From llvm-testresults at cs.uiuc.edu Tue May 1 01:09:05 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 1 May 2012 03:09:05 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120501080905.9E09F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/475?compare_to=474&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 475, Order: 155896, Start Time: 2012-05-01 07:12:15, End Time: 2012-05-01 08:09:36 To: 474, Order: 155884, Start Time: 2012-05-01 05:46:07, End Time: 2012-05-01 06:43:10 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (49 on baseline) Performance Improvements: 1 (24 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 891 (815 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/ary3: -1.20% (3.7450 => 3.6999, std. dev.: 0.0056) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.91% (2.0176 => 2.2780, std. dev.: 0.0088) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.97% (0.2721 => 0.2829, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.77% (0.3130 => 0.3248, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.38% (3.9660 => 4.0999, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 2.84% (13.8202 => 14.2124, std. dev.: 0.0056) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.79% (1.4563 => 1.4970, std. dev.: 0.0015) SingleSource/UnitTests/ObjC++/property-reference: 2.63% (0.7061 => 0.7247, std. dev.: 0.0033) SingleSource/UnitTests/ObjC++/property-reference-object: 2.56% (0.5818 => 0.5967, std. dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 2.54% (16.6129 => 17.0355, std. dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.49% (0.5265 => 0.5396, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.42% (1.2193 => 1.2488, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.37% (0.6959 => 0.7124, std. dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/football/football: 2.30% (0.8310 => 0.8501, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/Hello: 2.30% (0.5748 => 0.5880, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 1.95% (0.7506 => 0.7652, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.92% (0.9199 => 0.9376, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.84% (0.5637 => 0.5741, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.80% (3.6692 => 3.7354, std. dev.: 0.0047) MultiSource/Applications/hbd/hbd: 1.65% (1.3693 => 1.3919, std. dev.: 0.0081) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.65% (13.2842 => 13.5030, std. dev.: 0.0239) MultiSource/Applications/siod/siod: 1.62% (2.1791 => 2.2145, std. dev.: 0.0063) MultiSource/Applications/lambda-0_1_3/lambda: 1.58% (0.7038 => 0.7149, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/gs/gs: 1.57% (3.8646 => 3.9252, std. dev.: 0.0079) MultiSource/Applications/hexxagon/hexxagon: 1.56% (1.2292 => 1.2484, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.54% (1.1333 => 1.1508, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.53% (1.9828 => 2.0132, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.53% (1.3245 => 1.3448, std. dev.: 0.0019) MultiSource/Applications/Burg/burg: 1.50% (1.1061 => 1.1227, std. dev.: 0.0037) MultiSource/Applications/JM/ldecod/ldecod: 1.47% (6.5754 => 6.6723, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.42% (1.3819 => 1.4015, std. dev.: 0.0006) MultiSource/Applications/treecc/treecc: 1.41% (1.9270 => 1.9541, std. dev.: 0.0045) MultiSource/Applications/JM/lencod/lencod: 1.22% (14.8535 => 15.0342, std. dev.: 0.0102) MultiSource/Applications/SIBsim4/SIBsim4: 1.21% (1.2749 => 1.2903, std. dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.10% (2.1007 => 2.1238, std. dev.: 0.0013) MultiSource/Benchmarks/Bullet/bullet: 1.05% (33.2944 => 33.6450, std. dev.: 0.0453) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 23.92% (1.8175 => 2.2523, std. dev.: 0.0077) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0007) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6755, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8147, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 3.70% (7.4271 => 7.7018, std. dev.: 0.0043) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.66% (1.7688 => 1.8335, std. dev.: 0.0052) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 3.26% (0.9692 => 1.0008, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4554, std. dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.92% (8.8259 => 9.0834, std. dev.: 0.0074) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.40% (7.9275 => 8.1177, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/ffbench: 2.24% (0.8273 => 0.8458, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.27% (2.0200 => 2.0456, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0033) MultiSource/Benchmarks/sim/sim: 1.10% (5.0168 => 5.0720, std. dev.: 0.0091) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.40% (0.2670 => 0.2499, std. dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.90% (0.3511 => 0.3304, std. dev.: 0.0042) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.02% (0.8818 => 0.8640, std. dev.: 0.0010) MultiSource/Applications/lua/lua: -1.02% (3.7467 => 3.7086, std. dev.: 0.0125) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/richards_benchmark: -12.76% (1.1560 => 1.0085, std. dev.: 0.0053) SingleSource/Benchmarks/McGill/chomp: -10.26% (1.2308 => 1.1045, std. dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.11% (1.0460 => 0.9402, std. dev.: 0.0034) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.56% (0.3139 => 0.2933, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9473, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.61% (1.3780 => 1.3145, std. dev.: 0.0030) MultiSource/Benchmarks/FreeBench/neural/neural: -4.33% (0.2333 => 0.2232, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -3.65% (1.9762 => 1.9040, std. dev.: 0.0083) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.61% (0.3458 => 0.3333, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -2.09% (6.3560 => 6.2232, std. dev.: 0.0100) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.94% (6.6320 => 6.5032, std. dev.: 0.0009) MultiSource/Applications/minisat/minisat: -1.70% (9.3358 => 9.1767, std. dev.: 0.0254) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3446, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/ReedSolomon: -1.66% (7.1097 => 6.9915, std. dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -1.53% (7.3305 => 7.2183, std. dev.: 0.0089) MultiSource/Applications/lua/lua: -1.50% (26.5159 => 26.1181, std. dev.: 0.0364) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.49% (20.3410 => 20.0389, std. dev.: 0.0667) SingleSource/Benchmarks/Shootout/heapsort: -1.46% (3.9173 => 3.8600, std. dev.: 0.0055) MultiSource/Applications/spiff/spiff: -1.21% (3.0263 => 2.9898, std. dev.: 0.0003) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.23s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue May 1 02:31:55 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 1 May 2012 04:31:55 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120501093155.D37562A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/476?compare_to=475&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 476, Order: 155900, Start Time: 2012-05-01 08:35:06, End Time: 2012-05-01 09:32:27 To: 475, Order: 155896, Start Time: 2012-05-01 07:12:15, End Time: 2012-05-01 08:09:36 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (56 on baseline) Performance Improvements: 0 (25 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (807 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.02% (2.0176 => 2.2802, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.25% (0.3130 => 0.3263, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.12% (0.2721 => 0.2833, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.73% (3.9660 => 4.1141, std. dev.: 0.0044) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.07% (1.4563 => 1.5010, std. dev.: 0.0075) MultiSource/Applications/SPASS/SPASS: 2.92% (13.8202 => 14.2237, std. dev.: 0.0075) MultiSource/Benchmarks/nbench/nbench: 2.76% (1.0594 => 1.0886, std. dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.64% (0.5265 => 0.5404, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.56% (1.2193 => 1.2505, std. dev.: 0.0080) MultiSource/Applications/kimwitu++/kc: 2.51% (16.6129 => 17.0307, std. dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.50% (0.6959 => 0.7133, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference: 2.44% (0.7061 => 0.7233, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/football/football: 2.43% (0.8310 => 0.8512, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: 2.34% (0.5818 => 0.5954, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.25% (1.1364 => 1.1620, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 2.17% (0.5748 => 0.5873, std. dev.: 0.0009) MultiSource/Applications/spiff/spiff: 2.14% (0.7506 => 0.7667, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.08% (0.9199 => 0.9390, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.95% (0.5637 => 0.5747, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.88% (1.1333 => 1.1546, std. dev.: 0.0025) MultiSource/Applications/siod/siod: 1.79% (2.1791 => 2.2181, std. dev.: 0.0038) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.74% (13.2842 => 13.5158, std. dev.: 0.0187) MultiSource/Benchmarks/MallocBench/gs/gs: 1.70% (3.8646 => 3.9304, std. dev.: 0.0055) MultiSource/Applications/lambda-0_1_3/lambda: 1.68% (0.7038 => 0.7156, std. dev.: 0.0011) MultiSource/Applications/Burg/burg: 1.65% (1.1061 => 1.1243, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.64% (1.3819 => 1.4045, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.61% (0.7710 => 0.7834, std. dev.: 0.0029) MultiSource/Applications/treecc/treecc: 1.58% (1.9270 => 1.9575, std. dev.: 0.0025) MultiSource/Applications/hbd/hbd: 1.53% (1.3693 => 1.3902, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.52% (1.3813 => 1.4023, std. dev.: 0.0011) MultiSource/Applications/SIBsim4/SIBsim4: 1.47% (1.2749 => 1.2937, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.46% (3.6692 => 3.7227, std. dev.: 0.0056) MultiSource/Applications/hexxagon/hexxagon: 1.40% (1.2292 => 1.2464, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.37% (0.7460 => 0.7562, std. dev.: 0.0011) MultiSource/Applications/JM/lencod/lencod: 1.34% (14.8535 => 15.0525, std. dev.: 0.0134) MultiSource/Applications/sqlite3/sqlite3: 1.32% (16.2614 => 16.4766, std. dev.: 0.0128) MultiSource/Applications/JM/ldecod/ldecod: 1.28% (6.5754 => 6.6595, std. dev.: 0.0143) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.23% (2.1007 => 2.1266, std. dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: 1.10% (33.2944 => 33.6594, std. dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.09% (1.9828 => 2.0044, std. dev.: 0.0016) MultiSource/Applications/d/make_dparser: 1.05% (3.1889 => 3.2224, std. dev.: 0.0106) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 23.69% (1.8175 => 2.2481, std. dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.86% (1.5824 => 1.6752, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8146, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 3.70% (7.4271 => 7.7018, std. dev.: 0.0056) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.65% (1.7688 => 1.8334, std. dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 3.23% (0.9692 => 1.0005, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4550, std. dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.79% (8.8259 => 9.0724, std. dev.: 0.0175) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.40% (7.9275 => 8.1179, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/ffbench: 2.24% (0.8273 => 0.8458, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.25% (2.0200 => 2.0453, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bisort/bisort: 1.25% (0.8239 => 0.8342, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) MultiSource/Benchmarks/sim/sim: 1.00% (5.0168 => 5.0672, std. dev.: 0.0191) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -17.99% (0.4657 => 0.3819, std. dev.: 0.0055) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.40% (0.2670 => 0.2499, std. dev.: 0.0020) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.75% (0.3511 => 0.3309, std. dev.: 0.0035) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.01% (0.8818 => 0.8641, std. dev.: 0.0008) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/richards_benchmark: -12.72% (1.1560 => 1.0089, std. dev.: 0.0042) SingleSource/Benchmarks/McGill/chomp: -10.31% (1.2308 => 1.1039, std. dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.12% (1.0460 => 0.9401, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.53% (0.3139 => 0.2934, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.09% (1.3780 => 1.3078, std. dev.: 0.0072) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9472, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.33% (0.2333 => 0.2232, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.73% (0.3458 => 0.3329, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.64% (1.9762 => 1.9042, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/lists: -2.22% (6.3560 => 6.2150, std. dev.: 0.0091) MultiSource/Applications/minisat/minisat: -2.06% (9.3358 => 9.1433, std. dev.: 0.0053) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.92% (6.6320 => 6.5046, std. dev.: 0.0059) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3444, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.67% (7.1097 => 6.9911, std. dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -1.51% (7.3305 => 7.2198, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout/heapsort: -1.50% (3.9173 => 3.8585, std. dev.: 0.0027) MultiSource/Applications/lua/lua: -1.34% (26.5159 => 26.1619, std. dev.: 0.0339) MultiSource/Applications/spiff/spiff: -1.18% (3.0263 => 2.9906, std. dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.15% (20.3410 => 20.1069, std. dev.: 0.0303) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.02% (3.8887 => 3.8490, std. dev.: 0.0013) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.45s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue May 1 03:54:37 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 1 May 2012 05:54:37 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120501105437.2E1172A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/477?compare_to=476&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 477, Order: 155906, Start Time: 2012-05-01 09:57:52, End Time: 2012-05-01 10:55:08 To: 476, Order: 155900, Start Time: 2012-05-01 08:35:06, End Time: 2012-05-01 09:32:27 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (69 on baseline) Performance Improvements: 0 (23 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 891 (796 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 20.84% (0.3819 => 0.4615, std. dev.: 0.0027) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.92% (2.0176 => 2.2783, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.48% (0.2721 => 0.2843, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.38% (0.3130 => 0.3267, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.96% (3.9660 => 4.1230, std. dev.: 0.0024) MultiSource/Applications/SPASS/SPASS: 3.70% (13.8202 => 14.3312, std. dev.: 0.0173) MultiSource/Applications/kimwitu++/kc: 3.47% (16.6129 => 17.1897, std. dev.: 0.0170) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.42% (1.4563 => 1.5061, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.32% (0.5265 => 0.5440, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 3.24% (1.0594 => 1.0937, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.13% (0.6959 => 0.7177, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.00% (1.2193 => 1.2559, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/football/football: 2.91% (0.8310 => 0.8552, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.87% (0.3899 => 0.4011, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.64% (1.1364 => 1.1664, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.63% (0.4791 => 0.4917, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 2.58% (2.1791 => 2.2354, std. dev.: 0.0037) MultiSource/Applications/lambda-0_1_3/lambda: 2.57% (0.7038 => 0.7219, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.53% (0.9199 => 0.9432, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: 2.45% (0.7506 => 0.7690, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/gs/gs: 2.45% (3.8646 => 3.9593, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.32% (0.5637 => 0.5768, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference: 2.31% (0.7061 => 0.7224, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.18% (13.2842 => 13.5734, std. dev.: 0.0065) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.14% (1.1333 => 1.1576, std. dev.: 0.0006) MultiSource/Applications/treecc/treecc: 2.14% (1.9270 => 1.9682, std. dev.: 0.0022) SingleSource/UnitTests/ObjC++/property-reference-object: 2.13% (0.5818 => 0.5942, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.13% (1.3245 => 1.3527, std. dev.: 0.0008) MultiSource/Applications/Burg/burg: 2.11% (1.1061 => 1.1294, std. dev.: 0.0043) MultiSource/Applications/hbd/hbd: 2.09% (1.3693 => 1.3979, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.93% (0.6283 => 0.6404, std. dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 1.92% (1.2749 => 1.2994, std. dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.92% (2.1007 => 2.1410, std. dev.: 0.0149) MultiSource/Applications/minisat/minisat: 1.90% (0.6744 => 0.6872, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.85% (3.6692 => 3.7369, std. dev.: 0.0044) SingleSource/UnitTests/ObjC++/Hello: 1.84% (0.5748 => 0.5854, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.81% (1.3819 => 1.4069, std. dev.: 0.0058) MultiSource/Applications/hexxagon/hexxagon: 1.80% (1.2292 => 1.2513, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.78% (0.7460 => 0.7593, std. dev.: 0.0015) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.75% (0.7710 => 0.7845, std. dev.: 0.0011) MultiSource/Applications/JM/lencod/lencod: 1.74% (14.8535 => 15.1124, std. dev.: 0.0091) MultiSource/Benchmarks/Bullet/bullet: 1.72% (33.2944 => 33.8682, std. dev.: 0.0172) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.68% (1.3813 => 1.4045, std. dev.: 0.0016) MultiSource/Applications/d/make_dparser: 1.62% (3.1889 => 3.2407, std. dev.: 0.0052) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.62% (3.2742 => 3.3271, std. dev.: 0.0061) MultiSource/Applications/sqlite3/sqlite3: 1.61% (16.2614 => 16.5228, std. dev.: 0.0013) MultiSource/Applications/JM/ldecod/ldecod: 1.60% (6.5754 => 6.6809, std. dev.: 0.0081) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.53% (1.5188 => 1.5420, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.51% (1.9828 => 2.0127, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.38% (0.8698 => 0.8818, std. dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.27% (22.5627 => 22.8489, std. dev.: 0.0223) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.27% (4.9865 => 5.0497, std. dev.: 0.0081) MultiSource/Applications/oggenc/oggenc: 1.24% (4.6629 => 4.7207, std. dev.: 0.0025) MultiSource/Applications/ClamAV/clamscan: 1.23% (14.5298 => 14.7080, std. dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.17% (7.2180 => 7.3021, std. dev.: 0.0052) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.16% (4.3801 => 4.4311, std. dev.: 0.0068) MultiSource/Applications/lemon/lemon: 1.10% (1.0313 => 1.0426, std. dev.: 0.0007) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.22% (1.8175 => 2.2577, std. dev.: 0.0225) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6754, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8146, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.66% (1.7688 => 1.8336, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: 3.63% (7.4271 => 7.6970, std. dev.: 0.0067) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 3.25% (0.9692 => 1.0007, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4536, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.77% (8.8259 => 9.0701, std. dev.: 0.0110) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.56% (7.9275 => 8.1307, std. dev.: 0.0052) SingleSource/Benchmarks/Misc/ffbench: 2.26% (0.8273 => 0.8460, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.29% (2.0200 => 2.0460, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.10% (0.2670 => 0.2507, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.70% (0.3511 => 0.3311, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.52% (0.8818 => 0.8684, std. dev.: 0.0011) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/richards_benchmark: -12.17% (1.1560 => 1.0153, std. dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.12% (1.0460 => 0.9401, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -9.64% (1.2308 => 1.1121, std. dev.: 0.0070) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.53% (0.3139 => 0.2934, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.46% (1.3780 => 1.3027, std. dev.: 0.0090) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9474, std. dev.: 0.0004) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.33% (0.2333 => 0.2232, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.73% (0.3458 => 0.3329, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -3.64% (1.9762 => 1.9043, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -2.06% (6.3560 => 6.2252, std. dev.: 0.0026) MultiSource/Applications/minisat/minisat: -2.01% (9.3358 => 9.1477, std. dev.: 0.0046) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.88% (6.6320 => 6.5075, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.66% (7.1097 => 6.9916, std. dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -1.40% (7.3305 => 7.2277, std. dev.: 0.0232) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.39% (20.3410 => 20.0592, std. dev.: 0.0412) SingleSource/Benchmarks/Shootout/heapsort: -1.37% (3.9173 => 3.8636, std. dev.: 0.0035) MultiSource/Applications/lua/lua: -1.20% (26.5159 => 26.1987, std. dev.: 0.0160) MultiSource/Applications/spiff/spiff: -1.17% (3.0263 => 2.9908, std. dev.: 0.0017) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.17s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue May 1 05:17:14 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 1 May 2012 07:17:14 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120501121714.39A3D2A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/478?compare_to=477&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 478, Order: 155909, Start Time: 2012-05-01 11:20:29, End Time: 2012-05-01 12:17:45 To: 477, Order: 155906, Start Time: 2012-05-01 09:57:52, End Time: 2012-05-01 10:55:08 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (66 on baseline) Performance Improvements: 1 (24 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 891 (798 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -2.99% (0.4615 => 0.4477, std. dev.: 0.0022) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.07% (2.0176 => 2.2812, std. dev.: 0.0133) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.52% (0.2721 => 0.2844, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.15% (0.3130 => 0.3260, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.01% (3.9660 => 4.1249, std. dev.: 0.0102) MultiSource/Applications/SPASS/SPASS: 3.71% (13.8202 => 14.3324, std. dev.: 0.0061) MultiSource/Applications/kimwitu++/kc: 3.51% (16.6129 => 17.1967, std. dev.: 0.0068) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.30% (1.4563 => 1.5044, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.25% (0.5265 => 0.5436, std. dev.: 0.0023) MultiSource/Benchmarks/nbench/nbench: 3.11% (1.0594 => 1.0924, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.06% (0.6959 => 0.7172, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference: 2.97% (0.7061 => 0.7271, std. dev.: 0.0027) SingleSource/UnitTests/ObjC++/property-reference-object: 2.97% (0.5818 => 0.5991, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.96% (1.2193 => 1.2554, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/football/football: 2.76% (0.8310 => 0.8539, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 2.73% (0.5748 => 0.5905, std. dev.: 0.0010) MultiSource/Applications/spiff/spiff: 2.64% (0.7506 => 0.7704, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.60% (0.9199 => 0.9438, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.55% (0.4791 => 0.4913, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.54% (1.1364 => 1.1653, std. dev.: 0.0035) MultiSource/Applications/siod/siod: 2.53% (2.1791 => 2.2343, std. dev.: 0.0104) MultiSource/Benchmarks/MallocBench/gs/gs: 2.43% (3.8646 => 3.9586, std. dev.: 0.0103) MultiSource/Applications/lambda-0_1_3/lambda: 2.39% (0.7038 => 0.7206, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.29% (0.5637 => 0.5766, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.27% (0.7460 => 0.7629, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.22% (13.2842 => 13.5797, std. dev.: 0.0101) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.22% (1.3245 => 1.3539, std. dev.: 0.0024) MultiSource/Applications/Burg/burg: 2.20% (1.1061 => 1.1304, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.10% (0.5577 => 0.5694, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.09% (2.1007 => 2.1445, std. dev.: 0.0165) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.07% (1.1333 => 1.1568, std. dev.: 0.0006) MultiSource/Applications/treecc/treecc: 2.04% (1.9270 => 1.9663, std. dev.: 0.0046) MultiSource/Applications/hbd/hbd: 2.03% (1.3693 => 1.3971, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.02% (0.7710 => 0.7866, std. dev.: 0.0020) MultiSource/Applications/hexxagon/hexxagon: 1.99% (1.2292 => 1.2537, std. dev.: 0.0005) MultiSource/Applications/minisat/minisat: 1.94% (0.6744 => 0.6875, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.91% (3.6692 => 3.7392, std. dev.: 0.0119) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.75% (1.3819 => 1.4061, std. dev.: 0.0019) MultiSource/Applications/JM/lencod/lencod: 1.71% (14.8535 => 15.1071, std. dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.62% (1.5188 => 1.5434, std. dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 1.61% (6.5754 => 6.6814, std. dev.: 0.0053) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.59% (3.2742 => 3.3263, std. dev.: 0.0069) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.58% (1.3813 => 1.4031, std. dev.: 0.0012) MultiSource/Applications/SIBsim4/SIBsim4: 1.55% (1.2749 => 1.2946, std. dev.: 0.0075) MultiSource/Benchmarks/Bullet/bullet: 1.47% (33.2944 => 33.7831, std. dev.: 0.0051) MultiSource/Applications/d/make_dparser: 1.43% (3.1889 => 3.2346, std. dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.43% (0.8698 => 0.8822, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 1.39% (16.2614 => 16.4870, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.34% (4.3801 => 4.4388, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.34% (7.2180 => 7.3144, std. dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: 1.27% (14.5298 => 14.7144, std. dev.: 0.0077) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.17% (22.5627 => 22.8270, std. dev.: 0.0131) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.12% (4.9865 => 5.0421, std. dev.: 0.0073) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.07% (4.4433 => 4.4907, std. dev.: 0.0031) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 23.92% (1.8175 => 2.2523, std. dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.90% (1.5824 => 1.6758, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8146, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 3.70% (7.4271 => 7.7017, std. dev.: 0.0031) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.69% (1.7688 => 1.8341, std. dev.: 0.0141) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 3.18% (0.9692 => 1.0000, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4553, std. dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.73% (8.8259 => 9.0671, std. dev.: 0.0073) SingleSource/Benchmarks/Misc/ffbench: 2.24% (0.8273 => 0.8458, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.06% (7.9275 => 8.0905, std. dev.: 0.0165) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.30% (2.0200 => 2.0463, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0074) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.96% (0.2670 => 0.2511, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.64% (0.3511 => 0.3313, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: -3.87% (0.4657 => 0.4477, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.59% (0.8818 => 0.8678, std. dev.: 0.0013) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/richards_benchmark: -12.24% (1.1560 => 1.0145, std. dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.12% (1.0460 => 0.9401, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -9.72% (1.2308 => 1.1112, std. dev.: 0.0025) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.59% (0.3139 => 0.2932, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9473, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.49% (1.3780 => 1.3161, std. dev.: 0.0061) MultiSource/Benchmarks/FreeBench/neural/neural: -4.33% (0.2333 => 0.2232, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.73% (0.3458 => 0.3329, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.66% (1.9762 => 1.9038, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/lists: -2.16% (6.3560 => 6.2190, std. dev.: 0.0118) MultiSource/Applications/minisat/minisat: -2.01% (9.3358 => 9.1479, std. dev.: 0.0319) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.91% (6.6320 => 6.5053, std. dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.73% (20.3410 => 19.9889, std. dev.: 0.0579) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: -1.67% (7.1097 => 6.9913, std. dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -1.53% (7.3305 => 7.2185, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout/heapsort: -1.40% (3.9173 => 3.8623, std. dev.: 0.0038) MultiSource/Applications/lua/lua: -1.30% (26.5159 => 26.1719, std. dev.: 0.0118) MultiSource/Applications/spiff/spiff: -1.13% (3.0263 => 2.9922, std. dev.: 0.0006) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.19s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue May 1 07:35:16 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 1 May 2012 09:35:16 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120501143516.B52E62A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/479?compare_to=478&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 479, Order: 155913, Start Time: 2012-05-01 13:38:30, End Time: 2012-05-01 14:35:48 To: 478, Order: 155909, Start Time: 2012-05-01 11:20:29, End Time: 2012-05-01 12:17:45 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (67 on baseline) Performance Improvements: 0 (24 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (797 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.10% (2.0176 => 2.2820, std. dev.: 0.0154) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.56% (0.2721 => 0.2845, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.06% (0.3130 => 0.3257, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.92% (3.9660 => 4.1214, std. dev.: 0.0115) MultiSource/Applications/SPASS/SPASS: 3.69% (13.8202 => 14.3302, std. dev.: 0.0016) MultiSource/Applications/kimwitu++/kc: 3.42% (16.6129 => 17.1806, std. dev.: 0.0129) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.25% (1.4563 => 1.5036, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.17% (0.5265 => 0.5432, std. dev.: 0.0014) SingleSource/UnitTests/ObjC++/property-reference: 3.13% (0.7061 => 0.7282, std. dev.: 0.0033) MultiSource/Benchmarks/nbench/nbench: 3.08% (1.0594 => 1.0920, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.97% (0.6959 => 0.7166, std. dev.: 0.0016) SingleSource/UnitTests/ObjC++/property-reference-object: 2.94% (0.5818 => 0.5989, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.91% (1.2193 => 1.2548, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/football/football: 2.77% (0.8310 => 0.8540, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/Hello: 2.71% (0.5748 => 0.5904, std. dev.: 0.0011) MultiSource/Applications/spiff/spiff: 2.57% (0.7506 => 0.7699, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.56% (1.1364 => 1.1655, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.53% (0.9199 => 0.9432, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 2.50% (2.1791 => 2.2336, std. dev.: 0.0075) MultiSource/Benchmarks/MallocBench/gs/gs: 2.40% (3.8646 => 3.9574, std. dev.: 0.0084) MultiSource/Applications/lambda-0_1_3/lambda: 2.32% (0.7038 => 0.7201, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.25% (0.5637 => 0.5764, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.21% (13.2842 => 13.5775, std. dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.08% (0.6283 => 0.6414, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.08% (0.5577 => 0.5693, std. dev.: 0.0014) MultiSource/Applications/treecc/treecc: 2.07% (1.9270 => 1.9669, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.06% (1.1333 => 1.1567, std. dev.: 0.0005) MultiSource/Applications/Burg/burg: 2.06% (1.1061 => 1.1289, std. dev.: 0.0013) MultiSource/Applications/hbd/hbd: 2.04% (1.3693 => 1.3973, std. dev.: 0.0025) MultiSource/Applications/minisat/minisat: 2.03% (0.6744 => 0.6881, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.03% (1.3245 => 1.3514, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.99% (2.1007 => 2.1426, std. dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 1.99% (1.2292 => 1.2537, std. dev.: 0.0040) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.89% (0.7710 => 0.7856, std. dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.86% (3.2742 => 3.3352, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.84% (3.6692 => 3.7368, std. dev.: 0.0096) MultiSource/Applications/SIBsim4/SIBsim4: 1.79% (1.2749 => 1.2977, std. dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.75% (1.9828 => 2.0174, std. dev.: 0.0010) MultiSource/Applications/JM/lencod/lencod: 1.71% (14.8535 => 15.1068, std. dev.: 0.0026) MultiSource/Applications/JM/ldecod/ldecod: 1.66% (6.5754 => 6.6847, std. dev.: 0.0017) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.66% (0.7460 => 0.7584, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.62% (1.3819 => 1.4043, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.60% (1.3813 => 1.4034, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.50% (1.5188 => 1.5416, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.44% (0.8698 => 0.8823, std. dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: 1.42% (33.2944 => 33.7673, std. dev.: 0.0188) MultiSource/Applications/d/make_dparser: 1.37% (3.1889 => 3.2325, std. dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: 1.35% (16.2614 => 16.4814, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.32% (7.2180 => 7.3132, std. dev.: 0.0026) MultiSource/Applications/ClamAV/clamscan: 1.27% (14.5298 => 14.7144, std. dev.: 0.0111) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.21% (4.9865 => 5.0470, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.19% (4.3801 => 4.4321, std. dev.: 0.0072) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.15% (22.5627 => 22.8214, std. dev.: 0.0204) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.10% (4.4433 => 4.4923, std. dev.: 0.0024) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.28% (1.8175 => 2.2587, std. dev.: 0.0452) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.85% (1.5824 => 1.6750, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8146, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 3.71% (7.4271 => 7.7029, std. dev.: 0.0018) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.64% (1.7688 => 1.8331, std. dev.: 0.0186) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 3.28% (0.9692 => 1.0010, std. dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4543, std. dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.54% (8.8259 => 9.0505, std. dev.: 0.0349) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.54% (7.9275 => 8.1287, std. dev.: 0.0103) SingleSource/Benchmarks/Misc/ffbench: 2.25% (0.8273 => 0.8459, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.25% (2.0200 => 2.0452, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0080) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.99% (0.2670 => 0.2510, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.58% (0.3511 => 0.3315, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.54% (0.8818 => 0.8682, std. dev.: 0.0005) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/richards_benchmark: -11.97% (1.1560 => 1.0176, std. dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.12% (1.0460 => 0.9401, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -9.79% (1.2308 => 1.1103, std. dev.: 0.0043) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.53% (0.3139 => 0.2934, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9472, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.53% (1.3780 => 1.3156, std. dev.: 0.0039) MultiSource/Benchmarks/FreeBench/neural/neural: -4.33% (0.2333 => 0.2232, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.73% (0.3458 => 0.3329, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -3.70% (1.9762 => 1.9030, std. dev.: 0.0047) SingleSource/Benchmarks/Shootout/lists: -2.14% (6.3560 => 6.2201, std. dev.: 0.0079) MultiSource/Applications/minisat/minisat: -1.98% (9.3358 => 9.1512, std. dev.: 0.0258) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.93% (6.6320 => 6.5040, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.66% (7.1097 => 6.9914, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.59% (20.3410 => 20.0171, std. dev.: 0.0745) MultiSource/Benchmarks/Bullet/bullet: -1.57% (7.3305 => 7.2157, std. dev.: 0.0031) MultiSource/Applications/lua/lua: -1.48% (26.5159 => 26.1247, std. dev.: 0.0207) SingleSource/Benchmarks/Shootout/heapsort: -1.36% (3.9173 => 3.8639, std. dev.: 0.0021) MultiSource/Applications/spiff/spiff: -1.08% (3.0263 => 2.9936, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.02% (2.5254 => 2.4997, std. dev.: 0.0033) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.16s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue May 1 09:01:15 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 1 May 2012 11:01:15 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120501160115.E0DDE2A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/480?compare_to=479&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 480, Order: 155915, Start Time: 2012-05-01 15:04:32, End Time: 2012-05-01 16:01:47 To: 479, Order: 155913, Start Time: 2012-05-01 13:38:30, End Time: 2012-05-01 14:35:48 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (67 on baseline) Performance Improvements: 0 (25 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (796 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.35% (2.0176 => 2.2869, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.34% (0.2721 => 0.2839, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.31% (3.9660 => 4.1370, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.90% (0.3130 => 0.3252, std. dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 3.39% (16.6129 => 17.1754, std. dev.: 0.0081) MultiSource/Applications/SPASS/SPASS: 3.35% (13.8202 => 14.2834, std. dev.: 0.0039) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.03% (1.4563 => 1.5004, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.02% (0.5265 => 0.5424, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 3.01% (1.0594 => 1.0913, std. dev.: 0.0044) SingleSource/UnitTests/ObjC++/property-reference: 2.86% (0.7061 => 0.7263, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.85% (0.3899 => 0.4010, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.85% (0.6959 => 0.7157, std. dev.: 0.0016) SingleSource/UnitTests/ObjC++/property-reference-object: 2.75% (0.5818 => 0.5978, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.73% (1.2193 => 1.2526, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/football/football: 2.71% (0.8310 => 0.8535, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/Hello: 2.57% (0.5748 => 0.5896, std. dev.: 0.0000) MultiSource/Applications/spiff/spiff: 2.45% (0.7506 => 0.7690, std. dev.: 0.0020) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.44% (1.1364 => 1.1641, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.38% (0.4791 => 0.4905, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.37% (0.9199 => 0.9417, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/gs/gs: 2.31% (3.8646 => 3.9539, std. dev.: 0.0025) MultiSource/Applications/lambda-0_1_3/lambda: 2.29% (0.7038 => 0.7199, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.25% (0.5637 => 0.5764, std. dev.: 0.0019) MultiSource/Applications/siod/siod: 2.24% (2.1791 => 2.2279, std. dev.: 0.0031) MultiSource/Applications/Burg/burg: 1.98% (1.1061 => 1.1280, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.95% (0.5577 => 0.5686, std. dev.: 0.0008) MultiSource/Applications/hbd/hbd: 1.95% (1.3693 => 1.3960, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.94% (13.2842 => 13.5423, std. dev.: 0.0076) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.93% (1.1333 => 1.1552, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.90% (1.3245 => 1.3497, std. dev.: 0.0036) MultiSource/Applications/treecc/treecc: 1.87% (1.9270 => 1.9630, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.86% (0.6283 => 0.6400, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 1.82% (1.2292 => 1.2516, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.82% (3.6692 => 3.7359, std. dev.: 0.0110) MultiSource/Applications/minisat/minisat: 1.81% (0.6744 => 0.6866, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.78% (2.1007 => 2.1381, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.69% (1.9828 => 2.0164, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.65% (0.7710 => 0.7837, std. dev.: 0.0046) MultiSource/Applications/SIBsim4/SIBsim4: 1.59% (1.2749 => 1.2952, std. dev.: 0.0017) MultiSource/Applications/JM/lencod/lencod: 1.54% (14.8535 => 15.0825, std. dev.: 0.0039) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.54% (1.3819 => 1.4032, std. dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 1.53% (6.5754 => 6.6762, std. dev.: 0.0025) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.51% (0.7460 => 0.7573, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.46% (1.3813 => 1.4014, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.38% (3.2742 => 3.3193, std. dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.30% (0.8698 => 0.8811, std. dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: 1.24% (33.2944 => 33.7080, std. dev.: 0.0210) MultiSource/Applications/d/make_dparser: 1.23% (3.1889 => 3.2280, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.21% (4.3801 => 4.4329, std. dev.: 0.0035) MultiSource/Applications/ClamAV/clamscan: 1.20% (14.5298 => 14.7035, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.11% (7.2180 => 7.2982, std. dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: 1.04% (16.2614 => 16.4313, std. dev.: 0.0085) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.02% (4.9865 => 5.0373, std. dev.: 0.0018) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.14% (1.8175 => 2.2563, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.86% (1.5824 => 1.6752, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8146, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 3.72% (7.4271 => 7.7031, std. dev.: 0.0036) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.57% (1.7688 => 1.8319, std. dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 3.29% (0.9692 => 1.0011, std. dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4550, std. dev.: 0.0017) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.65% (8.8259 => 9.0594, std. dev.: 0.0223) SingleSource/Benchmarks/Misc/ffbench: 2.19% (0.8273 => 0.8454, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.08% (7.9275 => 8.0924, std. dev.: 0.0116) MultiSource/Benchmarks/sim/sim: 1.36% (5.0168 => 5.0849, std. dev.: 0.0078) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.26% (2.0200 => 2.0454, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -17.35% (0.4657 => 0.3849, std. dev.: 0.0127) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.07% (0.2670 => 0.2508, std. dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.87% (0.3511 => 0.3305, std. dev.: 0.0035) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.68% (0.8818 => 0.8670, std. dev.: 0.0014) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/richards_benchmark: -11.83% (1.1560 => 1.0193, std. dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.11% (1.0460 => 0.9402, std. dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: -9.73% (1.2308 => 1.1111, std. dev.: 0.0017) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.53% (0.3139 => 0.2934, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9472, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.81% (1.3780 => 1.3117, std. dev.: 0.0051) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.33% (0.2333 => 0.2232, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.71% (1.9762 => 1.9028, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -2.29% (6.3560 => 6.2104, std. dev.: 0.0093) MultiSource/Applications/minisat/minisat: -1.94% (9.3358 => 9.1545, std. dev.: 0.0224) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.90% (6.6320 => 6.5061, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3446, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.67% (7.1097 => 6.9911, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/heapsort: -1.48% (3.9173 => 3.8594, std. dev.: 0.0059) MultiSource/Benchmarks/Bullet/bullet: -1.46% (7.3305 => 7.2233, std. dev.: 0.0081) MultiSource/Applications/lua/lua: -1.40% (26.5159 => 26.1446, std. dev.: 0.0093) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.18% (20.3410 => 20.1015, std. dev.: 0.0069) MultiSource/Applications/spiff/spiff: -1.12% (3.0263 => 2.9924, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: -1.01% (11.2619 => 11.1484, std. dev.: 0.0018) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.28s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue May 1 10:23:52 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 1 May 2012 12:23:52 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120501172352.C07882A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/481?compare_to=480&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 481, Order: 155917, Start Time: 2012-05-01 16:27:19, End Time: 2012-05-01 17:24:24 To: 480, Order: 155915, Start Time: 2012-05-01 15:04:32, End Time: 2012-05-01 16:01:47 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (61 on baseline) Performance Improvements: 0 (28 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (799 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.06% (2.0176 => 2.2810, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.26% (0.2721 => 0.2837, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.64% (0.3130 => 0.3244, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.58% (3.9660 => 4.1080, std. dev.: 0.0033) MultiSource/Applications/SPASS/SPASS: 2.95% (13.8202 => 14.2284, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.94% (0.5265 => 0.5420, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.86% (1.4563 => 1.4980, std. dev.: 0.0033) MultiSource/Benchmarks/nbench/nbench: 2.79% (1.0594 => 1.0890, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference: 2.78% (0.7061 => 0.7257, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.77% (0.6959 => 0.7152, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 2.70% (0.5818 => 0.5975, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.66% (1.2193 => 1.2517, std. dev.: 0.0050) MultiSource/Applications/kimwitu++/kc: 2.66% (16.6129 => 17.0540, std. dev.: 0.0107) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.59% (0.3899 => 0.4000, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: 2.54% (0.5748 => 0.5894, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 2.48% (0.8310 => 0.8516, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.37% (1.1364 => 1.1633, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.34% (0.9199 => 0.9414, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: 2.29% (0.7506 => 0.7678, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.29% (0.5637 => 0.5766, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.15% (0.4791 => 0.4894, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 1.99% (3.8646 => 3.9416, std. dev.: 0.0050) MultiSource/Applications/hexxagon/hexxagon: 1.95% (1.2292 => 1.2532, std. dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 1.92% (0.7038 => 0.7173, std. dev.: 0.0006) MultiSource/Applications/siod/siod: 1.89% (2.1791 => 2.2202, std. dev.: 0.0114) MultiSource/Applications/hbd/hbd: 1.87% (1.3693 => 1.3949, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.85% (0.5577 => 0.5680, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.85% (13.2842 => 13.5293, std. dev.: 0.0129) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.81% (0.7460 => 0.7595, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.80% (1.3245 => 1.3484, std. dev.: 0.0005) MultiSource/Applications/Burg/burg: 1.78% (1.1061 => 1.1258, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.77% (1.1333 => 1.1534, std. dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.77% (1.9828 => 2.0179, std. dev.: 0.0038) MultiSource/Applications/treecc/treecc: 1.75% (1.9270 => 1.9607, std. dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.67% (0.6283 => 0.6388, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.64% (3.6692 => 3.7295, std. dev.: 0.0017) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.54% (0.7710 => 0.7829, std. dev.: 0.0016) MultiSource/Applications/SIBsim4/SIBsim4: 1.47% (1.2749 => 1.2937, std. dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 1.44% (14.8535 => 15.0678, std. dev.: 0.0096) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.39% (2.1007 => 2.1299, std. dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 1.38% (6.5754 => 6.6662, std. dev.: 0.0120) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.35% (1.3819 => 1.4006, std. dev.: 0.0039) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.35% (1.3813 => 1.3999, std. dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.17% (3.2742 => 3.3126, std. dev.: 0.0018) MultiSource/Applications/sqlite3/sqlite3: 1.13% (16.2614 => 16.4453, std. dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.13% (7.2180 => 7.2996, std. dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: 1.12% (33.2944 => 33.6667, std. dev.: 0.0030) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.03% (1.8175 => 2.2542, std. dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7298, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6754, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 3.78% (7.4271 => 7.7080, std. dev.: 0.0027) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.63% (1.7688 => 1.8330, std. dev.: 0.0056) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 3.25% (0.9692 => 1.0007, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4544, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.62% (8.8259 => 9.0567, std. dev.: 0.0174) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.25% (7.9275 => 8.1061, std. dev.: 0.0234) SingleSource/Benchmarks/Misc/ffbench: 2.24% (0.8273 => 0.8458, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: 1.46% (5.0168 => 5.0901, std. dev.: 0.0069) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.26% (2.0200 => 2.0455, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2135, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -21.22% (0.4657 => 0.3669, std. dev.: 0.0221) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.44% (0.2670 => 0.2498, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.15% (0.3511 => 0.3295, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.54% (0.6576 => 0.6475, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.38% (0.8818 => 0.8696, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/richards_benchmark: -12.87% (1.1560 => 1.0072, std. dev.: 0.0067) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.12% (1.0460 => 0.9401, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -9.71% (1.2308 => 1.1113, std. dev.: 0.0013) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.50% (0.3139 => 0.2935, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.04% (1.3780 => 1.3086, std. dev.: 0.0107) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9473, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.33% (0.2333 => 0.2232, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.63% (1.9762 => 1.9045, std. dev.: 0.0101) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.59% (0.3458 => 0.3334, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -2.13% (6.3560 => 6.2209, std. dev.: 0.0025) MultiSource/Applications/minisat/minisat: -2.04% (9.3358 => 9.1454, std. dev.: 0.0131) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.89% (6.6320 => 6.5064, std. dev.: 0.0043) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.66% (7.1097 => 6.9915, std. dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -1.51% (7.3305 => 7.2196, std. dev.: 0.0088) MultiSource/Applications/lua/lua: -1.46% (26.5159 => 26.1285, std. dev.: 0.0396) SingleSource/Benchmarks/Shootout/heapsort: -1.44% (3.9173 => 3.8607, std. dev.: 0.0021) MultiSource/Applications/spiff/spiff: -1.12% (3.0263 => 2.9924, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.04% (3.8887 => 3.8481, std. dev.: 0.0087) MultiSource/Benchmarks/nbench/nbench: -1.03% (11.2619 => 11.1462, std. dev.: 0.0046) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.02% (20.3410 => 20.1331, std. dev.: 0.0091) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.01% (2.5254 => 2.5000, std. dev.: 0.0030) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.27s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue May 1 11:46:19 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 1 May 2012 13:46:19 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120501184619.B1B8B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/482?compare_to=481&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 482, Order: 155919, Start Time: 2012-05-01 17:49:44, End Time: 2012-05-01 18:46:51 To: 481, Order: 155917, Start Time: 2012-05-01 16:27:19, End Time: 2012-05-01 17:24:24 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (66 on baseline) Performance Improvements: 0 (24 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (798 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.70% (2.0176 => 2.2940, std. dev.: 0.0044) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.56% (0.2721 => 0.2845, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.12% (0.3130 => 0.3259, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.80% (3.9660 => 4.1169, std. dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 3.52% (13.8202 => 14.3068, std. dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.17% (0.5265 => 0.5432, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.09% (1.4563 => 1.5013, std. dev.: 0.0020) MultiSource/Applications/kimwitu++/kc: 3.03% (16.6129 => 17.1169, std. dev.: 0.0129) MultiSource/Benchmarks/nbench/nbench: 3.03% (1.0594 => 1.0915, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.92% (0.6959 => 0.7162, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.86% (1.2193 => 1.2542, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 2.72% (0.8310 => 0.8536, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.60% (1.1364 => 1.1659, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.54% (0.5637 => 0.5780, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.45% (0.9199 => 0.9424, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.42% (0.4791 => 0.4907, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 2.35% (0.7061 => 0.7227, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.35% (13.2842 => 13.5963, std. dev.: 0.0080) MultiSource/Applications/spiff/spiff: 2.34% (0.7506 => 0.7682, std. dev.: 0.0015) SingleSource/UnitTests/ObjC++/property-reference-object: 2.22% (0.5818 => 0.5947, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 2.19% (3.8646 => 3.9492, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.08% (0.5577 => 0.5693, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 2.05% (0.7038 => 0.7182, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 2.03% (2.1791 => 2.2234, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/Hello: 2.02% (0.5748 => 0.5864, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.99% (1.1333 => 1.1559, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 1.96% (1.3693 => 1.3962, std. dev.: 0.0019) MultiSource/Applications/Burg/burg: 1.96% (1.1061 => 1.1278, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.94% (0.7460 => 0.7605, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 1.92% (1.9270 => 1.9640, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.91% (1.3245 => 1.3498, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.88% (3.6692 => 3.7380, std. dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.86% (0.6283 => 0.6400, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.85% (0.7710 => 0.7853, std. dev.: 0.0011) MultiSource/Applications/JM/lencod/lencod: 1.71% (14.8535 => 15.1074, std. dev.: 0.0062) MultiSource/Applications/JM/ldecod/ldecod: 1.66% (6.5754 => 6.6847, std. dev.: 0.0029) MultiSource/Applications/minisat/minisat: 1.60% (0.6744 => 0.6852, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.60% (1.3813 => 1.4034, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.51% (1.3819 => 1.4028, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.49% (2.1007 => 2.1320, std. dev.: 0.0006) MultiSource/Applications/d/make_dparser: 1.40% (3.1889 => 3.2335, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.35% (3.2742 => 3.3185, std. dev.: 0.0147) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.25% (1.9828 => 2.0075, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.21% (7.2180 => 7.3056, std. dev.: 0.0025) MultiSource/Applications/sqlite3/sqlite3: 1.21% (16.2614 => 16.4577, std. dev.: 0.0025) MultiSource/Benchmarks/Bullet/bullet: 1.16% (33.2944 => 33.6806, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.16% (4.3801 => 4.4307, std. dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 1.14% (14.5298 => 14.6960, std. dev.: 0.0061) MultiSource/Applications/oggenc/oggenc: 1.09% (4.6629 => 4.7136, std. dev.: 0.0042) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.03% (4.4433 => 4.4890, std. dev.: 0.0022) MultiSource/Benchmarks/mafft/pairlocalalign: 1.02% (8.4961 => 8.5827, std. dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.01% (1.5188 => 1.5341, std. dev.: 0.0012) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 23.94% (1.8175 => 2.2527, std. dev.: 0.0430) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.86% (1.5824 => 1.6752, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8146, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 3.73% (7.4271 => 7.7044, std. dev.: 0.0029) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.65% (1.7688 => 1.8334, std. dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 3.27% (0.9692 => 1.0009, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.01% (12.0921 => 12.4556, std. dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.78% (8.8259 => 9.0710, std. dev.: 0.0040) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.50% (7.9275 => 8.1253, std. dev.: 0.0044) SingleSource/Benchmarks/Misc/ffbench: 2.20% (0.8273 => 0.8455, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 1.53% (5.0168 => 5.0936, std. dev.: 0.0050) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.24% (2.0200 => 2.0451, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -20.23% (0.4657 => 0.3715, std. dev.: 0.0089) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.07% (0.2670 => 0.2508, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.41% (0.3511 => 0.3321, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.13% (0.8818 => 0.8718, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/richards_benchmark: -12.08% (1.1560 => 1.0164, std. dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: -10.13% (1.2308 => 1.1061, std. dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.12% (1.0460 => 0.9401, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.53% (0.3139 => 0.2934, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.93% (1.3780 => 1.3101, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9472, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.33% (0.2333 => 0.2232, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.70% (1.9762 => 1.9031, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.61% (0.3458 => 0.3333, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -2.01% (6.3560 => 6.2283, std. dev.: 0.0070) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.78% (6.6320 => 6.5138, std. dev.: 0.0012) MultiSource/Applications/minisat/minisat: -1.72% (9.3358 => 9.1753, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.66% (7.1097 => 6.9916, std. dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: -1.48% (7.3305 => 7.2220, std. dev.: 0.0086) SingleSource/Benchmarks/Shootout/heapsort: -1.43% (3.9173 => 3.8611, std. dev.: 0.0054) MultiSource/Applications/lua/lua: -1.28% (26.5159 => 26.1753, std. dev.: 0.0241) MultiSource/Applications/spiff/spiff: -1.25% (3.0263 => 2.9884, std. dev.: 0.0023) MultiSource/Benchmarks/nbench/nbench: -1.01% (11.2619 => 11.1484, std. dev.: 0.0027) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.20s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue May 1 13:08:51 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 1 May 2012 15:08:51 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120501200851.813592A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/483?compare_to=482&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 483, Order: 155926, Start Time: 2012-05-01 19:12:11, End Time: 2012-05-01 20:09:23 To: 482, Order: 155919, Start Time: 2012-05-01 17:49:44, End Time: 2012-05-01 18:46:51 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (59 on baseline) Performance Improvements: 0 (24 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 890 (805 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 8.75% (0.3715 => 0.4040, std. dev.: 0.0034) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lambda-0_1_3/lambda: 3.81% (5.3592 => 5.5635, std. dev.: 0.0703) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.68% (2.0176 => 2.2734, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.19% (0.2721 => 0.2835, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.58% (0.3130 => 0.3242, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.44% (3.9660 => 4.1024, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.96% (0.5265 => 0.5421, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.95% (1.4563 => 1.4992, std. dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 2.93% (13.8202 => 14.2247, std. dev.: 0.0057) MultiSource/Applications/kimwitu++/kc: 2.81% (16.6129 => 17.0802, std. dev.: 0.0037) MultiSource/Benchmarks/nbench/nbench: 2.64% (1.0594 => 1.0874, std. dev.: 0.0102) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.62% (0.3899 => 0.4001, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.58% (1.2193 => 1.2508, std. dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.54% (0.6959 => 0.7136, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: 2.54% (0.7061 => 0.7240, std. dev.: 0.0020) SingleSource/UnitTests/ObjC++/property-reference-object: 2.51% (0.5818 => 0.5964, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: 2.33% (0.7506 => 0.7681, std. dev.: 0.0016) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.32% (1.1364 => 1.1628, std. dev.: 0.0089) MultiSource/Benchmarks/Prolangs-C/football/football: 2.31% (0.8310 => 0.8502, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.30% (0.9199 => 0.9411, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.29% (0.5637 => 0.5766, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 2.23% (0.5748 => 0.5876, std. dev.: 0.0038) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.04% (0.7710 => 0.7867, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.98% (13.2842 => 13.5475, std. dev.: 0.0102) MultiSource/Applications/Burg/burg: 1.94% (1.1061 => 1.1276, std. dev.: 0.0035) MultiSource/Benchmarks/MallocBench/gs/gs: 1.88% (3.8646 => 3.9372, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 1.84% (2.1791 => 2.2191, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.81% (0.5577 => 0.5678, std. dev.: 0.0010) MultiSource/Applications/hbd/hbd: 1.80% (1.3693 => 1.3939, std. dev.: 0.0021) MultiSource/Applications/lambda-0_1_3/lambda: 1.75% (0.7038 => 0.7161, std. dev.: 0.0014) MultiSource/Applications/hexxagon/hexxagon: 1.72% (1.2292 => 1.2504, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.70% (1.3245 => 1.3470, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.68% (1.1333 => 1.1523, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.66% (0.7460 => 0.7584, std. dev.: 0.0001) MultiSource/Applications/treecc/treecc: 1.62% (1.9270 => 1.9583, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.50% (1.9828 => 2.0126, std. dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: 1.43% (1.2749 => 1.2931, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.38% (3.6692 => 3.7199, std. dev.: 0.0064) MultiSource/Applications/JM/lencod/lencod: 1.33% (14.8535 => 15.0507, std. dev.: 0.0036) MultiSource/Applications/JM/ldecod/ldecod: 1.31% (6.5754 => 6.6618, std. dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.29% (2.1007 => 2.1278, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.16% (1.3813 => 1.3973, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.11% (1.3819 => 1.3972, std. dev.: 0.0015) MultiSource/Applications/sqlite3/sqlite3: 1.08% (16.2614 => 16.4377, std. dev.: 0.0179) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.04% (3.2742 => 3.3083, std. dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.00% (7.2180 => 7.2903, std. dev.: 0.0084) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.21% (1.8175 => 2.2576, std. dev.: 0.0446) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7298, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.86% (1.5824 => 1.6752, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 4.64% (5.3167 => 5.5635, std. dev.: 0.0703) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.63% (1.7688 => 1.8330, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/salsa20: 3.63% (7.4271 => 7.6964, std. dev.: 0.0070) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 3.26% (0.9692 => 1.0008, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4543, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.82% (8.8259 => 9.0745, std. dev.: 0.0101) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.27% (7.9275 => 8.1076, std. dev.: 0.0148) SingleSource/Benchmarks/Misc/ffbench: 2.20% (0.8273 => 0.8455, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.28% (2.0200 => 2.0458, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0001) MultiSource/Benchmarks/sim/sim: 1.08% (5.0168 => 5.0709, std. dev.: 0.0108) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -13.25% (0.4657 => 0.4040, std. dev.: 0.0034) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.40% (0.2670 => 0.2499, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.18% (0.3511 => 0.3294, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.76% (0.8818 => 0.8663, std. dev.: 0.0006) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/richards_benchmark: -12.57% (1.1560 => 1.0107, std. dev.: 0.0046) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.11% (1.0460 => 0.9402, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -9.69% (1.2308 => 1.1115, std. dev.: 0.0023) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.53% (0.3139 => 0.2934, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.88% (1.3780 => 1.3107, std. dev.: 0.0045) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9474, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.33% (0.2333 => 0.2232, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.73% (0.3458 => 0.3329, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.63% (1.9762 => 1.9045, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout/lists: -2.06% (6.3560 => 6.2253, std. dev.: 0.0068) MultiSource/Applications/minisat/minisat: -1.97% (9.3358 => 9.1523, std. dev.: 0.0052) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.86% (6.6320 => 6.5087, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.66% (7.1097 => 6.9917, std. dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -1.52% (7.3305 => 7.2194, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout/heapsort: -1.36% (3.9173 => 3.8641, std. dev.: 0.0071) MultiSource/Applications/lua/lua: -1.34% (26.5159 => 26.1616, std. dev.: 0.0250) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.24% (20.3410 => 20.0880, std. dev.: 0.0126) MultiSource/Applications/spiff/spiff: -1.12% (3.0263 => 2.9925, std. dev.: 0.0006) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.30s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue May 1 14:31:39 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 1 May 2012 16:31:39 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120501213139.7112D2A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/484?compare_to=483&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 484, Order: 155932, Start Time: 2012-05-01 20:35:02, End Time: 2012-05-01 21:32:10 To: 483, Order: 155926, Start Time: 2012-05-01 19:12:11, End Time: 2012-05-01 20:09:23 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (59 on baseline) Performance Improvements: 0 (24 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (805 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.80% (2.0176 => 2.2759, std. dev.: 0.0046) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.23% (0.2721 => 0.2836, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.77% (0.3130 => 0.3248, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.62% (3.9660 => 4.1095, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.02% (0.5265 => 0.5424, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.97% (1.4563 => 1.4996, std. dev.: 0.0022) MultiSource/Applications/SPASS/SPASS: 2.93% (13.8202 => 14.2251, std. dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.74% (0.6959 => 0.7150, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 2.69% (1.0594 => 1.0879, std. dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 2.69% (16.6129 => 17.0595, std. dev.: 0.0089) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.63% (1.2193 => 1.2514, std. dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.46% (1.1364 => 1.1644, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.43% (0.5637 => 0.5774, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/football/football: 2.42% (0.8310 => 0.8511, std. dev.: 0.0027) MultiSource/Applications/spiff/spiff: 2.41% (0.7506 => 0.7687, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.40% (0.9199 => 0.9420, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 2.39% (0.7061 => 0.7230, std. dev.: 0.0021) SingleSource/UnitTests/ObjC++/property-reference-object: 2.30% (0.5818 => 0.5952, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.15% (0.4791 => 0.4894, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 2.14% (0.5748 => 0.5871, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.05% (0.7710 => 0.7868, std. dev.: 0.0016) MultiSource/Benchmarks/MallocBench/gs/gs: 2.01% (3.8646 => 3.9421, std. dev.: 0.0051) MultiSource/Applications/siod/siod: 1.99% (2.1791 => 2.2225, std. dev.: 0.0011) MultiSource/Applications/Burg/burg: 1.99% (1.1061 => 1.1281, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.87% (1.3245 => 1.3493, std. dev.: 0.0057) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.87% (13.2842 => 13.5327, std. dev.: 0.0059) MultiSource/Applications/hbd/hbd: 1.85% (1.3693 => 1.3947, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.84% (1.1333 => 1.1542, std. dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.83% (0.5577 => 0.5679, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.77% (0.7460 => 0.7592, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 1.72% (1.9270 => 1.9602, std. dev.: 0.0112) MultiSource/Applications/hexxagon/hexxagon: 1.64% (1.2292 => 1.2493, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.51% (3.6692 => 3.7246, std. dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.50% (1.9828 => 2.0126, std. dev.: 0.0015) MultiSource/Applications/minisat/minisat: 1.50% (0.6744 => 0.6845, std. dev.: 0.0010) MultiSource/Applications/JM/lencod/lencod: 1.44% (14.8535 => 15.0681, std. dev.: 0.0081) MultiSource/Applications/SIBsim4/SIBsim4: 1.44% (1.2749 => 1.2932, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.37% (1.3813 => 1.4002, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.36% (2.1007 => 2.1293, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.36% (1.3819 => 1.4007, std. dev.: 0.0045) MultiSource/Applications/JM/ldecod/ldecod: 1.26% (6.5754 => 6.6583, std. dev.: 0.0015) MultiSource/Benchmarks/Bullet/bullet: 1.11% (33.2944 => 33.6646, std. dev.: 0.0117) MultiSource/Applications/d/make_dparser: 1.10% (3.1889 => 3.2240, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.05% (1.5188 => 1.5348, std. dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.03% (7.2180 => 7.2922, std. dev.: 0.0013) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.30% (1.8175 => 2.2592, std. dev.: 0.0076) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6754, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.72% (1.7688 => 1.8346, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 3.57% (7.4271 => 7.6919, std. dev.: 0.0101) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 3.26% (0.9692 => 1.0008, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4540, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.62% (8.8259 => 9.0574, std. dev.: 0.0252) SingleSource/Benchmarks/Misc/ffbench: 2.25% (0.8273 => 0.8459, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.21% (7.9275 => 8.1026, std. dev.: 0.0220) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.29% (2.0200 => 2.0460, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 1.19% (5.0168 => 5.0766, std. dev.: 0.0072) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2135, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -16.10% (0.4657 => 0.3907, std. dev.: 0.0078) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.40% (0.2670 => 0.2499, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.32% (0.3511 => 0.3289, std. dev.: 0.0053) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.79% (0.8818 => 0.8660, std. dev.: 0.0039) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/richards_benchmark: -12.32% (1.1560 => 1.0136, std. dev.: 0.0042) SingleSource/Benchmarks/McGill/chomp: -10.55% (1.2308 => 1.1009, std. dev.: 0.0055) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.11% (1.0460 => 0.9402, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.53% (0.3139 => 0.2934, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.93% (1.3780 => 1.3100, std. dev.: 0.0086) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9473, std. dev.: 0.0006) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.33% (0.2333 => 0.2232, std. dev.: 0.0011) MultiSource/Benchmarks/Olden/bh/bh: -3.68% (1.9762 => 1.9034, std. dev.: 0.0014) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.61% (0.3458 => 0.3333, std. dev.: 0.0000) MultiSource/Applications/minisat/minisat: -2.11% (9.3358 => 9.1387, std. dev.: 0.0176) SingleSource/Benchmarks/Shootout/lists: -2.00% (6.3560 => 6.2287, std. dev.: 0.0060) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.86% (6.6320 => 6.5085, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.66% (7.1097 => 6.9918, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/heapsort: -1.47% (3.9173 => 3.8599, std. dev.: 0.0065) MultiSource/Applications/lua/lua: -1.46% (26.5159 => 26.1287, std. dev.: 0.0260) MultiSource/Benchmarks/Bullet/bullet: -1.46% (7.3305 => 7.2235, std. dev.: 0.0072) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.45% (20.3410 => 20.0461, std. dev.: 0.0428) MultiSource/Applications/spiff/spiff: -1.09% (3.0263 => 2.9934, std. dev.: 0.0011) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.61s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue May 1 15:55:14 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 1 May 2012 17:55:14 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120501225514.5EA992A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/485?compare_to=484&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 485, Order: 155948, Start Time: 2012-05-01 21:58:35, End Time: 2012-05-01 22:55:45 To: 484, Order: 155932, Start Time: 2012-05-01 20:35:02, End Time: 2012-05-01 21:32:10 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (58 on baseline) Performance Improvements: 0 (24 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (806 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.03% (2.0176 => 2.2805, std. dev.: 0.0053) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.37% (0.2721 => 0.2840, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.67% (0.3130 => 0.3245, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.58% (3.9660 => 4.1079, std. dev.: 0.0109) MultiSource/Applications/SPASS/SPASS: 2.99% (13.8202 => 14.2333, std. dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.91% (0.5265 => 0.5418, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.89% (1.4563 => 1.4984, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.89% (0.6959 => 0.7160, std. dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 2.79% (16.6129 => 17.0758, std. dev.: 0.0081) MultiSource/Benchmarks/nbench/nbench: 2.65% (1.0594 => 1.0875, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.61% (1.2193 => 1.2511, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/football/football: 2.41% (0.8310 => 0.8510, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.37% (0.9199 => 0.9417, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.36% (0.5637 => 0.5770, std. dev.: 0.0032) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.25% (1.1364 => 1.1620, std. dev.: 0.0021) MultiSource/Applications/spiff/spiff: 2.25% (0.7506 => 0.7675, std. dev.: 0.0014) SingleSource/UnitTests/ObjC++/property-reference-object: 2.23% (0.5818 => 0.5948, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 2.21% (0.7061 => 0.7217, std. dev.: 0.0022) MultiSource/Benchmarks/MallocBench/gs/gs: 2.04% (3.8646 => 3.9436, std. dev.: 0.0024) MultiSource/Applications/lambda-0_1_3/lambda: 2.03% (0.7038 => 0.7181, std. dev.: 0.0052) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.96% (0.7710 => 0.7861, std. dev.: 0.0041) MultiSource/Applications/hbd/hbd: 1.87% (1.3693 => 1.3949, std. dev.: 0.0022) MultiSource/Applications/siod/siod: 1.86% (2.1791 => 2.2197, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 1.86% (0.5748 => 0.5855, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.83% (13.2842 => 13.5272, std. dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.82% (1.1333 => 1.1539, std. dev.: 0.0048) MultiSource/Applications/Burg/burg: 1.82% (1.1061 => 1.1262, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.81% (0.5577 => 0.5678, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 1.80% (1.9270 => 1.9616, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.74% (1.3245 => 1.3476, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 1.70% (1.2292 => 1.2501, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.62% (1.9828 => 2.0150, std. dev.: 0.0115) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.53% (3.6692 => 3.7254, std. dev.: 0.0040) MultiSource/Applications/minisat/minisat: 1.51% (0.6744 => 0.6846, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.49% (1.3819 => 1.4025, std. dev.: 0.0030) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.43% (1.3813 => 1.4011, std. dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 1.31% (14.8535 => 15.0486, std. dev.: 0.0121) MultiSource/Applications/SIBsim4/SIBsim4: 1.31% (1.2749 => 1.2916, std. dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 1.31% (6.5754 => 6.6613, std. dev.: 0.0054) MultiSource/Applications/d/make_dparser: 1.16% (3.1889 => 3.2259, std. dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: 1.09% (33.2944 => 33.6573, std. dev.: 0.0221) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.07% (7.2180 => 7.2949, std. dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 1.02% (14.5298 => 14.6774, std. dev.: 0.0140) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.30% (1.8175 => 2.2591, std. dev.: 0.0060) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.89% (1.5824 => 1.6756, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.69% (1.7688 => 1.8341, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: 3.64% (7.4271 => 7.6978, std. dev.: 0.0059) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 3.18% (0.9692 => 1.0000, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 3.01% (12.0921 => 12.4557, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.98% (8.8259 => 9.0889, std. dev.: 0.0124) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.26% (7.9275 => 8.1063, std. dev.: 0.0065) SingleSource/Benchmarks/Misc/ffbench: 2.24% (0.8273 => 0.8458, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 1.31% (10.7476 => 10.8887, std. dev.: 0.0079) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.25% (2.0200 => 2.0453, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 1.01% (5.0168 => 5.0677, std. dev.: 0.0113) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.07% (0.2670 => 0.2508, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.10% (0.3511 => 0.3332, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.69% (0.8818 => 0.8669, std. dev.: 0.0057) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/richards_benchmark: -12.11% (1.1560 => 1.0160, std. dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.11% (1.0460 => 0.9402, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -9.69% (1.2308 => 1.1115, std. dev.: 0.0024) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.59% (0.3139 => 0.2932, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.10% (1.3780 => 1.3077, std. dev.: 0.0082) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9473, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.33% (0.2333 => 0.2232, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.73% (0.3458 => 0.3329, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -3.65% (1.9762 => 1.9040, std. dev.: 0.0031) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -2.05% (6.6320 => 6.4962, std. dev.: 0.0058) SingleSource/Benchmarks/Shootout/lists: -2.04% (6.3560 => 6.2262, std. dev.: 0.0081) MultiSource/Applications/minisat/minisat: -2.04% (9.3358 => 9.1457, std. dev.: 0.0150) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3446, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.66% (7.1097 => 6.9914, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.61% (20.3410 => 20.0145, std. dev.: 0.0421) MultiSource/Benchmarks/Bullet/bullet: -1.43% (7.3305 => 7.2256, std. dev.: 0.0096) SingleSource/Benchmarks/Shootout/heapsort: -1.42% (3.9173 => 3.8618, std. dev.: 0.0037) MultiSource/Applications/lua/lua: -1.35% (26.5159 => 26.1591, std. dev.: 0.0214) MultiSource/Applications/spiff/spiff: -1.22% (3.0263 => 2.9894, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.07% (3.8887 => 3.8469, std. dev.: 0.0024) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.39s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue May 1 19:35:07 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 1 May 2012 21:35:07 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120502023507.1CEFB2A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/486?compare_to=485&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 486, Order: 155971, Start Time: 2012-05-02 01:38:26, End Time: 2012-05-02 02:35:39 To: 485, Order: 155948, Start Time: 2012-05-01 21:58:35, End Time: 2012-05-01 22:55:45 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (67 on baseline) Performance Improvements: 0 (25 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 891 (796 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 1.28% (7.9636 => 8.0652, std. dev.: 0.0039) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.66% (2.0176 => 2.2932, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.81% (0.2721 => 0.2852, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.99% (0.3130 => 0.3255, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.98% (3.9660 => 4.1238, std. dev.: 0.0092) MultiSource/Applications/SPASS/SPASS: 3.23% (13.8202 => 14.2670, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.15% (0.5265 => 0.5431, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.12% (1.4563 => 1.5018, std. dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 3.09% (16.6129 => 17.1262, std. dev.: 0.0225) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.97% (0.6959 => 0.7166, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 2.91% (1.0594 => 1.0902, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.80% (1.2193 => 1.2535, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.70% (1.1364 => 1.1671, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.62% (0.3899 => 0.4001, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 2.56% (0.8310 => 0.8523, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.47% (13.2842 => 13.6129, std. dev.: 0.0111) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.47% (0.9199 => 0.9426, std. dev.: 0.0008) MultiSource/Applications/spiff/spiff: 2.46% (0.7506 => 0.7691, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.41% (0.5637 => 0.5773, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.28% (0.4791 => 0.4900, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 2.20% (0.7061 => 0.7216, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.19% (0.7710 => 0.7879, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 2.19% (0.7038 => 0.7192, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 2.18% (3.8646 => 3.9489, std. dev.: 0.0102) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.15% (0.5577 => 0.5697, std. dev.: 0.0011) MultiSource/Applications/hbd/hbd: 2.15% (1.3693 => 1.3987, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.10% (1.3813 => 1.4103, std. dev.: 0.0008) MultiSource/Applications/siod/siod: 2.09% (2.1791 => 2.2246, std. dev.: 0.0009) MultiSource/Applications/Burg/burg: 2.07% (1.1061 => 1.1290, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.04% (1.3245 => 1.3515, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.02% (1.3819 => 1.4098, std. dev.: 0.0012) MultiSource/Applications/treecc/treecc: 2.00% (1.9270 => 1.9655, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference-object: 1.99% (0.5818 => 0.5934, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.94% (1.1333 => 1.1553, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.93% (0.7460 => 0.7604, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.92% (3.6692 => 3.7395, std. dev.: 0.0082) MultiSource/Applications/hexxagon/hexxagon: 1.90% (1.2292 => 1.2525, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 1.81% (0.5748 => 0.5852, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.78% (0.6744 => 0.6864, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.73% (1.9828 => 2.0171, std. dev.: 0.0029) MultiSource/Benchmarks/Bullet/bullet: 1.63% (33.2944 => 33.8360, std. dev.: 0.0060) MultiSource/Applications/SIBsim4/SIBsim4: 1.58% (1.2749 => 1.2951, std. dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: 1.56% (6.5754 => 6.6780, std. dev.: 0.0022) MultiSource/Applications/JM/lencod/lencod: 1.55% (14.8535 => 15.0835, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.51% (2.1007 => 2.1324, std. dev.: 0.0003) MultiSource/Applications/d/make_dparser: 1.42% (3.1889 => 3.2341, std. dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: 1.41% (14.5298 => 14.7352, std. dev.: 0.0053) MultiSource/Applications/sqlite3/sqlite3: 1.35% (16.2614 => 16.4812, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.27% (7.2180 => 7.3095, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.16% (4.3801 => 4.4308, std. dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.15% (1.5188 => 1.5363, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.05% (3.2742 => 3.3087, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.02% (4.9865 => 5.0374, std. dev.: 0.0027) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.16% (1.8175 => 2.2566, std. dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7298, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.86% (1.5824 => 1.6751, std. dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8147, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.64% (1.7688 => 1.8331, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/salsa20: 3.63% (7.4271 => 7.6966, std. dev.: 0.0078) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 3.25% (0.9692 => 1.0007, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4538, std. dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.84% (8.8259 => 9.0764, std. dev.: 0.0154) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.42% (7.9275 => 8.1194, std. dev.: 0.0099) SingleSource/Benchmarks/Misc/ffbench: 2.24% (0.8273 => 0.8458, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.27% (2.0200 => 2.0456, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bisort/bisort: 1.24% (0.8239 => 0.8341, std. dev.: 0.0005) MultiSource/Benchmarks/sim/sim: 1.22% (5.0168 => 5.0778, std. dev.: 0.0087) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0036) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.64% (0.3511 => 0.3313, std. dev.: 0.0028) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.36% (0.2670 => 0.2527, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.63% (0.8818 => 0.8674, std. dev.: 0.0042) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/richards_benchmark: -12.37% (1.1560 => 1.0130, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.12% (1.0460 => 0.9401, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.09% (1.2308 => 1.1066, std. dev.: 0.0025) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.53% (0.3139 => 0.2934, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.94% (1.3780 => 1.3099, std. dev.: 0.0084) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9473, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.33% (0.2333 => 0.2232, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.73% (0.3458 => 0.3329, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -3.67% (1.9762 => 1.9037, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -2.14% (6.6320 => 6.4904, std. dev.: 0.0100) SingleSource/Benchmarks/Shootout/lists: -2.10% (6.3560 => 6.2228, std. dev.: 0.0093) MultiSource/Applications/minisat/minisat: -2.00% (9.3358 => 9.1495, std. dev.: 0.0379) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3446, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.66% (7.1097 => 6.9914, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.55% (20.3410 => 20.0248, std. dev.: 0.0201) MultiSource/Benchmarks/Bullet/bullet: -1.50% (7.3305 => 7.2206, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout/heapsort: -1.48% (3.9173 => 3.8592, std. dev.: 0.0046) MultiSource/Applications/lua/lua: -1.40% (26.5159 => 26.1439, std. dev.: 0.0163) MultiSource/Applications/spiff/spiff: -1.27% (3.0263 => 2.9880, std. dev.: 0.0031) MultiSource/Benchmarks/nbench/nbench: -1.01% (11.2619 => 11.1483, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.00% (3.8887 => 3.8497, std. dev.: 0.0033) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.33s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue May 1 20:57:51 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 1 May 2012 22:57:51 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120502035751.2A2B32A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/487?compare_to=486&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 487, Order: 155975, Start Time: 2012-05-02 03:01:05, End Time: 2012-05-02 03:58:23 To: 486, Order: 155971, Start Time: 2012-05-02 01:38:26, End Time: 2012-05-02 02:35:39 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (68 on baseline) Performance Improvements: 0 (24 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 891 (796 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 1.77% (3.7570 => 3.8236, std. dev.: 0.0082) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.70% (2.0176 => 2.2940, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.81% (0.2721 => 0.2852, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.01% (3.9660 => 4.1250, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.83% (0.3130 => 0.3250, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.45% (1.4563 => 1.5065, std. dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.32% (0.5265 => 0.5440, std. dev.: 0.0020) MultiSource/Applications/SPASS/SPASS: 3.29% (13.8202 => 14.2752, std. dev.: 0.0074) MultiSource/Benchmarks/nbench/nbench: 3.00% (1.0594 => 1.0912, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.96% (1.2193 => 1.2554, std. dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.96% (0.6959 => 0.7165, std. dev.: 0.0025) MultiSource/Applications/kimwitu++/kc: 2.94% (16.6129 => 17.1007, std. dev.: 0.0043) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.81% (1.1364 => 1.1683, std. dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.64% (0.5637 => 0.5786, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.61% (0.9199 => 0.9439, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 2.59% (0.8310 => 0.8525, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: 2.57% (0.7506 => 0.7699, std. dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.53% (0.4791 => 0.4912, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.29% (13.2842 => 13.5885, std. dev.: 0.0123) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.21% (0.7460 => 0.7625, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.15% (0.5577 => 0.5697, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.14% (1.3813 => 1.4109, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: 2.12% (3.8646 => 3.9466, std. dev.: 0.0039) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.08% (1.3819 => 1.4106, std. dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.04% (1.1333 => 1.1564, std. dev.: 0.0079) MultiSource/Applications/hbd/hbd: 2.02% (1.3693 => 1.3969, std. dev.: 0.0027) MultiSource/Applications/siod/siod: 2.01% (2.1791 => 2.2230, std. dev.: 0.0121) MultiSource/Applications/Burg/burg: 2.01% (1.1061 => 1.1283, std. dev.: 0.0035) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.00% (0.7710 => 0.7864, std. dev.: 0.0031) MultiSource/Applications/lambda-0_1_3/lambda: 1.99% (0.7038 => 0.7178, std. dev.: 0.0012) MultiSource/Applications/treecc/treecc: 1.97% (1.9270 => 1.9649, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.96% (1.3245 => 1.3504, std. dev.: 0.0089) SingleSource/UnitTests/ObjC++/property-reference: 1.95% (0.7061 => 0.7199, std. dev.: 0.0020) MultiSource/Applications/JM/lencod/lencod: 1.86% (14.8535 => 15.1291, std. dev.: 0.0040) MultiSource/Applications/SIBsim4/SIBsim4: 1.84% (1.2749 => 1.2984, std. dev.: 0.0083) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.84% (3.6692 => 3.7368, std. dev.: 0.0019) SingleSource/UnitTests/ObjC++/property-reference-object: 1.82% (0.5818 => 0.5924, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: 1.78% (0.6744 => 0.6864, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.66% (0.6283 => 0.6387, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 1.62% (1.2292 => 1.2491, std. dev.: 0.0060) MultiSource/Applications/d/make_dparser: 1.61% (3.1889 => 3.2403, std. dev.: 0.0064) MultiSource/Applications/JM/ldecod/ldecod: 1.57% (6.5754 => 6.6787, std. dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.47% (2.1007 => 2.1316, std. dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.42% (7.2180 => 7.3204, std. dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.39% (1.9828 => 2.0103, std. dev.: 0.0047) MultiSource/Applications/sqlite3/sqlite3: 1.37% (16.2614 => 16.4842, std. dev.: 0.0176) MultiSource/Applications/ClamAV/clamscan: 1.33% (14.5298 => 14.7231, std. dev.: 0.0066) MultiSource/Benchmarks/Bullet/bullet: 1.28% (33.2944 => 33.7202, std. dev.: 0.0152) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.24% (0.8698 => 0.8806, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.19% (3.2742 => 3.3132, std. dev.: 0.0052) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.18% (4.4433 => 4.4956, std. dev.: 0.0046) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.16% (4.3801 => 4.4309, std. dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.13% (1.5188 => 1.5359, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.11% (4.9865 => 5.0418, std. dev.: 0.0073) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.31% (1.8175 => 2.2593, std. dev.: 0.0153) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.52% (2.5629 => 2.7299, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.86% (1.5824 => 1.6752, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.66% (1.7688 => 1.8336, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/salsa20: 3.54% (7.4271 => 7.6902, std. dev.: 0.0068) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 3.29% (0.9692 => 1.0011, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 3.01% (8.8259 => 9.0918, std. dev.: 0.0044) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4542, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ffbench: 2.22% (0.8273 => 0.8457, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.20% (7.9275 => 8.1016, std. dev.: 0.0129) MultiSource/Benchmarks/llubenchmark/llu: 1.34% (3.7731 => 3.8236, std. dev.: 0.0082) MultiSource/Benchmarks/sim/sim: 1.33% (5.0168 => 5.0833, std. dev.: 0.0050) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.26% (2.0200 => 2.0454, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -11.23% (0.4657 => 0.4134, std. dev.: 0.0110) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.81% (0.3511 => 0.3307, std. dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.47% (0.2670 => 0.2524, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.36% (0.8818 => 0.8698, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/richards_benchmark: -12.91% (1.1560 => 1.0068, std. dev.: 0.0055) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.12% (1.0460 => 0.9401, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -9.53% (1.2308 => 1.1135, std. dev.: 0.0132) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.59% (0.3139 => 0.2932, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.12% (1.3780 => 1.3074, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9473, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.33% (0.2333 => 0.2232, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.66% (1.9762 => 1.9039, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/lists: -2.20% (6.3560 => 6.2160, std. dev.: 0.0065) MultiSource/Applications/minisat/minisat: -2.02% (9.3358 => 9.1468, std. dev.: 0.0055) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.96% (6.6320 => 6.5018, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.67% (7.1097 => 6.9913, std. dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -1.49% (7.3305 => 7.2210, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout/heapsort: -1.47% (3.9173 => 3.8598, std. dev.: 0.0053) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.34% (20.3410 => 20.0677, std. dev.: 0.0347) MultiSource/Applications/lua/lua: -1.20% (26.5159 => 26.1969, std. dev.: 0.0089) MultiSource/Applications/spiff/spiff: -1.12% (3.0263 => 2.9924, std. dev.: 0.0010) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.81s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue May 1 22:20:28 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 2 May 2012 00:20:28 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120502052028.CE98C2A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/488?compare_to=487&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 488, Order: 155976, Start Time: 2012-05-02 04:23:50, End Time: 2012-05-02 05:21:00 To: 487, Order: 155975, Start Time: 2012-05-02 03:01:05, End Time: 2012-05-02 03:58:23 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (66 on baseline) Performance Improvements: 0 (25 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (797 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.66% (2.0176 => 2.2932, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.78% (0.2721 => 0.2851, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.99% (3.9660 => 4.1242, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.87% (0.3130 => 0.3251, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 3.43% (13.8202 => 14.2940, std. dev.: 0.0065) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.31% (1.4563 => 1.5045, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.30% (0.5265 => 0.5439, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 2.95% (1.0594 => 1.0907, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.90% (1.2193 => 1.2547, std. dev.: 0.0008) MultiSource/Applications/kimwitu++/kc: 2.90% (16.6129 => 17.0943, std. dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.89% (0.6959 => 0.7160, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.79% (1.1364 => 1.1681, std. dev.: 0.0009) MultiSource/Applications/spiff/spiff: 2.70% (0.7506 => 0.7709, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 2.70% (0.8310 => 0.8534, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.64% (0.9199 => 0.9442, std. dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.55% (0.5637 => 0.5781, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.30% (0.4791 => 0.4901, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.29% (13.2842 => 13.5878, std. dev.: 0.0043) MultiSource/Applications/hbd/hbd: 2.18% (1.3693 => 1.3991, std. dev.: 0.0045) MultiSource/Benchmarks/MallocBench/gs/gs: 2.16% (3.8646 => 3.9482, std. dev.: 0.0014) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.15% (0.7710 => 0.7876, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.15% (0.5577 => 0.5697, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.09% (1.3819 => 1.4108, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.08% (1.1333 => 1.1569, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 2.08% (0.7061 => 0.7208, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.07% (1.3813 => 1.4099, std. dev.: 0.0025) MultiSource/Applications/Burg/burg: 2.07% (1.1061 => 1.1290, std. dev.: 0.0013) MultiSource/Applications/lambda-0_1_3/lambda: 2.05% (0.7038 => 0.7182, std. dev.: 0.0043) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.04% (0.7460 => 0.7612, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 2.01% (2.1791 => 2.2230, std. dev.: 0.0021) MultiSource/Applications/treecc/treecc: 1.95% (1.9270 => 1.9646, std. dev.: 0.0027) SingleSource/UnitTests/ObjC++/property-reference-object: 1.91% (0.5818 => 0.5929, std. dev.: 0.0031) MultiSource/Applications/minisat/minisat: 1.90% (0.6744 => 0.6872, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.88% (1.3245 => 1.3494, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.81% (3.6692 => 3.7356, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.73% (0.6283 => 0.6392, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 1.73% (1.2292 => 1.2505, std. dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: 1.71% (1.2749 => 1.2967, std. dev.: 0.0023) MultiSource/Applications/JM/ldecod/ldecod: 1.60% (6.5754 => 6.6804, std. dev.: 0.0072) MultiSource/Applications/JM/lencod/lencod: 1.59% (14.8535 => 15.0893, std. dev.: 0.0064) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.50% (2.1007 => 2.1323, std. dev.: 0.0012) MultiSource/Applications/d/make_dparser: 1.43% (3.1889 => 3.2345, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.43% (1.9828 => 2.0111, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.40% (7.2180 => 7.3187, std. dev.: 0.0029) MultiSource/Applications/ClamAV/clamscan: 1.31% (14.5298 => 14.7196, std. dev.: 0.0035) MultiSource/Applications/sqlite3/sqlite3: 1.26% (16.2614 => 16.4659, std. dev.: 0.0102) MultiSource/Benchmarks/Bullet/bullet: 1.21% (33.2944 => 33.6969, std. dev.: 0.0113) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.16% (1.5188 => 1.5364, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.15% (0.8698 => 0.8798, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.11% (3.2742 => 3.3104, std. dev.: 0.0060) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.10% (4.4433 => 4.4923, std. dev.: 0.0050) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.08% (4.3801 => 4.4273, std. dev.: 0.0023) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.21% (1.8175 => 2.2575, std. dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.92% (1.5824 => 1.6761, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 3.66% (7.4271 => 7.6993, std. dev.: 0.0024) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.66% (1.7688 => 1.8335, std. dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 3.26% (0.9692 => 1.0008, std. dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4542, std. dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.64% (8.8259 => 9.0591, std. dev.: 0.0134) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.39% (7.9275 => 8.1168, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/ffbench: 2.21% (0.8273 => 0.8456, std. dev.: 0.0026) MultiSource/Benchmarks/sim/sim: 1.39% (5.0168 => 5.0864, std. dev.: 0.0080) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.29% (2.0200 => 2.0460, std. dev.: 0.0039) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2135, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -11.64% (0.4657 => 0.4115, std. dev.: 0.0077) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.58% (0.3511 => 0.3315, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.51% (0.2670 => 0.2523, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.37% (0.8818 => 0.8697, std. dev.: 0.0011) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/richards_benchmark: -12.50% (1.1560 => 1.0115, std. dev.: 0.0013) SingleSource/Benchmarks/McGill/chomp: -10.74% (1.2308 => 1.0986, std. dev.: 0.0059) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.12% (1.0460 => 0.9401, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.50% (0.3139 => 0.2935, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.54% (1.3780 => 1.3016, std. dev.: 0.0119) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9474, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.33% (0.2333 => 0.2232, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.68% (1.9762 => 1.9035, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/lists: -2.39% (6.3560 => 6.2043, std. dev.: 0.0153) MultiSource/Applications/minisat/minisat: -2.09% (9.3358 => 9.1408, std. dev.: 0.0080) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.96% (6.6320 => 6.5017, std. dev.: 0.0066) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.66% (7.1097 => 6.9916, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.65% (20.3410 => 20.0058, std. dev.: 0.1073) MultiSource/Benchmarks/Bullet/bullet: -1.41% (7.3305 => 7.2273, std. dev.: 0.0217) SingleSource/Benchmarks/Shootout/heapsort: -1.36% (3.9173 => 3.8639, std. dev.: 0.0044) MultiSource/Applications/spiff/spiff: -1.11% (3.0263 => 2.9926, std. dev.: 0.0007) MultiSource/Applications/lua/lua: -1.10% (26.5159 => 26.2231, std. dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.01% (3.8887 => 3.8496, std. dev.: 0.0045) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.44s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed May 2 00:00:51 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 2 May 2012 02:00:51 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120502070051.B76592A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/489?compare_to=488&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 489, Order: 155977, Start Time: 2012-05-02 06:03:46, End Time: 2012-05-02 07:01:22 To: 488, Order: 155976, Start Time: 2012-05-02 04:23:50, End Time: 2012-05-02 05:21:00 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (63 on baseline) Performance Improvements: 0 (22 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 891 (803 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.67% (1.3016 => 1.3234, std. dev.: 0.0007) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.74% (2.0176 => 2.2948, std. dev.: 0.0050) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.81% (0.2721 => 0.2852, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.99% (3.9660 => 4.1242, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.87% (0.3130 => 0.3251, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 3.38% (13.8202 => 14.2874, std. dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.36% (0.5265 => 0.5442, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.19% (1.4563 => 1.5028, std. dev.: 0.0027) MultiSource/Benchmarks/nbench/nbench: 2.95% (1.0594 => 1.0907, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.90% (1.2193 => 1.2547, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.85% (0.6959 => 0.7157, std. dev.: 0.0029) MultiSource/Applications/kimwitu++/kc: 2.83% (16.6129 => 17.0831, std. dev.: 0.0289) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.79% (1.1364 => 1.1681, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/football/football: 2.60% (0.8310 => 0.8526, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.54% (0.5637 => 0.5780, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.49% (0.9199 => 0.9428, std. dev.: 0.0006) MultiSource/Applications/spiff/spiff: 2.46% (0.7506 => 0.7691, std. dev.: 0.0014) MultiSource/Applications/hbd/hbd: 2.42% (1.3693 => 1.4025, std. dev.: 0.0038) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.29% (13.2842 => 13.5880, std. dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.28% (0.4791 => 0.4900, std. dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: 2.16% (0.7038 => 0.7190, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: 2.15% (3.8646 => 3.9478, std. dev.: 0.0078) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.12% (1.3819 => 1.4112, std. dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference: 2.11% (0.7061 => 0.7210, std. dev.: 0.0023) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.07% (1.3813 => 1.4099, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.06% (0.5577 => 0.5692, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.05% (1.1333 => 1.1565, std. dev.: 0.0018) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.01% (0.7460 => 0.7610, std. dev.: 0.0010) MultiSource/Applications/Burg/burg: 1.99% (1.1061 => 1.1281, std. dev.: 0.0018) MultiSource/Applications/treecc/treecc: 1.98% (1.9270 => 1.9651, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.94% (1.3245 => 1.3502, std. dev.: 0.0012) MultiSource/Applications/siod/siod: 1.93% (2.1791 => 2.2211, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.81% (3.6692 => 3.7356, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 1.80% (0.5818 => 0.5923, std. dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 1.75% (1.2749 => 1.2972, std. dev.: 0.0006) MultiSource/Applications/minisat/minisat: 1.72% (0.6744 => 0.6860, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.72% (0.6283 => 0.6391, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 1.63% (1.2292 => 1.2492, std. dev.: 0.0019) MultiSource/Applications/JM/lencod/lencod: 1.59% (14.8535 => 15.0893, std. dev.: 0.0619) MultiSource/Applications/JM/ldecod/ldecod: 1.55% (6.5754 => 6.6770, std. dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.51% (2.1007 => 2.1324, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.44% (7.2180 => 7.3216, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.43% (1.9828 => 2.0112, std. dev.: 0.0016) MultiSource/Applications/d/make_dparser: 1.35% (3.1889 => 3.2319, std. dev.: 0.0020) MultiSource/Applications/ClamAV/clamscan: 1.33% (14.5298 => 14.7225, std. dev.: 0.0125) MultiSource/Applications/sqlite3/sqlite3: 1.29% (16.2614 => 16.4710, std. dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.20% (0.8698 => 0.8802, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.12% (4.3801 => 4.4292, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.11% (1.5188 => 1.5356, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.09% (4.4433 => 4.4917, std. dev.: 0.0018) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.06% (1.8175 => 2.2547, std. dev.: 0.0096) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.84% (1.5824 => 1.6748, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.64% (1.7688 => 1.8331, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: 3.58% (7.4271 => 7.6932, std. dev.: 0.0060) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 3.29% (0.9692 => 1.0011, std. dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4541, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.68% (8.8259 => 9.0622, std. dev.: 0.0191) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.28% (7.9275 => 8.1082, std. dev.: 0.0195) SingleSource/Benchmarks/Misc/ffbench: 2.22% (0.8273 => 0.8457, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.28% (2.0200 => 2.0458, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 1.03% (5.0168 => 5.0686, std. dev.: 0.0125) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.81% (0.3511 => 0.3307, std. dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.51% (0.2670 => 0.2523, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.42% (0.8818 => 0.8693, std. dev.: 0.0013) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/richards_benchmark: -12.28% (1.1560 => 1.0141, std. dev.: 0.0033) SingleSource/Benchmarks/McGill/chomp: -10.30% (1.2308 => 1.1040, std. dev.: 0.0058) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.11% (1.0460 => 0.9402, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.50% (0.3139 => 0.2935, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9474, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.33% (0.2333 => 0.2232, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.96% (1.3780 => 1.3234, std. dev.: 0.0007) MultiSource/Benchmarks/Olden/bh/bh: -3.70% (1.9762 => 1.9030, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.67% (0.3458 => 0.3331, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -2.22% (6.3560 => 6.2152, std. dev.: 0.0050) MultiSource/Applications/minisat/minisat: -1.99% (9.3358 => 9.1504, std. dev.: 0.0135) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.87% (6.6320 => 6.5081, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3444, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: -1.67% (7.1097 => 6.9911, std. dev.: 0.0003) MultiSource/Applications/lua/lua: -1.40% (26.5159 => 26.1459, std. dev.: 0.0227) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.23% (20.3410 => 20.0908, std. dev.: 0.0245) SingleSource/Benchmarks/Shootout/heapsort: -1.16% (3.9173 => 3.8719, std. dev.: 0.0132) MultiSource/Applications/spiff/spiff: -1.11% (3.0263 => 2.9926, std. dev.: 0.0009) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.66s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed May 2 01:27:49 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 2 May 2012 03:27:49 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120502082749.0EB2A2A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/490?compare_to=489&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 490, Order: 155980, Start Time: 2012-05-02 07:30:51, End Time: 2012-05-02 08:28:20 To: 489, Order: 155977, Start Time: 2012-05-02 06:03:46, End Time: 2012-05-02 07:01:22 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (51 on baseline) Performance Improvements: 0 (24 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (813 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.50% (2.0176 => 2.2899, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.37% (0.2721 => 0.2840, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.96% (0.3130 => 0.3254, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.74% (3.9660 => 4.1142, std. dev.: 0.0024) MultiSource/Applications/SPASS/SPASS: 3.09% (13.8202 => 14.2468, std. dev.: 0.0129) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.04% (0.5265 => 0.5425, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.91% (1.4563 => 1.4987, std. dev.: 0.0103) MultiSource/Benchmarks/nbench/nbench: 2.85% (1.0594 => 1.0896, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.60% (1.2193 => 1.2510, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.59% (0.6959 => 0.7139, std. dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.54% (0.5637 => 0.5780, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.53% (1.1364 => 1.1651, std. dev.: 0.0015) MultiSource/Applications/spiff/spiff: 2.38% (0.7506 => 0.7685, std. dev.: 0.0009) MultiSource/Applications/kimwitu++/kc: 2.37% (16.6129 => 17.0064, std. dev.: 0.0060) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.27% (0.7710 => 0.7885, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.24% (0.9199 => 0.9405, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.22% (13.2842 => 13.5797, std. dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.03% (0.5577 => 0.5690, std. dev.: 0.0017) MultiSource/Benchmarks/MallocBench/gs/gs: 2.00% (3.8646 => 3.9418, std. dev.: 0.0078) MultiSource/Applications/siod/siod: 1.95% (2.1791 => 2.2216, std. dev.: 0.0060) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.93% (1.3813 => 1.4080, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.92% (0.7460 => 0.7603, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.87% (1.3819 => 1.4078, std. dev.: 0.0013) MultiSource/Applications/Burg/burg: 1.86% (1.1061 => 1.1267, std. dev.: 0.0056) MultiSource/Applications/lambda-0_1_3/lambda: 1.79% (0.7038 => 0.7164, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.78% (1.1333 => 1.1535, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.74% (1.3245 => 1.3476, std. dev.: 0.0022) MultiSource/Applications/hbd/hbd: 1.72% (1.3693 => 1.3929, std. dev.: 0.0078) MultiSource/Applications/treecc/treecc: 1.64% (1.9270 => 1.9586, std. dev.: 0.0011) MultiSource/Applications/SIBsim4/SIBsim4: 1.51% (1.2749 => 1.2941, std. dev.: 0.0021) MultiSource/Applications/JM/lencod/lencod: 1.44% (14.8535 => 15.0669, std. dev.: 0.0042) MultiSource/Applications/JM/ldecod/ldecod: 1.29% (6.5754 => 6.6599, std. dev.: 0.0056) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.25% (2.1007 => 2.1270, std. dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 1.23% (16.2614 => 16.4609, std. dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.22% (7.2180 => 7.3057, std. dev.: 0.0023) MultiSource/Applications/d/make_dparser: 1.21% (3.1889 => 3.2274, std. dev.: 0.0031) MultiSource/Applications/ClamAV/clamscan: 1.17% (14.5298 => 14.6992, std. dev.: 0.0194) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.21% (1.8175 => 2.2576, std. dev.: 0.0053) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7298, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.86% (1.5824 => 1.6752, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8142, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.70% (1.7688 => 1.8343, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/salsa20: 3.65% (7.4271 => 7.6985, std. dev.: 0.0098) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 3.28% (0.9692 => 1.0010, std. dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4554, std. dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.97% (8.8259 => 9.0879, std. dev.: 0.0206) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.26% (7.9275 => 8.1070, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/ffbench: 2.20% (0.8273 => 0.8455, std. dev.: 0.0061) MultiSource/Benchmarks/Olden/bisort/bisort: 1.34% (0.8239 => 0.8349, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.28% (2.0200 => 2.0458, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.27% (0.3511 => 0.3291, std. dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.14% (0.2670 => 0.2506, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/richards_benchmark: -12.60% (1.1560 => 1.0103, std. dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.12% (1.0460 => 0.9401, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -9.93% (1.2308 => 1.1086, std. dev.: 0.0018) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.47% (0.3139 => 0.2936, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.89% (1.3780 => 1.3106, std. dev.: 0.0053) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9472, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.33% (0.2333 => 0.2232, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -3.66% (1.9762 => 1.9038, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.59% (0.3458 => 0.3334, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.98% (6.3560 => 6.2299, std. dev.: 0.0058) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.87% (6.6320 => 6.5078, std. dev.: 0.0012) MultiSource/Applications/minisat/minisat: -1.85% (9.3358 => 9.1633, std. dev.: 0.0070) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3444, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: -1.67% (7.1097 => 6.9911, std. dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -1.51% (7.3305 => 7.2197, std. dev.: 0.0097) SingleSource/Benchmarks/Shootout/heapsort: -1.40% (3.9173 => 3.8625, std. dev.: 0.0046) MultiSource/Applications/lua/lua: -1.34% (26.5159 => 26.1604, std. dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.21% (20.3410 => 20.0947, std. dev.: 0.0122) MultiSource/Applications/spiff/spiff: -1.10% (3.0263 => 2.9929, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.10% (3.8887 => 3.8461, std. dev.: 0.0041) MultiSource/Benchmarks/nbench/nbench: -1.01% (11.2619 => 11.1480, std. dev.: 0.0041) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.94s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed May 2 02:50:58 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 2 May 2012 04:50:58 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120502095058.068EB2A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/491?compare_to=490&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 491, Order: 155982, Start Time: 2012-05-02 08:54:06, End Time: 2012-05-02 09:51:30 To: 490, Order: 155980, Start Time: 2012-05-02 07:30:51, End Time: 2012-05-02 08:28:20 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (59 on baseline) Performance Improvements: 0 (23 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 891 (806 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 1.15% (7.9531 => 8.0447, std. dev.: 0.0119) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.36% (2.0176 => 2.2872, std. dev.: 0.0051) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.48% (0.2721 => 0.2843, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.74% (3.9660 => 4.1144, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.74% (0.3130 => 0.3247, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.08% (0.5265 => 0.5427, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.08% (0.6959 => 0.7173, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.97% (1.4563 => 1.4995, std. dev.: 0.0015) MultiSource/Applications/SPASS/SPASS: 2.94% (13.8202 => 14.2269, std. dev.: 0.0072) MultiSource/Benchmarks/nbench/nbench: 2.78% (1.0594 => 1.0888, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.71% (1.2193 => 1.2523, std. dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/football/football: 2.55% (0.8310 => 0.8522, std. dev.: 0.0014) MultiSource/Applications/kimwitu++/kc: 2.55% (16.6129 => 17.0360, std. dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.48% (0.9199 => 0.9427, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.40% (1.1364 => 1.1637, std. dev.: 0.0061) MultiSource/Applications/spiff/spiff: 2.38% (0.7506 => 0.7685, std. dev.: 0.0034) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.35% (0.7710 => 0.7891, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.34% (0.5637 => 0.5769, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.32% (13.2842 => 13.5926, std. dev.: 0.0068) MultiSource/Benchmarks/MallocBench/gs/gs: 2.12% (3.8646 => 3.9464, std. dev.: 0.0087) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.11% (0.4791 => 0.4892, std. dev.: 0.0021) MultiSource/Applications/siod/siod: 2.07% (2.1791 => 2.2243, std. dev.: 0.0108) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.01% (1.3813 => 1.4091, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.95% (0.5577 => 0.5686, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.95% (1.3819 => 1.4088, std. dev.: 0.0017) MultiSource/Applications/lambda-0_1_3/lambda: 1.92% (0.7038 => 0.7173, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.84% (0.7460 => 0.7597, std. dev.: 0.0011) MultiSource/Applications/Burg/burg: 1.79% (1.1061 => 1.1259, std. dev.: 0.0038) MultiSource/Applications/hbd/hbd: 1.79% (1.3693 => 1.3938, std. dev.: 0.0073) MultiSource/Applications/treecc/treecc: 1.77% (1.9270 => 1.9611, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.75% (3.6692 => 3.7335, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.72% (1.1333 => 1.1528, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.70% (1.3245 => 1.3470, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 1.64% (0.7061 => 0.7177, std. dev.: 0.0022) MultiSource/Applications/minisat/minisat: 1.56% (0.6744 => 0.6849, std. dev.: 0.0023) MultiSource/Applications/SIBsim4/SIBsim4: 1.53% (1.2749 => 1.2944, std. dev.: 0.0021) MultiSource/Benchmarks/Bullet/bullet: 1.43% (33.2944 => 33.7711, std. dev.: 0.0064) MultiSource/Applications/JM/lencod/lencod: 1.40% (14.8535 => 15.0611, std. dev.: 0.0157) MultiSource/Applications/JM/ldecod/ldecod: 1.39% (6.5754 => 6.6667, std. dev.: 0.0200) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.36% (2.1007 => 2.1293, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 1.31% (1.2292 => 1.2453, std. dev.: 0.0016) MultiSource/Applications/d/make_dparser: 1.19% (3.1889 => 3.2268, std. dev.: 0.0058) MultiSource/Applications/ClamAV/clamscan: 1.18% (14.5298 => 14.7012, std. dev.: 0.0123) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.13% (7.2180 => 7.2996, std. dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.04% (3.2742 => 3.3084, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.00% (1.5188 => 1.5340, std. dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.13% (1.8175 => 2.2561, std. dev.: 0.0215) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7298, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.92% (1.5824 => 1.6761, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8146, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 3.67% (7.4271 => 7.6997, std. dev.: 0.0099) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.61% (1.7688 => 1.8326, std. dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 3.29% (0.9692 => 1.0011, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4544, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.79% (8.8259 => 9.0718, std. dev.: 0.0098) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.24% (7.9275 => 8.1050, std. dev.: 0.0102) SingleSource/Benchmarks/Misc/ffbench: 2.20% (0.8273 => 0.8455, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.26% (2.0200 => 2.0455, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 1.20% (5.0168 => 5.0772, std. dev.: 0.0105) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.44% (0.2670 => 0.2498, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.81% (0.3511 => 0.3307, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.55% (0.8818 => 0.8681, std. dev.: 0.0014) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/richards_benchmark: -12.02% (1.1560 => 1.0171, std. dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.12% (1.0460 => 0.9401, std. dev.: 0.0022) SingleSource/Benchmarks/McGill/chomp: -9.76% (1.2308 => 1.1107, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.59% (0.3139 => 0.2932, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9472, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.33% (0.2333 => 0.2232, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.14% (1.3780 => 1.3209, std. dev.: 0.0016) MultiSource/Benchmarks/Olden/bh/bh: -3.71% (1.9762 => 1.9028, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.61% (0.3458 => 0.3333, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -2.04% (6.3560 => 6.2262, std. dev.: 0.0089) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.93% (6.6320 => 6.5038, std. dev.: 0.0021) MultiSource/Applications/minisat/minisat: -1.76% (9.3358 => 9.1714, std. dev.: 0.0338) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.67% (7.1097 => 6.9913, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/heapsort: -1.41% (3.9173 => 3.8619, std. dev.: 0.0052) MultiSource/Benchmarks/Bullet/bullet: -1.33% (7.3305 => 7.2329, std. dev.: 0.0045) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.29% (20.3410 => 20.0796, std. dev.: 0.0551) MultiSource/Applications/lua/lua: -1.24% (26.5159 => 26.1876, std. dev.: 0.0097) MultiSource/Applications/spiff/spiff: -1.20% (3.0263 => 2.9900, std. dev.: 0.0017) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.97s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed May 2 04:13:54 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 2 May 2012 06:13:54 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120502111354.3C6C72A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/492?compare_to=491&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 492, Order: 155983, Start Time: 2012-05-02 10:17:09, End Time: 2012-05-02 11:14:27 To: 491, Order: 155982, Start Time: 2012-05-02 08:54:06, End Time: 2012-05-02 09:51:30 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (56 on baseline) Performance Improvements: 0 (26 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (806 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.34% (2.0176 => 2.2868, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.34% (0.2721 => 0.2839, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.77% (0.3130 => 0.3248, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.72% (3.9660 => 4.1136, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.05% (1.4563 => 1.5007, std. dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 3.02% (13.8202 => 14.2369, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.96% (0.5265 => 0.5421, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 2.78% (1.0594 => 1.0889, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.73% (0.6959 => 0.7149, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.70% (1.2193 => 1.2522, std. dev.: 0.0012) MultiSource/Applications/kimwitu++/kc: 2.53% (16.6129 => 17.0338, std. dev.: 0.0099) MultiSource/Benchmarks/Prolangs-C/football/football: 2.49% (0.8310 => 0.8517, std. dev.: 0.0018) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.42% (1.1364 => 1.1639, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.36% (0.9199 => 0.9416, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.36% (13.2842 => 13.5971, std. dev.: 0.0037) MultiSource/Applications/spiff/spiff: 2.29% (0.7506 => 0.7678, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.27% (0.5637 => 0.5765, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.26% (0.7710 => 0.7884, std. dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.17% (0.4791 => 0.4895, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 2.15% (1.1061 => 1.1299, std. dev.: 0.0062) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.13% (1.3819 => 1.4113, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.10% (0.5577 => 0.5694, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/gs/gs: 2.00% (3.8646 => 3.9417, std. dev.: 0.0017) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.94% (1.3813 => 1.4081, std. dev.: 0.0070) MultiSource/Applications/siod/siod: 1.84% (2.1791 => 2.2192, std. dev.: 0.0062) MultiSource/Applications/hbd/hbd: 1.83% (1.3693 => 1.3943, std. dev.: 0.0073) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.81% (0.7460 => 0.7595, std. dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: 1.79% (0.7038 => 0.7164, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.75% (1.1333 => 1.1531, std. dev.: 0.0014) MultiSource/Applications/treecc/treecc: 1.74% (1.9270 => 1.9605, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference: 1.71% (0.7061 => 0.7182, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.70% (1.3245 => 1.3470, std. dev.: 0.0011) MultiSource/Applications/SIBsim4/SIBsim4: 1.69% (1.2749 => 1.2965, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.62% (3.6692 => 3.7285, std. dev.: 0.0025) MultiSource/Applications/JM/ldecod/ldecod: 1.59% (6.5754 => 6.6799, std. dev.: 0.0074) MultiSource/Benchmarks/Bullet/bullet: 1.41% (33.2944 => 33.7632, std. dev.: 0.0013) MultiSource/Applications/JM/lencod/lencod: 1.35% (14.8535 => 15.0547, std. dev.: 0.0208) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.35% (2.1007 => 2.1290, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 1.34% (1.2292 => 1.2457, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.25% (7.2180 => 7.3085, std. dev.: 0.0023) MultiSource/Applications/d/make_dparser: 1.17% (3.1889 => 3.2263, std. dev.: 0.0119) MultiSource/Applications/ClamAV/clamscan: 1.16% (14.5298 => 14.6985, std. dev.: 0.0089) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.16% (1.8175 => 2.2566, std. dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.86% (1.5824 => 1.6751, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8146, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 3.68% (7.4271 => 7.7006, std. dev.: 0.0032) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.54% (1.7688 => 1.8315, std. dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 3.28% (0.9692 => 1.0010, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4551, std. dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.84% (8.8259 => 9.0765, std. dev.: 0.0032) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.49% (7.9275 => 8.1247, std. dev.: 0.0058) SingleSource/Benchmarks/Misc/ffbench: 2.24% (0.8273 => 0.8458, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.27% (2.0200 => 2.0457, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 1.09% (5.0168 => 5.0715, std. dev.: 0.0116) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.52% (0.2670 => 0.2496, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.10% (0.3511 => 0.3297, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.49% (0.8818 => 0.8687, std. dev.: 0.0015) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/richards_benchmark: -12.66% (1.1560 => 1.0097, std. dev.: 0.0057) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.12% (1.0460 => 0.9401, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -9.63% (1.2308 => 1.1123, std. dev.: 0.0025) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.56% (0.3139 => 0.2933, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9472, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.67% (1.3780 => 1.3137, std. dev.: 0.0030) MultiSource/Benchmarks/FreeBench/neural/neural: -4.33% (0.2333 => 0.2232, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.73% (0.3458 => 0.3329, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -3.68% (1.9762 => 1.9034, std. dev.: 0.0108) MultiSource/Applications/minisat/minisat: -2.18% (9.3358 => 9.1327, std. dev.: 0.0322) SingleSource/Benchmarks/Shootout/lists: -2.13% (6.3560 => 6.2204, std. dev.: 0.0171) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.79% (6.6320 => 6.5130, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.67% (7.1097 => 6.9912, std. dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -1.46% (7.3305 => 7.2232, std. dev.: 0.0022) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.45% (2.5254 => 2.4889, std. dev.: 0.0082) SingleSource/Benchmarks/Shootout/heapsort: -1.34% (3.9173 => 3.8648, std. dev.: 0.0036) MultiSource/Applications/spiff/spiff: -1.27% (3.0263 => 2.9878, std. dev.: 0.0020) MultiSource/Applications/lua/lua: -1.24% (26.5159 => 26.1869, std. dev.: 0.0031) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.10% (20.3410 => 20.1163, std. dev.: 0.0150) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.04% (3.8887 => 3.8484, std. dev.: 0.0019) MultiSource/Benchmarks/nbench/nbench: -1.00% (11.2619 => 11.1489, std. dev.: 0.0025) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.13s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed May 2 05:36:50 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 2 May 2012 07:36:50 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120502123650.4552C2A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/493?compare_to=492&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 493, Order: 155984, Start Time: 2012-05-02 11:40:01, End Time: 2012-05-02 12:37:22 To: 492, Order: 155983, Start Time: 2012-05-02 10:17:09, End Time: 2012-05-02 11:14:27 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (55 on baseline) Performance Improvements: 0 (22 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (811 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.86% (2.0176 => 2.2771, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.26% (0.2721 => 0.2837, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.71% (0.3130 => 0.3246, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.60% (3.9660 => 4.1087, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.97% (1.4563 => 1.4996, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.94% (0.5265 => 0.5420, std. dev.: 0.0030) MultiSource/Applications/SPASS/SPASS: 2.87% (13.8202 => 14.2164, std. dev.: 0.0053) MultiSource/Applications/kimwitu++/kc: 2.71% (16.6129 => 17.0637, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 2.57% (1.0594 => 1.0866, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.57% (1.2193 => 1.2506, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.53% (0.6959 => 0.7135, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.33% (1.1364 => 1.1629, std. dev.: 0.0042) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.33% (1.3819 => 1.4141, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.24% (1.3813 => 1.4123, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/football/football: 2.24% (0.8310 => 0.8496, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.19% (0.9199 => 0.9400, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.18% (0.5637 => 0.5760, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 2.16% (0.7506 => 0.7668, std. dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.95% (13.2842 => 13.5429, std. dev.: 0.0114) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.89% (0.7710 => 0.7856, std. dev.: 0.0023) MultiSource/Applications/siod/siod: 1.88% (2.1791 => 2.2201, std. dev.: 0.0102) MultiSource/Benchmarks/MallocBench/gs/gs: 1.86% (3.8646 => 3.9363, std. dev.: 0.0045) MultiSource/Applications/lambda-0_1_3/lambda: 1.85% (0.7038 => 0.7168, std. dev.: 0.0015) MultiSource/Applications/Burg/burg: 1.82% (1.1061 => 1.1262, std. dev.: 0.0042) SingleSource/UnitTests/ObjC++/property-reference: 1.73% (0.7061 => 0.7183, std. dev.: 0.0038) MultiSource/Applications/treecc/treecc: 1.70% (1.9270 => 1.9597, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.66% (0.7460 => 0.7584, std. dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.63% (1.1333 => 1.1518, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.57% (1.3245 => 1.3453, std. dev.: 0.0072) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.45% (3.6692 => 3.7223, std. dev.: 0.0025) MultiSource/Applications/JM/lencod/lencod: 1.42% (14.8535 => 15.0641, std. dev.: 0.0027) MultiSource/Applications/hexxagon/hexxagon: 1.41% (1.2292 => 1.2465, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.34% (2.1007 => 2.1288, std. dev.: 0.0075) MultiSource/Benchmarks/Bullet/bullet: 1.32% (33.2944 => 33.7336, std. dev.: 0.0073) MultiSource/Applications/SIBsim4/SIBsim4: 1.32% (1.2749 => 1.2917, std. dev.: 0.0024) MultiSource/Applications/JM/ldecod/ldecod: 1.18% (6.5754 => 6.6532, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.17% (1.9828 => 2.0059, std. dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 1.08% (14.5298 => 14.6870, std. dev.: 0.0124) MultiSource/Applications/d/make_dparser: 1.07% (3.1889 => 3.2230, std. dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.06% (7.2180 => 7.2945, std. dev.: 0.0016) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.26% (1.8175 => 2.2585, std. dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.86% (1.5824 => 1.6752, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8146, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 3.70% (7.4271 => 7.7021, std. dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.67% (1.7688 => 1.8338, std. dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 3.23% (0.9692 => 1.0005, std. dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4540, std. dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.94% (8.8259 => 9.0856, std. dev.: 0.0119) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.59% (7.9275 => 8.1326, std. dev.: 0.0142) SingleSource/Benchmarks/Misc/ffbench: 2.20% (0.8273 => 0.8455, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 1.55% (5.0168 => 5.0944, std. dev.: 0.0060) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.27% (2.0200 => 2.0456, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bisort/bisort: 1.23% (0.8239 => 0.8340, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.44% (0.2670 => 0.2498, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.58% (0.3511 => 0.3315, std. dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/richards_benchmark: -12.40% (1.1560 => 1.0127, std. dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.12% (1.0460 => 0.9401, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -9.68% (1.2308 => 1.1117, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.50% (0.3139 => 0.2935, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.93% (1.3780 => 1.3101, std. dev.: 0.0072) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9474, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/neural/neural: -4.33% (0.2333 => 0.2232, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.62% (1.9762 => 1.9046, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/lists: -2.15% (6.3560 => 6.2194, std. dev.: 0.0105) MultiSource/Applications/minisat/minisat: -2.06% (9.3358 => 9.1439, std. dev.: 0.0033) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.87% (6.6320 => 6.5081, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.67% (7.1097 => 6.9912, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.51% (20.3410 => 20.0345, std. dev.: 0.0634) MultiSource/Benchmarks/Bullet/bullet: -1.49% (7.3305 => 7.2210, std. dev.: 0.0014) MultiSource/Applications/lua/lua: -1.34% (26.5159 => 26.1608, std. dev.: 0.0340) SingleSource/Benchmarks/Shootout/heapsort: -1.26% (3.9173 => 3.8681, std. dev.: 0.0007) MultiSource/Applications/spiff/spiff: -1.13% (3.0263 => 2.9920, std. dev.: 0.0011) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.40s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed May 2 07:41:16 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 2 May 2012 09:41:16 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120502144116.5C0D62A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/494?compare_to=493&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 494, Order: 155986, Start Time: 2012-05-02 13:44:34, End Time: 2012-05-02 14:41:48 To: 493, Order: 155984, Start Time: 2012-05-02 11:40:01, End Time: 2012-05-02 12:37:22 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (52 on baseline) Performance Improvements: 0 (25 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (811 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.92% (2.0176 => 2.2782, std. dev.: 0.0064) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.37% (0.2721 => 0.2840, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.71% (0.3130 => 0.3246, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.63% (3.9660 => 4.1101, std. dev.: 0.0083) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.06% (0.5265 => 0.5426, std. dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 2.97% (13.8202 => 14.2304, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.95% (1.4563 => 1.4992, std. dev.: 0.0016) MultiSource/Applications/kimwitu++/kc: 2.79% (16.6129 => 17.0764, std. dev.: 0.0106) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.74% (0.6959 => 0.7150, std. dev.: 0.0020) MultiSource/Benchmarks/nbench/nbench: 2.60% (1.0594 => 1.0869, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.48% (1.2193 => 1.2495, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.32% (1.1364 => 1.1628, std. dev.: 0.0008) MultiSource/Applications/spiff/spiff: 2.32% (0.7506 => 0.7680, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.29% (0.9199 => 0.9410, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 2.27% (0.8310 => 0.8499, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.22% (1.3813 => 1.4120, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.20% (0.5637 => 0.5761, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.10% (1.3819 => 1.4109, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.04% (0.5577 => 0.5691, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/gs/gs: 1.97% (3.8646 => 3.9407, std. dev.: 0.0063) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.96% (13.2842 => 13.5440, std. dev.: 0.0050) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.93% (0.7710 => 0.7859, std. dev.: 0.0020) MultiSource/Applications/lambda-0_1_3/lambda: 1.90% (0.7038 => 0.7172, std. dev.: 0.0044) MultiSource/Applications/siod/siod: 1.85% (2.1791 => 2.2195, std. dev.: 0.0026) MultiSource/Applications/Burg/burg: 1.81% (1.1061 => 1.1261, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference: 1.76% (0.7061 => 0.7185, std. dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.74% (1.3245 => 1.3475, std. dev.: 0.0008) MultiSource/Applications/treecc/treecc: 1.69% (1.9270 => 1.9595, std. dev.: 0.0055) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.64% (1.1333 => 1.1519, std. dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 1.63% (1.2292 => 1.2492, std. dev.: 0.0005) MultiSource/Applications/hbd/hbd: 1.61% (1.3693 => 1.3914, std. dev.: 0.0059) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.55% (0.7460 => 0.7576, std. dev.: 0.0039) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.45% (3.6692 => 3.7223, std. dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.40% (1.9828 => 2.0106, std. dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 1.33% (1.2749 => 1.2918, std. dev.: 0.0025) MultiSource/Benchmarks/Bullet/bullet: 1.31% (33.2944 => 33.7322, std. dev.: 0.0312) MultiSource/Applications/JM/lencod/lencod: 1.22% (14.8535 => 15.0347, std. dev.: 0.0043) MultiSource/Applications/ClamAV/clamscan: 1.21% (14.5298 => 14.7057, std. dev.: 0.0134) MultiSource/Applications/JM/ldecod/ldecod: 1.20% (6.5754 => 6.6545, std. dev.: 0.0076) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 23.96% (1.8175 => 2.2530, std. dev.: 0.0607) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6755, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8143, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 3.66% (7.4271 => 7.6986, std. dev.: 0.0084) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.64% (1.7688 => 1.8331, std. dev.: 0.0066) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 3.24% (0.9692 => 1.0006, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 3.01% (12.0921 => 12.4565, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.84% (8.8259 => 9.0769, std. dev.: 0.0096) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.31% (7.9275 => 8.1110, std. dev.: 0.0148) SingleSource/Benchmarks/Misc/ffbench: 2.19% (0.8273 => 0.8454, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.29% (2.0200 => 2.0460, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.44% (0.2670 => 0.2498, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.21% (0.3511 => 0.3293, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.54% (0.8818 => 0.8682, std. dev.: 0.0009) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/richards_benchmark: -12.62% (1.1560 => 1.0101, std. dev.: 0.0044) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.11% (1.0460 => 0.9402, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -9.78% (1.2308 => 1.1104, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.56% (0.3139 => 0.2933, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.93% (1.3780 => 1.3100, std. dev.: 0.0109) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9472, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/neural/neural: -4.33% (0.2333 => 0.2232, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.66% (1.9762 => 1.9039, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout/lists: -2.26% (6.3560 => 6.2124, std. dev.: 0.0141) MultiSource/Applications/minisat/minisat: -2.06% (9.3358 => 9.1437, std. dev.: 0.0138) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.86% (6.6320 => 6.5089, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.66% (7.1097 => 6.9914, std. dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -1.53% (7.3305 => 7.2184, std. dev.: 0.0078) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.39% (20.3410 => 20.0576, std. dev.: 0.0206) SingleSource/Benchmarks/Shootout/heapsort: -1.38% (3.9173 => 3.8634, std. dev.: 0.0056) MultiSource/Applications/lua/lua: -1.26% (26.5159 => 26.1805, std. dev.: 0.0117) MultiSource/Applications/spiff/spiff: -1.18% (3.0263 => 2.9905, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.06% (3.8887 => 3.8474, std. dev.: 0.0075) MultiSource/Benchmarks/nbench/nbench: -1.00% (11.2619 => 11.1492, std. dev.: 0.0016) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.51s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed May 2 09:04:14 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 2 May 2012 11:04:14 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120502160414.EE3802A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/495?compare_to=494&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 495, Order: 155988, Start Time: 2012-05-02 15:07:28, End Time: 2012-05-02 16:04:47 To: 494, Order: 155986, Start Time: 2012-05-02 13:44:34, End Time: 2012-05-02 14:41:48 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (58 on baseline) Performance Improvements: 0 (25 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 891 (805 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.39% (1.3100 => 1.3282, std. dev.: 0.0055) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.30% (2.0176 => 2.2860, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.15% (0.2721 => 0.2834, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.59% (3.9660 => 4.1084, std. dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.58% (0.3130 => 0.3242, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.14% (1.4563 => 1.5020, std. dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.06% (0.5265 => 0.5426, std. dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 2.97% (13.8202 => 14.2313, std. dev.: 0.0044) MultiSource/Applications/kimwitu++/kc: 2.70% (16.6129 => 17.0620, std. dev.: 0.0138) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.64% (0.6959 => 0.7143, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 2.56% (1.0594 => 1.0865, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.56% (0.7710 => 0.7907, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.51% (1.2193 => 1.2499, std. dev.: 0.0028) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.49% (1.1364 => 1.1647, std. dev.: 0.0013) MultiSource/Applications/spiff/spiff: 2.41% (0.7506 => 0.7687, std. dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.37% (0.4390 => 0.4494, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.29% (0.5637 => 0.5766, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 2.27% (0.8310 => 0.8499, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.27% (0.9199 => 0.9408, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.24% (1.3819 => 1.4128, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.13% (1.3813 => 1.4107, std. dev.: 0.0012) MultiSource/Applications/siod/siod: 2.00% (2.1791 => 2.2227, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.97% (13.2842 => 13.5458, std. dev.: 0.0082) MultiSource/Applications/hexxagon/hexxagon: 1.96% (1.2292 => 1.2533, std. dev.: 0.0041) MultiSource/Applications/hbd/hbd: 1.96% (1.3693 => 1.3961, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.96% (1.9828 => 2.0216, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/gs/gs: 1.89% (3.8646 => 3.9378, std. dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.86% (0.5577 => 0.5681, std. dev.: 0.0022) MultiSource/Applications/lambda-0_1_3/lambda: 1.82% (0.7038 => 0.7166, std. dev.: 0.0001) MultiSource/Applications/treecc/treecc: 1.75% (1.9270 => 1.9608, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: 1.74% (0.7061 => 0.7184, std. dev.: 0.0032) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.73% (0.7460 => 0.7589, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.64% (1.1333 => 1.1519, std. dev.: 0.0013) MultiSource/Applications/Burg/burg: 1.62% (1.1061 => 1.1240, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.60% (1.3245 => 1.3457, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.45% (3.6692 => 3.7224, std. dev.: 0.0135) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.35% (2.1007 => 2.1290, std. dev.: 0.0048) MultiSource/Applications/JM/lencod/lencod: 1.27% (14.8535 => 15.0421, std. dev.: 0.0042) MultiSource/Applications/SIBsim4/SIBsim4: 1.26% (1.2749 => 1.2910, std. dev.: 0.0044) MultiSource/Applications/JM/ldecod/ldecod: 1.24% (6.5754 => 6.6570, std. dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: 1.17% (14.5298 => 14.6997, std. dev.: 0.0071) MultiSource/Benchmarks/Bullet/bullet: 1.11% (33.2944 => 33.6638, std. dev.: 0.0098) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.08% (4.3801 => 4.4272, std. dev.: 0.0057) MultiSource/Applications/sqlite3/sqlite3: 1.06% (16.2614 => 16.4330, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.05% (7.2180 => 7.2935, std. dev.: 0.0067) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 26.00% (1.8175 => 2.2900, std. dev.: 0.0393) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.87% (1.5824 => 1.6753, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8147, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 3.70% (7.4271 => 7.7021, std. dev.: 0.0028) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.64% (1.7688 => 1.8331, std. dev.: 0.0177) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 3.26% (0.9692 => 1.0008, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4534, std. dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.94% (8.8259 => 9.0850, std. dev.: 0.0117) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.37% (7.9275 => 8.1154, std. dev.: 0.0136) SingleSource/Benchmarks/Misc/ffbench: 2.24% (0.8273 => 0.8458, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.26% (2.0200 => 2.0454, std. dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 1.21% (5.0168 => 5.0774, std. dev.: 0.0076) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0036) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.67% (0.2670 => 0.2492, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.47% (0.3511 => 0.3284, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.74% (0.8818 => 0.8665, std. dev.: 0.0011) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/richards_benchmark: -12.67% (1.1560 => 1.0095, std. dev.: 0.0050) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.12% (1.0460 => 0.9401, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.02% (1.2308 => 1.1075, std. dev.: 0.0028) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.53% (0.3139 => 0.2934, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9472, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.33% (0.2333 => 0.2232, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.70% (1.9762 => 1.9030, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.61% (1.3780 => 1.3282, std. dev.: 0.0055) SingleSource/Benchmarks/Shootout/lists: -2.13% (6.3560 => 6.2209, std. dev.: 0.0023) MultiSource/Applications/minisat/minisat: -2.01% (9.3358 => 9.1481, std. dev.: 0.0201) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.97% (6.6320 => 6.5014, std. dev.: 0.0058) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3444, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.67% (7.1097 => 6.9910, std. dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -1.58% (7.3305 => 7.2147, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout/heapsort: -1.47% (3.9173 => 3.8597, std. dev.: 0.0028) MultiSource/Applications/lua/lua: -1.40% (26.5159 => 26.1443, std. dev.: 0.0074) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.36% (20.3410 => 20.0647, std. dev.: 0.0609) MultiSource/Applications/spiff/spiff: -1.15% (3.0263 => 2.9914, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.11% (3.8887 => 3.8456, std. dev.: 0.0022) MultiSource/Benchmarks/nbench/nbench: -1.01% (11.2619 => 11.1486, std. dev.: 0.0042) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.57s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed May 2 10:27:19 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 2 May 2012 12:27:19 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120502172719.CA8B42A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/496?compare_to=495&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 496, Order: 155995, Start Time: 2012-05-02 16:30:28, End Time: 2012-05-02 17:27:52 To: 495, Order: 155988, Start Time: 2012-05-02 15:07:28, End Time: 2012-05-02 16:04:47 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (58 on baseline) Performance Improvements: 0 (23 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (807 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.95% (2.0176 => 2.2788, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.26% (0.2721 => 0.2837, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.58% (0.3130 => 0.3242, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.54% (3.9660 => 4.1062, std. dev.: 0.0117) MultiSource/Applications/SPASS/SPASS: 3.01% (13.8202 => 14.2362, std. dev.: 0.0127) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.98% (0.5265 => 0.5422, std. dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 2.95% (16.6129 => 17.1031, std. dev.: 0.0086) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.76% (1.4563 => 1.4965, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.66% (0.6959 => 0.7144, std. dev.: 0.0019) MultiSource/Benchmarks/nbench/nbench: 2.59% (1.0594 => 1.0868, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.53% (1.2193 => 1.2501, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.30% (1.1364 => 1.1625, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/football/football: 2.27% (0.8310 => 0.8499, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 2.22% (0.7061 => 0.7218, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.21% (0.9199 => 0.9402, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.15% (0.5637 => 0.5758, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: 2.14% (0.7506 => 0.7667, std. dev.: 0.0016) MultiSource/Applications/hexxagon/hexxagon: 2.13% (1.2292 => 1.2554, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.11% (1.9828 => 2.0246, std. dev.: 0.0092) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.03% (1.3813 => 1.4093, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.98% (1.3819 => 1.4093, std. dev.: 0.0019) MultiSource/Applications/hbd/hbd: 1.98% (1.3693 => 1.3964, std. dev.: 0.0055) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.97% (13.2842 => 13.5460, std. dev.: 0.0080) SingleSource/UnitTests/ObjC++/property-reference-object: 1.94% (0.5818 => 0.5931, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 1.90% (3.8646 => 3.9382, std. dev.: 0.0039) SingleSource/UnitTests/ObjC++/Hello: 1.86% (0.5748 => 0.5855, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.85% (0.5577 => 0.5680, std. dev.: 0.0015) MultiSource/Applications/siod/siod: 1.84% (2.1791 => 2.2193, std. dev.: 0.0062) MultiSource/Applications/lambda-0_1_3/lambda: 1.82% (0.7038 => 0.7166, std. dev.: 0.0019) MultiSource/Applications/Burg/burg: 1.81% (1.1061 => 1.1261, std. dev.: 0.0039) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.71% (0.7710 => 0.7842, std. dev.: 0.0048) MultiSource/Benchmarks/Bullet/bullet: 1.67% (33.2944 => 33.8488, std. dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.60% (1.1333 => 1.1514, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.60% (0.7460 => 0.7579, std. dev.: 0.0006) MultiSource/Applications/treecc/treecc: 1.58% (1.9270 => 1.9575, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.56% (1.3245 => 1.3451, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.42% (3.6692 => 3.7212, std. dev.: 0.0020) MultiSource/Applications/SIBsim4/SIBsim4: 1.34% (1.2749 => 1.2920, std. dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.28% (3.2742 => 3.3160, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.25% (0.8698 => 0.8807, std. dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 1.24% (14.8535 => 15.0382, std. dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.22% (2.1007 => 2.1264, std. dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: 1.17% (6.5754 => 6.6526, std. dev.: 0.0043) MultiSource/Applications/d/make_dparser: 1.04% (3.1889 => 3.2220, std. dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 25.09% (1.8175 => 2.2736, std. dev.: 0.0392) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.89% (1.5824 => 1.6756, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8146, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 3.65% (7.4271 => 7.6984, std. dev.: 0.0065) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.61% (1.7688 => 1.8327, std. dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 3.26% (0.9692 => 1.0008, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 2.98% (12.0921 => 12.4526, std. dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.65% (8.8259 => 9.0597, std. dev.: 0.0251) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.52% (7.9275 => 8.1272, std. dev.: 0.0077) SingleSource/Benchmarks/Misc/ffbench: 2.25% (0.8273 => 0.8459, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: 1.46% (5.0168 => 5.0901, std. dev.: 0.0046) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.26% (2.0200 => 2.0455, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.48% (0.2670 => 0.2497, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.92% (0.3511 => 0.3303, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.53% (0.8818 => 0.8683, std. dev.: 0.0016) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/richards_benchmark: -12.53% (1.1560 => 1.0112, std. dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.12% (1.0460 => 0.9401, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -9.93% (1.2308 => 1.1086, std. dev.: 0.0021) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.56% (0.3139 => 0.2933, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9472, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.39% (1.3780 => 1.3175, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.68% (1.9762 => 1.9035, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/lists: -2.10% (6.3560 => 6.2223, std. dev.: 0.0157) MultiSource/Applications/minisat/minisat: -2.02% (9.3358 => 9.1472, std. dev.: 0.0058) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.91% (6.6320 => 6.5055, std. dev.: 0.0037) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.76% (20.3410 => 19.9825, std. dev.: 0.0482) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.66% (7.1097 => 6.9914, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/heapsort: -1.57% (3.9173 => 3.8559, std. dev.: 0.0073) MultiSource/Benchmarks/Bullet/bullet: -1.50% (7.3305 => 7.2205, std. dev.: 0.0006) MultiSource/Applications/lua/lua: -1.31% (26.5159 => 26.1681, std. dev.: 0.0112) MultiSource/Applications/spiff/spiff: -1.21% (3.0263 => 2.9896, std. dev.: 0.0021) MultiSource/Benchmarks/nbench/nbench: -1.00% (11.2619 => 11.1491, std. dev.: 0.0038) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.52s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed May 2 11:50:15 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 2 May 2012 13:50:15 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120502185015.183D72A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/497?compare_to=496&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 497, Order: 155998, Start Time: 2012-05-02 17:53:26, End Time: 2012-05-02 18:50:46 To: 496, Order: 155995, Start Time: 2012-05-02 16:30:28, End Time: 2012-05-02 17:27:52 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (51 on baseline) Performance Improvements: 1 (25 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 891 (812 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: -1.12% (2.0246 => 2.0019, std. dev.: 0.0073) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.92% (2.0176 => 2.2782, std. dev.: 0.0082) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.23% (0.2721 => 0.2836, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.51% (0.3130 => 0.3240, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.41% (3.9660 => 4.1011, std. dev.: 0.0114) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.75% (1.4563 => 1.4964, std. dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 2.74% (13.8202 => 14.1986, std. dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.60% (0.5265 => 0.5402, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.50% (0.6959 => 0.7133, std. dev.: 0.0019) MultiSource/Benchmarks/nbench/nbench: 2.48% (1.0594 => 1.0857, std. dev.: 0.0025) MultiSource/Applications/kimwitu++/kc: 2.37% (16.6129 => 17.0062, std. dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.35% (1.2193 => 1.2479, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/football/football: 2.14% (0.8310 => 0.8488, std. dev.: 0.0055) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.12% (1.1364 => 1.1605, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.05% (1.3819 => 1.4102, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.03% (0.9199 => 0.9386, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.92% (0.5637 => 0.5745, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 1.89% (0.7506 => 0.7648, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.84% (0.7710 => 0.7852, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.79% (1.3813 => 1.4060, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.76% (13.2842 => 13.5179, std. dev.: 0.0037) MultiSource/Benchmarks/MallocBench/gs/gs: 1.65% (3.8646 => 3.9285, std. dev.: 0.0078) MultiSource/Applications/hbd/hbd: 1.60% (1.3693 => 1.3912, std. dev.: 0.0050) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.60% (0.7460 => 0.7579, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 1.58% (2.1791 => 2.2135, std. dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.57% (1.1333 => 1.1511, std. dev.: 0.0021) MultiSource/Applications/Burg/burg: 1.53% (1.1061 => 1.1230, std. dev.: 0.0015) MultiSource/Applications/treecc/treecc: 1.53% (1.9270 => 1.9564, std. dev.: 0.0050) SingleSource/UnitTests/ObjC++/property-reference: 1.52% (0.7061 => 0.7168, std. dev.: 0.0024) MultiSource/Applications/lambda-0_1_3/lambda: 1.46% (0.7038 => 0.7141, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.44% (3.6692 => 3.7220, std. dev.: 0.0096) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.40% (1.3245 => 1.3430, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 1.33% (1.2292 => 1.2455, std. dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 1.29% (1.2749 => 1.2914, std. dev.: 0.0015) MultiSource/Benchmarks/Bullet/bullet: 1.22% (33.2944 => 33.7018, std. dev.: 0.0116) MultiSource/Applications/JM/lencod/lencod: 1.13% (14.8535 => 15.0209, std. dev.: 0.0057) MultiSource/Applications/JM/ldecod/ldecod: 1.05% (6.5754 => 6.6446, std. dev.: 0.0037) MultiSource/Applications/ClamAV/clamscan: 1.03% (14.5298 => 14.6789, std. dev.: 0.0066) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 23.93% (1.8175 => 2.2525, std. dev.: 0.0060) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.90% (1.5824 => 1.6757, std. dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8147, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.71% (1.7688 => 1.8344, std. dev.: 0.0054) SingleSource/Benchmarks/Misc/salsa20: 3.62% (7.4271 => 7.6957, std. dev.: 0.0102) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 3.28% (0.9692 => 1.0010, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4550, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.76% (8.8259 => 9.0691, std. dev.: 0.0246) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.24% (7.9275 => 8.1051, std. dev.: 0.0166) SingleSource/Benchmarks/Misc/ffbench: 2.19% (0.8273 => 0.8454, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 1.57% (5.0168 => 5.0954, std. dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.28% (2.0200 => 2.0459, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0054) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -14.22% (0.4657 => 0.3995, std. dev.: 0.0222) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.40% (0.2670 => 0.2499, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.24% (0.3511 => 0.3292, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.50% (0.8818 => 0.8686, std. dev.: 0.0016) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/richards_benchmark: -12.53% (1.1560 => 1.0112, std. dev.: 0.0057) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.11% (1.0460 => 0.9402, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -9.61% (1.2308 => 1.1125, std. dev.: 0.0018) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.53% (0.3139 => 0.2934, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9474, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.75% (1.3780 => 1.3125, std. dev.: 0.0054) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.33% (0.2333 => 0.2232, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.64% (1.9762 => 1.9043, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -2.18% (6.3560 => 6.2176, std. dev.: 0.0098) MultiSource/Applications/minisat/minisat: -1.97% (9.3358 => 9.1516, std. dev.: 0.0247) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.84% (6.6320 => 6.5097, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/ReedSolomon: -1.66% (7.1097 => 6.9914, std. dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -1.51% (7.3305 => 7.2200, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout/heapsort: -1.51% (3.9173 => 3.8583, std. dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.41% (20.3410 => 20.0532, std. dev.: 0.0306) MultiSource/Applications/lua/lua: -1.39% (26.5159 => 26.1466, std. dev.: 0.0150) MultiSource/Applications/spiff/spiff: -1.16% (3.0263 => 2.9913, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.12% (3.8887 => 3.8451, std. dev.: 0.0110) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.84s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed May 2 13:13:06 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 2 May 2012 15:13:06 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120502201306.821662A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/498?compare_to=497&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 498, Order: 156005, Start Time: 2012-05-02 19:16:27, End Time: 2012-05-02 20:13:38 To: 497, Order: 155998, Start Time: 2012-05-02 17:53:26, End Time: 2012-05-02 18:50:46 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (49 on baseline) Performance Improvements: 1 (25 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 891 (814 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -1.27% (1.1125 => 1.0984, std. dev.: 0.0036) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.57% (2.0176 => 2.2712, std. dev.: 0.0149) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.90% (0.2721 => 0.2827, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.45% (0.3130 => 0.3238, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.35% (3.9660 => 4.0988, std. dev.: 0.0081) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.98% (0.5265 => 0.5422, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 2.76% (13.8202 => 14.2018, std. dev.: 0.0040) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.73% (1.4563 => 1.4961, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.39% (1.2193 => 1.2484, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.39% (0.6959 => 0.7125, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 2.33% (1.0594 => 1.0841, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.24% (0.5637 => 0.5763, std. dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 2.23% (16.6129 => 16.9839, std. dev.: 0.0145) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.23% (0.7710 => 0.7882, std. dev.: 0.0016) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.16% (1.1364 => 1.1610, std. dev.: 0.0006) MultiSource/Applications/spiff/spiff: 2.14% (0.7506 => 0.7667, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.14% (0.9199 => 0.9396, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 2.09% (0.8310 => 0.8484, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: 1.79% (3.8646 => 3.9339, std. dev.: 0.0134) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.79% (0.5577 => 0.5677, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.78% (13.2842 => 13.5207, std. dev.: 0.0076) MultiSource/Applications/hbd/hbd: 1.71% (1.3693 => 1.3927, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference: 1.61% (0.7061 => 0.7175, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.61% (1.3819 => 1.4041, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.60% (1.3813 => 1.4034, std. dev.: 0.0009) MultiSource/Applications/siod/siod: 1.57% (2.1791 => 2.2134, std. dev.: 0.0019) MultiSource/Applications/Burg/burg: 1.57% (1.1061 => 1.1235, std. dev.: 0.0007) MultiSource/Applications/treecc/treecc: 1.56% (1.9270 => 1.9570, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.51% (0.7460 => 0.7573, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.51% (1.1333 => 1.1504, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.46% (3.6692 => 3.7228, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.41% (1.3245 => 1.3432, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 1.33% (1.2292 => 1.2456, std. dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 1.11% (1.2749 => 1.2891, std. dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: 1.09% (33.2944 => 33.6580, std. dev.: 0.0111) MultiSource/Applications/JM/ldecod/ldecod: 1.08% (6.5754 => 6.6464, std. dev.: 0.0026) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.30% (1.8175 => 2.2591, std. dev.: 0.0407) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.52% (2.5629 => 2.7299, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.92% (1.5824 => 1.6761, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8146, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.64% (1.7688 => 1.8331, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 3.63% (7.4271 => 7.6970, std. dev.: 0.0046) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 3.27% (0.9692 => 1.0009, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4546, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.78% (8.8259 => 9.0713, std. dev.: 0.0022) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.37% (7.9275 => 8.1152, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/ffbench: 2.24% (0.8273 => 0.8458, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.31% (2.0200 => 2.0464, std. dev.: 0.0007) MultiSource/Benchmarks/sim/sim: 1.30% (5.0168 => 5.0822, std. dev.: 0.0100) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0039) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -15.65% (0.4657 => 0.3928, std. dev.: 0.0255) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.34% (0.2670 => 0.2474, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.47% (0.3511 => 0.3284, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.42% (0.8818 => 0.8605, std. dev.: 0.0014) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/richards_benchmark: -12.61% (1.1560 => 1.0102, std. dev.: 0.0019) SingleSource/Benchmarks/McGill/chomp: -10.76% (1.2308 => 1.0984, std. dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.12% (1.0460 => 0.9401, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.50% (0.3139 => 0.2935, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.36% (1.3780 => 1.3041, std. dev.: 0.0139) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9472, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.33% (0.2333 => 0.2232, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.73% (0.3458 => 0.3329, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.72% (1.9762 => 1.9027, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/lists: -2.16% (6.3560 => 6.2188, std. dev.: 0.0025) MultiSource/Applications/minisat/minisat: -2.02% (9.3358 => 9.1468, std. dev.: 0.0405) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.98% (6.6320 => 6.5007, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3446, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: -1.66% (7.1097 => 6.9916, std. dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -1.53% (7.3305 => 7.2185, std. dev.: 0.0028) MultiSource/Applications/lua/lua: -1.48% (26.5159 => 26.1222, std. dev.: 0.0218) SingleSource/Benchmarks/Shootout/heapsort: -1.40% (3.9173 => 3.8626, std. dev.: 0.0105) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.37% (20.3410 => 20.0628, std. dev.: 0.0158) MultiSource/Applications/spiff/spiff: -1.16% (3.0263 => 2.9912, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.10% (3.8887 => 3.8461, std. dev.: 0.0044) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.78s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed May 2 14:35:55 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 2 May 2012 16:35:55 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120502213555.9CBF92A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/499?compare_to=498&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 499, Order: 156009, Start Time: 2012-05-02 20:39:13, End Time: 2012-05-02 21:36:27 To: 498, Order: 156005, Start Time: 2012-05-02 19:16:27, End Time: 2012-05-02 20:13:38 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (51 on baseline) Performance Improvements: 0 (24 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 891 (813 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/McGill/chomp: 1.09% (1.0984 => 1.1104, std. dev.: 0.0028) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.47% (2.0176 => 2.2691, std. dev.: 0.0042) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.93% (0.2721 => 0.2828, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.45% (0.3130 => 0.3238, std. dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.32% (3.9660 => 4.0976, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.87% (0.5265 => 0.5416, std. dev.: 0.0033) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.66% (1.4563 => 1.4951, std. dev.: 0.0018) MultiSource/Applications/SPASS/SPASS: 2.65% (13.8202 => 14.1859, std. dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.46% (1.2193 => 1.2493, std. dev.: 0.0010) MultiSource/Applications/spiff/spiff: 2.37% (0.7506 => 0.7684, std. dev.: 0.0039) MultiSource/Benchmarks/nbench/nbench: 2.37% (1.0594 => 1.0845, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.36% (0.6959 => 0.7123, std. dev.: 0.0038) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.22% (1.1364 => 1.1616, std. dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 2.12% (16.6129 => 16.9645, std. dev.: 0.0147) MultiSource/Benchmarks/Prolangs-C/football/football: 2.11% (0.8310 => 0.8485, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.09% (0.5637 => 0.5755, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.02% (0.9199 => 0.9385, std. dev.: 0.0014) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.92% (0.7710 => 0.7858, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.86% (0.5577 => 0.5681, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.86% (13.2842 => 13.5311, std. dev.: 0.0059) MultiSource/Applications/Burg/burg: 1.84% (1.1061 => 1.1264, std. dev.: 0.0035) MultiSource/Benchmarks/MallocBench/gs/gs: 1.73% (3.8646 => 3.9314, std. dev.: 0.0125) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.63% (1.3813 => 1.4038, std. dev.: 0.0007) MultiSource/Applications/hbd/hbd: 1.62% (1.3693 => 1.3915, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.58% (1.3819 => 1.4038, std. dev.: 0.0014) MultiSource/Applications/siod/siod: 1.58% (2.1791 => 2.2136, std. dev.: 0.0040) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.55% (0.7460 => 0.7576, std. dev.: 0.0011) MultiSource/Applications/treecc/treecc: 1.55% (1.9270 => 1.9568, std. dev.: 0.0048) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.48% (1.1333 => 1.1501, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.42% (1.3245 => 1.3433, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.32% (3.6692 => 3.7176, std. dev.: 0.0025) MultiSource/Applications/hexxagon/hexxagon: 1.30% (1.2292 => 1.2452, std. dev.: 0.0009) MultiSource/Applications/SIBsim4/SIBsim4: 1.14% (1.2749 => 1.2894, std. dev.: 0.0016) MultiSource/Benchmarks/Bullet/bullet: 1.12% (33.2944 => 33.6675, std. dev.: 0.0179) MultiSource/Applications/JM/ldecod/ldecod: 1.06% (6.5754 => 6.6453, std. dev.: 0.0087) MultiSource/Applications/ClamAV/clamscan: 1.04% (14.5298 => 14.6803, std. dev.: 0.0161) MultiSource/Applications/JM/lencod/lencod: 1.02% (14.8535 => 15.0048, std. dev.: 0.0154) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.02% (7.2180 => 7.2915, std. dev.: 0.0108) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 23.70% (1.8175 => 2.2482, std. dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.85% (1.5824 => 1.6750, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8147, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.66% (1.7688 => 1.8335, std. dev.: 0.0058) SingleSource/Benchmarks/Misc/salsa20: 3.55% (7.4271 => 7.6908, std. dev.: 0.0040) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 3.26% (0.9692 => 1.0008, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4541, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.53% (8.8259 => 9.0494, std. dev.: 0.0350) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.33% (7.9275 => 8.1123, std. dev.: 0.0055) SingleSource/Benchmarks/Misc/ffbench: 2.22% (0.8273 => 0.8457, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: 1.37% (5.0168 => 5.0853, std. dev.: 0.0071) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.29% (2.0200 => 2.0460, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2135, std. dev.: 0.0034) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -15.53% (0.4657 => 0.3934, std. dev.: 0.0056) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.42% (0.2670 => 0.2472, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.61% (0.3511 => 0.3279, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.39% (0.8818 => 0.8607, std. dev.: 0.0010) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/richards_benchmark: -12.47% (1.1560 => 1.0119, std. dev.: 0.0047) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.12% (1.0460 => 0.9401, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -9.78% (1.2308 => 1.1104, std. dev.: 0.0028) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.56% (0.3139 => 0.2933, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.35% (1.3780 => 1.3043, std. dev.: 0.0100) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9473, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.33% (0.2333 => 0.2232, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.66% (1.9762 => 1.9039, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -2.02% (6.3560 => 6.2273, std. dev.: 0.0045) MultiSource/Applications/minisat/minisat: -2.02% (9.3358 => 9.1476, std. dev.: 0.0517) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.86% (6.6320 => 6.5086, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3446, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: -1.67% (7.1097 => 6.9913, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/heapsort: -1.53% (3.9173 => 3.8575, std. dev.: 0.0028) MultiSource/Benchmarks/Bullet/bullet: -1.49% (7.3305 => 7.2216, std. dev.: 0.0091) MultiSource/Applications/lua/lua: -1.37% (26.5159 => 26.1522, std. dev.: 0.0198) MultiSource/Applications/spiff/spiff: -1.26% (3.0263 => 2.9882, std. dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.19% (20.3410 => 20.0998, std. dev.: 0.0232) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.83s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed May 2 15:58:49 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 2 May 2012 17:58:49 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120502225849.E82D32A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/500?compare_to=499&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 500, Order: 156022, Start Time: 2012-05-02 22:02:16, End Time: 2012-05-02 22:59:23 To: 499, Order: 156009, Start Time: 2012-05-02 20:39:13, End Time: 2012-05-02 21:36:27 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (45 on baseline) Performance Improvements: 0 (25 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 890 (818 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 1.30% (7.9558 => 8.0596, std. dev.: 0.0076) MultiSource/Benchmarks/llubenchmark/llu: 1.09% (3.7659 => 3.8068, std. dev.: 0.0155) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.45% (2.0176 => 2.2688, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.71% (0.2721 => 0.2822, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.45% (0.3130 => 0.3238, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.28% (3.9660 => 4.0960, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.72% (0.5265 => 0.5408, std. dev.: 0.0014) MultiSource/Applications/SPASS/SPASS: 2.66% (13.8202 => 14.1883, std. dev.: 0.0066) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.65% (1.4563 => 1.4949, std. dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 2.34% (1.0594 => 1.0842, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.31% (1.2193 => 1.2475, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.24% (0.6959 => 0.7115, std. dev.: 0.0011) MultiSource/Applications/spiff/spiff: 2.13% (0.7506 => 0.7666, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.10% (0.9199 => 0.9392, std. dev.: 0.0022) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.09% (1.1364 => 1.1602, std. dev.: 0.0009) MultiSource/Applications/kimwitu++/kc: 2.03% (16.6129 => 16.9500, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/football/football: 1.97% (0.8310 => 0.8474, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.94% (13.2842 => 13.5415, std. dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.88% (0.5637 => 0.5743, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.74% (1.3813 => 1.4053, std. dev.: 0.0028) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.71% (0.7710 => 0.7842, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 1.64% (3.8646 => 3.9280, std. dev.: 0.0062) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.48% (1.3819 => 1.4024, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.47% (0.7460 => 0.7570, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.46% (1.1333 => 1.1498, std. dev.: 0.0008) MultiSource/Applications/treecc/treecc: 1.44% (1.9270 => 1.9547, std. dev.: 0.0016) MultiSource/Applications/Burg/burg: 1.43% (1.1061 => 1.1219, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.31% (1.3245 => 1.3419, std. dev.: 0.0017) MultiSource/Applications/hbd/hbd: 1.23% (1.3693 => 1.3862, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.23% (3.6692 => 3.7142, std. dev.: 0.0028) MultiSource/Applications/SIBsim4/SIBsim4: 1.12% (1.2749 => 1.2892, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.02% (7.2180 => 7.2913, std. dev.: 0.0054) MultiSource/Applications/sqlite3/sqlite3: 1.02% (16.2614 => 16.4265, std. dev.: 0.0055) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 23.96% (1.8175 => 2.2530, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7298, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6754, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.65% (1.7688 => 1.8334, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: 3.54% (7.4271 => 7.6902, std. dev.: 0.0098) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 3.28% (0.9692 => 1.0010, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4541, std. dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.94% (8.8259 => 9.0855, std. dev.: 0.0095) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.49% (7.9275 => 8.1248, std. dev.: 0.0061) SingleSource/Benchmarks/Misc/ffbench: 2.25% (0.8273 => 0.8459, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: 1.49% (5.0168 => 5.0913, std. dev.: 0.0051) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.26% (2.0200 => 2.0455, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -16.79% (0.4657 => 0.3875, std. dev.: 0.0069) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.34% (0.2670 => 0.2474, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.66% (0.3511 => 0.3277, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.36% (0.8818 => 0.8610, std. dev.: 0.0009) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/richards_benchmark: -12.40% (1.1560 => 1.0126, std. dev.: 0.0042) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.12% (1.0460 => 0.9401, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -9.82% (1.2308 => 1.1099, std. dev.: 0.0041) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.50% (0.3139 => 0.2935, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.19% (1.3780 => 1.3065, std. dev.: 0.0070) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9474, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.33% (0.2333 => 0.2232, std. dev.: 0.0015) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.61% (0.3458 => 0.3333, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -3.59% (1.9762 => 1.9052, std. dev.: 0.0105) MultiSource/Applications/minisat/minisat: -2.14% (9.3358 => 9.1357, std. dev.: 0.0200) SingleSource/Benchmarks/Shootout/lists: -2.04% (6.3560 => 6.2266, std. dev.: 0.0071) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.92% (6.6320 => 6.5048, std. dev.: 0.0051) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.66% (7.1097 => 6.9914, std. dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -1.50% (7.3305 => 7.2202, std. dev.: 0.0093) MultiSource/Applications/lua/lua: -1.37% (26.5159 => 26.1517, std. dev.: 0.0240) SingleSource/Benchmarks/Shootout/heapsort: -1.37% (3.9173 => 3.8636, std. dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.29% (20.3410 => 20.0787, std. dev.: 0.0608) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.15% (3.8887 => 3.8440, std. dev.: 0.0061) MultiSource/Applications/spiff/spiff: -1.07% (3.0263 => 2.9939, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.12s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed May 2 17:21:49 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 2 May 2012 19:21:49 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120503002149.96D2E2A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/501?compare_to=500&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 501, Order: 156033, Start Time: 2012-05-02 23:24:54, End Time: 2012-05-03 00:22:23 To: 500, Order: 156022, Start Time: 2012-05-02 22:02:16, End Time: 2012-05-02 22:59:23 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (55 on baseline) Performance Improvements: 0 (24 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (809 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.91% (2.0176 => 2.2780, std. dev.: 0.0042) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.67% (0.2721 => 0.2848, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.64% (0.3130 => 0.3244, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.52% (3.9660 => 4.1055, std. dev.: 0.0014) MultiSource/Applications/SPASS/SPASS: 3.11% (13.8202 => 14.2499, std. dev.: 0.0146) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.05% (1.4563 => 1.5007, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.00% (0.5265 => 0.5423, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.69% (0.6959 => 0.7146, std. dev.: 0.0062) MultiSource/Benchmarks/nbench/nbench: 2.68% (1.0594 => 1.0878, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.62% (1.2193 => 1.2512, std. dev.: 0.0013) MultiSource/Applications/kimwitu++/kc: 2.49% (16.6129 => 17.0270, std. dev.: 0.0077) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.45% (1.1364 => 1.1642, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.38% (0.5637 => 0.5771, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 2.28% (0.7506 => 0.7677, std. dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.24% (0.9199 => 0.9405, std. dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.23% (13.2842 => 13.5802, std. dev.: 0.0047) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.05% (0.7710 => 0.7868, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.94% (0.5577 => 0.5685, std. dev.: 0.0008) MultiSource/Applications/hbd/hbd: 1.94% (1.3693 => 1.3958, std. dev.: 0.0020) MultiSource/Benchmarks/MallocBench/gs/gs: 1.91% (3.8646 => 3.9384, std. dev.: 0.0046) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.82% (0.7460 => 0.7596, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.79% (1.1333 => 1.1536, std. dev.: 0.0007) MultiSource/Applications/siod/siod: 1.79% (2.1791 => 2.2180, std. dev.: 0.0056) MultiSource/Applications/Burg/burg: 1.77% (1.1061 => 1.1257, std. dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.75% (1.3245 => 1.3477, std. dev.: 0.0056) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.74% (1.3819 => 1.4059, std. dev.: 0.0044) MultiSource/Applications/treecc/treecc: 1.62% (1.9270 => 1.9583, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.59% (1.3813 => 1.4032, std. dev.: 0.0025) MultiSource/Applications/SIBsim4/SIBsim4: 1.58% (1.2749 => 1.2951, std. dev.: 0.0019) MultiSource/Applications/hexxagon/hexxagon: 1.58% (1.2292 => 1.2486, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.51% (3.6692 => 3.7245, std. dev.: 0.0049) MultiSource/Applications/JM/lencod/lencod: 1.38% (14.8535 => 15.0581, std. dev.: 0.0098) MultiSource/Benchmarks/Bullet/bullet: 1.33% (33.2944 => 33.7363, std. dev.: 0.0201) MultiSource/Applications/JM/ldecod/ldecod: 1.31% (6.5754 => 6.6617, std. dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.27% (2.1007 => 2.1274, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.26% (1.9828 => 2.0078, std. dev.: 0.0006) MultiSource/Applications/d/make_dparser: 1.23% (3.1889 => 3.2281, std. dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: 1.17% (16.2614 => 16.4518, std. dev.: 0.0441) MultiSource/Applications/ClamAV/clamscan: 1.10% (14.5298 => 14.6890, std. dev.: 0.0078) MultiSource/Applications/oggenc/oggenc: 1.05% (4.6629 => 4.7120, std. dev.: 0.0081) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.03% (7.2180 => 7.2926, std. dev.: 0.0049) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.14% (1.8175 => 2.2562, std. dev.: 0.0131) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.87% (1.5824 => 1.6753, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8146, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.64% (1.7688 => 1.8331, std. dev.: 0.0057) SingleSource/Benchmarks/Misc/salsa20: 3.58% (7.4271 => 7.6932, std. dev.: 0.0094) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 3.29% (0.9692 => 1.0011, std. dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4540, std. dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.64% (8.8259 => 9.0588, std. dev.: 0.0390) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.42% (7.9275 => 8.1193, std. dev.: 0.0072) SingleSource/Benchmarks/Misc/ffbench: 2.25% (0.8273 => 0.8459, std. dev.: 0.0044) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.27% (2.0200 => 2.0456, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0014) MultiSource/Benchmarks/sim/sim: 1.11% (5.0168 => 5.0723, std. dev.: 0.0150) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -19.50% (0.4657 => 0.3749, std. dev.: 0.0054) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.18% (0.2670 => 0.2505, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.64% (0.3511 => 0.3313, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.55% (0.8818 => 0.8681, std. dev.: 0.0011) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/richards_benchmark: -12.34% (1.1560 => 1.0133, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -10.94% (1.2308 => 1.0961, std. dev.: 0.0067) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.12% (1.0460 => 0.9401, std. dev.: 0.0020) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.53% (0.3139 => 0.2934, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.34% (1.3780 => 1.3044, std. dev.: 0.0133) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9474, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.33% (0.2333 => 0.2232, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -3.71% (1.9762 => 1.9028, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.99% (6.3560 => 6.2298, std. dev.: 0.0098) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.93% (6.6320 => 6.5037, std. dev.: 0.0038) MultiSource/Applications/minisat/minisat: -1.90% (9.3358 => 9.1581, std. dev.: 0.0082) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.67% (7.1097 => 6.9911, std. dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: -1.51% (7.3305 => 7.2195, std. dev.: 0.0261) MultiSource/Applications/lua/lua: -1.36% (26.5159 => 26.1564, std. dev.: 0.0193) SingleSource/Benchmarks/Shootout/heapsort: -1.24% (3.9173 => 3.8686, std. dev.: 0.0024) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.17% (20.3410 => 20.1024, std. dev.: 0.0346) MultiSource/Applications/spiff/spiff: -1.17% (3.0263 => 2.9909, std. dev.: 0.0017) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.11s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed May 2 19:38:10 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 2 May 2012 21:38:10 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120503023810.18BA82A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/502?compare_to=501&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 502, Order: 156043, Start Time: 2012-05-03 01:41:31, End Time: 2012-05-03 02:38:42 To: 501, Order: 156033, Start Time: 2012-05-02 23:24:54, End Time: 2012-05-03 00:22:23 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (59 on baseline) Performance Improvements: 0 (25 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (804 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.87% (2.0176 => 2.2772, std. dev.: 0.0052) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.67% (0.2721 => 0.2848, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.77% (0.3130 => 0.3248, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.59% (3.9660 => 4.1083, std. dev.: 0.0074) MultiSource/Applications/SPASS/SPASS: 3.16% (13.8202 => 14.2572, std. dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.02% (0.5265 => 0.5424, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.91% (1.4563 => 1.4987, std. dev.: 0.0009) MultiSource/Applications/kimwitu++/kc: 2.87% (16.6129 => 17.0891, std. dev.: 0.0093) MultiSource/Benchmarks/nbench/nbench: 2.73% (1.0594 => 1.0883, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.67% (0.6959 => 0.7145, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.66% (1.2193 => 1.2517, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.46% (1.1364 => 1.1644, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.41% (0.5637 => 0.5773, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 2.39% (0.8310 => 0.8509, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.38% (0.9199 => 0.9418, std. dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.36% (0.4791 => 0.4904, std. dev.: 0.0000) MultiSource/Applications/spiff/spiff: 2.28% (0.7506 => 0.7677, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.21% (13.2842 => 13.5777, std. dev.: 0.0072) MultiSource/Benchmarks/MallocBench/gs/gs: 2.12% (3.8646 => 3.9467, std. dev.: 0.0052) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.08% (0.7710 => 0.7870, std. dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: 2.02% (0.7038 => 0.7180, std. dev.: 0.0009) MultiSource/Applications/hbd/hbd: 1.98% (1.3693 => 1.3964, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 1.95% (2.1791 => 2.2217, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.94% (0.5577 => 0.5685, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 1.92% (1.1061 => 1.1273, std. dev.: 0.0035) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.86% (0.7460 => 0.7599, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.82% (1.1333 => 1.1539, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.80% (1.3813 => 1.4061, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.76% (1.3819 => 1.4062, std. dev.: 0.0005) MultiSource/Applications/treecc/treecc: 1.75% (1.9270 => 1.9608, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.75% (1.3245 => 1.3477, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.62% (3.6692 => 3.7285, std. dev.: 0.0115) MultiSource/Applications/hexxagon/hexxagon: 1.59% (1.2292 => 1.2487, std. dev.: 0.0015) MultiSource/Applications/SIBsim4/SIBsim4: 1.54% (1.2749 => 1.2945, std. dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: 1.53% (33.2944 => 33.8039, std. dev.: 0.0099) MultiSource/Applications/minisat/minisat: 1.53% (0.6744 => 0.6847, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.45% (2.1007 => 2.1312, std. dev.: 0.0008) MultiSource/Applications/JM/lencod/lencod: 1.31% (14.8535 => 15.0482, std. dev.: 0.0047) MultiSource/Applications/JM/ldecod/ldecod: 1.28% (6.5754 => 6.6594, std. dev.: 0.0062) MultiSource/Applications/d/make_dparser: 1.22% (3.1889 => 3.2279, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.18% (1.5188 => 1.5367, std. dev.: 0.0017) MultiSource/Applications/ClamAV/clamscan: 1.18% (14.5298 => 14.7007, std. dev.: 0.0094) MultiSource/Applications/sqlite3/sqlite3: 1.13% (16.2614 => 16.4449, std. dev.: 0.0027) MultiSource/Applications/oggenc/oggenc: 1.07% (4.6629 => 4.7129, std. dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.05% (7.2180 => 7.2938, std. dev.: 0.0018) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.50% (1.8175 => 2.2627, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6754, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: 3.75% (7.4271 => 7.7054, std. dev.: 0.0046) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.63% (1.7688 => 1.8330, std. dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 3.27% (0.9692 => 1.0009, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.01% (12.0921 => 12.4556, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.83% (8.8259 => 9.0759, std. dev.: 0.0069) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.52% (7.9275 => 8.1273, std. dev.: 0.0129) SingleSource/Benchmarks/Misc/ffbench: 2.24% (0.8273 => 0.8458, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.28% (2.0200 => 2.0458, std. dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 1.19% (5.0168 => 5.0764, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -19.93% (0.4657 => 0.3729, std. dev.: 0.0034) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.10% (0.2670 => 0.2507, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.61% (0.3511 => 0.3314, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.56% (0.8818 => 0.8680, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/richards_benchmark: -12.78% (1.1560 => 1.0083, std. dev.: 0.0064) SingleSource/Benchmarks/McGill/chomp: -10.72% (1.2308 => 1.0989, std. dev.: 0.0063) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.12% (1.0460 => 0.9401, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.53% (0.3139 => 0.2934, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.16% (1.3780 => 1.3069, std. dev.: 0.0057) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9473, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.33% (0.2333 => 0.2232, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.68% (1.9762 => 1.9034, std. dev.: 0.0006) MultiSource/Applications/minisat/minisat: -2.11% (9.3358 => 9.1384, std. dev.: 0.0351) SingleSource/Benchmarks/Shootout/lists: -2.08% (6.3560 => 6.2240, std. dev.: 0.0092) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.08% (0.4867 => 0.4766, std. dev.: 0.0017) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.95% (6.6320 => 6.5025, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.67% (7.1097 => 6.9912, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/heapsort: -1.44% (3.9173 => 3.8607, std. dev.: 0.0035) MultiSource/Benchmarks/Bullet/bullet: -1.44% (7.3305 => 7.2248, std. dev.: 0.0070) MultiSource/Applications/lua/lua: -1.29% (26.5159 => 26.1727, std. dev.: 0.0219) MultiSource/Applications/spiff/spiff: -1.26% (3.0263 => 2.9881, std. dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.16% (20.3410 => 20.1060, std. dev.: 0.0169) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.18s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed May 2 21:00:55 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 2 May 2012 23:00:55 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120503040055.E465F2A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/503?compare_to=502&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 503, Order: 156056, Start Time: 2012-05-03 03:04:16, End Time: 2012-05-03 04:01:29 To: 502, Order: 156043, Start Time: 2012-05-03 01:41:31, End Time: 2012-05-03 02:38:42 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (61 on baseline) Performance Improvements: 0 (25 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (802 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.07% (2.0176 => 2.2812, std. dev.: 0.0042) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.63% (0.2721 => 0.2847, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.77% (0.3130 => 0.3248, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.62% (3.9660 => 4.1097, std. dev.: 0.0040) MultiSource/Applications/SPASS/SPASS: 3.06% (13.8202 => 14.2434, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.02% (0.5265 => 0.5424, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.96% (1.4563 => 1.4994, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 2.68% (1.0594 => 1.0878, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.65% (1.2193 => 1.2516, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.63% (0.6959 => 0.7142, std. dev.: 0.0012) MultiSource/Applications/kimwitu++/kc: 2.59% (16.6129 => 17.0424, std. dev.: 0.0047) MultiSource/Applications/spiff/spiff: 2.54% (0.7506 => 0.7697, std. dev.: 0.0020) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.48% (1.1364 => 1.1646, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.40% (13.2842 => 13.6026, std. dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.39% (0.9199 => 0.9419, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: 2.35% (0.8310 => 0.8505, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.34% (0.5637 => 0.5769, std. dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.15% (0.4791 => 0.4894, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 2.12% (0.7038 => 0.7187, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 2.08% (3.8646 => 3.9449, std. dev.: 0.0116) MultiSource/Applications/hbd/hbd: 2.02% (1.3693 => 1.3969, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 2.01% (1.1061 => 1.1283, std. dev.: 0.0020) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.94% (0.7460 => 0.7605, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.94% (0.5577 => 0.5685, std. dev.: 0.0010) MultiSource/Applications/siod/siod: 1.91% (2.1791 => 2.2207, std. dev.: 0.0112) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.91% (0.7710 => 0.7857, std. dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.85% (1.1333 => 1.1543, std. dev.: 0.0018) MultiSource/Applications/treecc/treecc: 1.77% (1.9270 => 1.9612, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.74% (1.3813 => 1.4053, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.72% (1.3819 => 1.4056, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.71% (1.3245 => 1.3471, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.65% (3.6692 => 3.7298, std. dev.: 0.0018) MultiSource/Applications/JM/ldecod/ldecod: 1.63% (6.5754 => 6.6825, std. dev.: 0.0083) SingleSource/UnitTests/ObjC++/property-reference: 1.61% (0.7061 => 0.7175, std. dev.: 0.0026) MultiSource/Applications/SIBsim4/SIBsim4: 1.59% (1.2749 => 1.2952, std. dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 1.57% (1.2292 => 1.2485, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: 1.50% (0.6744 => 0.6845, std. dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 1.43% (14.8535 => 15.0662, std. dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: 1.25% (16.2614 => 16.4651, std. dev.: 0.0279) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.25% (1.9828 => 2.0075, std. dev.: 0.0004) MultiSource/Applications/d/make_dparser: 1.24% (3.1889 => 3.2285, std. dev.: 0.0039) MultiSource/Benchmarks/Bullet/bullet: 1.22% (33.2944 => 33.7019, std. dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.16% (2.1007 => 2.1251, std. dev.: 0.0072) MultiSource/Applications/ClamAV/clamscan: 1.16% (14.5298 => 14.6985, std. dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.16% (7.2180 => 7.3016, std. dev.: 0.0089) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.11% (4.3801 => 4.4288, std. dev.: 0.0051) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 23.81% (1.8175 => 2.2503, std. dev.: 0.0061) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0007) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.92% (1.5824 => 1.6760, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.69% (1.7688 => 1.8341, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: 3.63% (7.4271 => 7.6965, std. dev.: 0.0119) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 3.25% (0.9692 => 1.0007, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4540, std. dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.98% (8.8259 => 9.0891, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.50% (7.9275 => 8.1256, std. dev.: 0.0075) SingleSource/Benchmarks/Misc/ffbench: 2.24% (0.8273 => 0.8458, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: 1.37% (5.0168 => 5.0855, std. dev.: 0.0083) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.28% (2.0200 => 2.0459, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0046) SingleSource/Benchmarks/Dhrystone/fldry: 1.01% (1.9290 => 1.9484, std. dev.: 0.0049) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.22% (0.2670 => 0.2504, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.90% (0.3511 => 0.3304, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.69% (0.8818 => 0.8669, std. dev.: 0.0013) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/richards_benchmark: -13.04% (1.1560 => 1.0052, std. dev.: 0.0095) SingleSource/Benchmarks/McGill/chomp: -10.50% (1.2308 => 1.1016, std. dev.: 0.0096) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.12% (1.0460 => 0.9401, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.50% (0.3139 => 0.2935, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9472, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.80% (1.3780 => 1.3118, std. dev.: 0.0045) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.33% (0.2333 => 0.2232, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.67% (0.3458 => 0.3331, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -3.66% (1.9762 => 1.9038, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout/lists: -2.04% (6.3560 => 6.2264, std. dev.: 0.0092) MultiSource/Applications/minisat/minisat: -2.03% (9.3358 => 9.1464, std. dev.: 0.0482) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.99% (6.6320 => 6.5003, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/ReedSolomon: -1.66% (7.1097 => 6.9917, std. dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -1.50% (7.3305 => 7.2209, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout/heapsort: -1.44% (3.9173 => 3.8608, std. dev.: 0.0022) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.39% (20.3410 => 20.0575, std. dev.: 0.0677) MultiSource/Applications/lua/lua: -1.22% (26.5159 => 26.1913, std. dev.: 0.0180) MultiSource/Applications/spiff/spiff: -1.15% (3.0263 => 2.9916, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.03% (3.8887 => 3.8485, std. dev.: 0.0050) MultiSource/Benchmarks/nbench/nbench: -1.01% (11.2619 => 11.1476, std. dev.: 0.0013) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.23s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed May 2 23:50:24 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 3 May 2012 01:50:24 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120503065024.6E4762A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/504?compare_to=503&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 504, Order: 156058, Start Time: 2012-05-03 05:53:45, End Time: 2012-05-03 06:50:56 To: 503, Order: 156056, Start Time: 2012-05-03 03:04:16, End Time: 2012-05-03 04:01:29 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (61 on baseline) Performance Improvements: 0 (25 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (802 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.76% (2.0176 => 2.2953, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.56% (0.2721 => 0.2845, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.96% (0.3130 => 0.3254, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.80% (3.9660 => 4.1166, std. dev.: 0.0015) MultiSource/Applications/SPASS/SPASS: 3.45% (13.8202 => 14.2975, std. dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.25% (0.5265 => 0.5436, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.09% (1.4563 => 1.5013, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.97% (0.6959 => 0.7166, std. dev.: 0.0012) MultiSource/Applications/kimwitu++/kc: 2.89% (16.6129 => 17.0932, std. dev.: 0.0097) MultiSource/Benchmarks/nbench/nbench: 2.83% (1.0594 => 1.0894, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.75% (1.2193 => 1.2528, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 2.57% (0.7506 => 0.7699, std. dev.: 0.0016) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.53% (1.1364 => 1.1652, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.49% (13.2842 => 13.6148, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/football/football: 2.43% (0.8310 => 0.8512, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.43% (0.5637 => 0.5774, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.42% (0.4791 => 0.4907, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.38% (0.9199 => 0.9418, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 2.23% (3.8646 => 3.9509, std. dev.: 0.0066) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.15% (0.7710 => 0.7876, std. dev.: 0.0017) MultiSource/Applications/lambda-0_1_3/lambda: 2.13% (0.7038 => 0.7188, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 2.09% (1.1061 => 1.1292, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.04% (0.5577 => 0.5691, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 2.02% (1.3693 => 1.3970, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.01% (1.1333 => 1.1561, std. dev.: 0.0008) MultiSource/Applications/siod/siod: 2.00% (2.1791 => 2.2227, std. dev.: 0.0090) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.93% (1.3813 => 1.4079, std. dev.: 0.0008) MultiSource/Applications/treecc/treecc: 1.90% (1.9270 => 1.9637, std. dev.: 0.0020) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.88% (0.7460 => 0.7600, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.87% (1.3819 => 1.4078, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.84% (1.3245 => 1.3489, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.73% (3.6692 => 3.7326, std. dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.67% (0.6283 => 0.6388, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 1.55% (1.2292 => 1.2483, std. dev.: 0.0062) MultiSource/Applications/JM/ldecod/ldecod: 1.51% (6.5754 => 6.6748, std. dev.: 0.0050) MultiSource/Applications/minisat/minisat: 1.48% (0.6744 => 0.6844, std. dev.: 0.0007) MultiSource/Applications/d/make_dparser: 1.42% (3.1889 => 3.2341, std. dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.41% (2.1007 => 2.1304, std. dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 1.38% (14.8535 => 15.0585, std. dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.26% (7.2180 => 7.3090, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.22% (1.9828 => 2.0069, std. dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: 1.20% (33.2944 => 33.6952, std. dev.: 0.0527) MultiSource/Applications/ClamAV/clamscan: 1.15% (14.5298 => 14.6973, std. dev.: 0.0087) MultiSource/Applications/sqlite3/sqlite3: 1.11% (16.2614 => 16.4427, std. dev.: 0.0117) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.05% (4.3801 => 4.4261, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.02% (1.5188 => 1.5343, std. dev.: 0.0010) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.77% (1.8175 => 2.2677, std. dev.: 0.0134) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.90% (1.5824 => 1.6757, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.67% (1.7688 => 1.8337, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/salsa20: 3.58% (7.4271 => 7.6932, std. dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 3.27% (0.9692 => 1.0009, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4541, std. dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.96% (8.8259 => 9.0875, std. dev.: 0.0072) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.34% (7.9275 => 8.1130, std. dev.: 0.0072) SingleSource/Benchmarks/Misc/ffbench: 2.25% (0.8273 => 0.8459, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: 1.57% (5.0168 => 5.0955, std. dev.: 0.0060) SingleSource/Benchmarks/Dhrystone/fldry: 1.54% (1.9290 => 1.9587, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.27% (2.0200 => 2.0456, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -12.82% (0.4657 => 0.4060, std. dev.: 0.0061) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.10% (0.2670 => 0.2507, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.95% (0.3511 => 0.3302, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.69% (0.8818 => 0.8669, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/richards_benchmark: -12.24% (1.1560 => 1.0145, std. dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.12% (1.0460 => 0.9401, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -9.79% (1.2308 => 1.1103, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.53% (0.3139 => 0.2934, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9474, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.51% (1.3780 => 1.3159, std. dev.: 0.0052) MultiSource/Benchmarks/FreeBench/neural/neural: -4.33% (0.2333 => 0.2232, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.63% (1.9762 => 1.9044, std. dev.: 0.0041) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.59% (0.3458 => 0.3334, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -2.15% (6.3560 => 6.2194, std. dev.: 0.0107) MultiSource/Applications/minisat/minisat: -2.10% (9.3358 => 9.1394, std. dev.: 0.0192) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.90% (6.6320 => 6.5061, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.67% (7.1097 => 6.9913, std. dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -1.46% (7.3305 => 7.2238, std. dev.: 0.0205) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.35% (20.3410 => 20.0655, std. dev.: 0.0636) MultiSource/Applications/lua/lua: -1.23% (26.5159 => 26.1896, std. dev.: 0.0344) MultiSource/Applications/spiff/spiff: -1.12% (3.0263 => 2.9924, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.09% (3.8887 => 3.8462, std. dev.: 0.0068) MultiSource/Benchmarks/nbench/nbench: -1.02% (11.2619 => 11.1466, std. dev.: 0.0019) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.75s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu May 3 01:41:58 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 3 May 2012 03:41:58 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120503084158.AE7612A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/505?compare_to=504&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 505, Order: 156059, Start Time: 2012-05-03 07:44:57, End Time: 2012-05-03 08:42:31 To: 504, Order: 156058, Start Time: 2012-05-03 05:53:45, End Time: 2012-05-03 06:50:56 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (66 on baseline) Performance Improvements: 0 (24 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 891 (798 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 3.33% (3.7646 => 3.8901, std. dev.: 0.0264) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.18% (2.0176 => 2.2836, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.48% (0.2721 => 0.2843, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.99% (0.3130 => 0.3255, std. dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.82% (3.9660 => 4.1176, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.55% (1.4563 => 1.5080, std. dev.: 0.0079) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.32% (0.5265 => 0.5440, std. dev.: 0.0032) MultiSource/Applications/SPASS/SPASS: 3.26% (13.8202 => 14.2706, std. dev.: 0.0047) MultiSource/Benchmarks/nbench/nbench: 3.16% (1.0594 => 1.0929, std. dev.: 0.0043) MultiSource/Applications/spiff/spiff: 2.90% (0.7506 => 0.7724, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.90% (0.6959 => 0.7161, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.88% (1.2193 => 1.2544, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.76% (0.7710 => 0.7923, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.70% (0.9199 => 0.9447, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.68% (1.1364 => 1.1668, std. dev.: 0.0020) MultiSource/Applications/kimwitu++/kc: 2.67% (16.6129 => 17.0572, std. dev.: 0.0113) MultiSource/Benchmarks/Prolangs-C/football/football: 2.67% (0.8310 => 0.8532, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.61% (0.5637 => 0.5784, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 2.56% (1.3693 => 1.4044, std. dev.: 0.0058) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.46% (13.2842 => 13.6115, std. dev.: 0.0131) MultiSource/Applications/Burg/burg: 2.35% (1.1061 => 1.1321, std. dev.: 0.0052) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.23% (0.4791 => 0.4898, std. dev.: 0.0011) MultiSource/Applications/lambda-0_1_3/lambda: 2.20% (0.7038 => 0.7193, std. dev.: 0.0030) MultiSource/Benchmarks/MallocBench/gs/gs: 2.18% (3.8646 => 3.9490, std. dev.: 0.0085) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.15% (0.5577 => 0.5697, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.08% (1.3819 => 1.4107, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.08% (0.7460 => 0.7615, std. dev.: 0.0012) MultiSource/Applications/minisat/minisat: 2.03% (0.6744 => 0.6881, std. dev.: 0.0009) MultiSource/Applications/treecc/treecc: 2.01% (1.9270 => 1.9658, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.01% (1.1333 => 1.1561, std. dev.: 0.0006) MultiSource/Applications/siod/siod: 2.00% (2.1791 => 2.2226, std. dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.93% (1.3245 => 1.3501, std. dev.: 0.0032) MultiSource/Applications/hexxagon/hexxagon: 1.86% (1.2292 => 1.2521, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.85% (1.3813 => 1.4069, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.85% (0.6283 => 0.6399, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.84% (3.6692 => 3.7368, std. dev.: 0.0028) MultiSource/Applications/SIBsim4/SIBsim4: 1.84% (1.2749 => 1.2983, std. dev.: 0.0027) MultiSource/Applications/JM/ldecod/ldecod: 1.73% (6.5754 => 6.6889, std. dev.: 0.0155) MultiSource/Applications/JM/lencod/lencod: 1.64% (14.8535 => 15.0971, std. dev.: 0.0098) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.59% (2.1007 => 2.1340, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.54% (1.9828 => 2.0133, std. dev.: 0.0013) MultiSource/Applications/ClamAV/clamscan: 1.52% (14.5298 => 14.7512, std. dev.: 0.0082) MultiSource/Applications/d/make_dparser: 1.49% (3.1889 => 3.2364, std. dev.: 0.0020) MultiSource/Applications/sqlite3/sqlite3: 1.43% (16.2614 => 16.4943, std. dev.: 0.0233) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.38% (7.2180 => 7.3175, std. dev.: 0.0047) MultiSource/Benchmarks/Bullet/bullet: 1.29% (33.2944 => 33.7233, std. dev.: 0.0219) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.26% (4.3801 => 4.4352, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.21% (3.2742 => 3.3137, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.20% (1.5188 => 1.5370, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.12% (4.4433 => 4.4932, std. dev.: 0.0088) MultiSource/Applications/oggenc/oggenc: 1.12% (4.6629 => 4.7150, std. dev.: 0.0028) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.05% (4.9865 => 5.0388, std. dev.: 0.0113) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.01% (6.2785 => 6.3416, std. dev.: 0.0011) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.20% (1.8175 => 2.2574, std. dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.86% (1.5824 => 1.6751, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 3.72% (7.4271 => 7.7031, std. dev.: 0.0025) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.53% (1.7688 => 1.8312, std. dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 3.25% (0.9692 => 1.0007, std. dev.: 0.0002) MultiSource/Benchmarks/llubenchmark/llu: 3.10% (3.7731 => 3.8901, std. dev.: 0.0264) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4537, std. dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.96% (8.8259 => 9.0868, std. dev.: 0.0104) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.28% (7.9275 => 8.1085, std. dev.: 0.0092) SingleSource/Benchmarks/Misc/ffbench: 2.20% (0.8273 => 0.8455, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.27% (2.0200 => 2.0456, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.29% (0.2670 => 0.2502, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.18% (0.3511 => 0.3329, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.50% (0.8818 => 0.8686, std. dev.: 0.0016) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/richards_benchmark: -12.74% (1.1560 => 1.0087, std. dev.: 0.0048) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.12% (1.0460 => 0.9401, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.07% (1.2308 => 1.1069, std. dev.: 0.0025) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.53% (0.3139 => 0.2934, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.85% (1.3780 => 1.3111, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9473, std. dev.: 0.0004) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.33% (0.2333 => 0.2232, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.76% (0.3458 => 0.3328, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.73% (1.9762 => 1.9025, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout/lists: -2.26% (6.3560 => 6.2124, std. dev.: 0.0117) MultiSource/Applications/minisat/minisat: -1.87% (9.3358 => 9.1608, std. dev.: 0.0289) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.86% (6.6320 => 6.5085, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3444, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.67% (7.1097 => 6.9913, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/heapsort: -1.51% (3.9173 => 3.8581, std. dev.: 0.0068) MultiSource/Benchmarks/Bullet/bullet: -1.49% (7.3305 => 7.2212, std. dev.: 0.0096) MultiSource/Applications/lua/lua: -1.40% (26.5159 => 26.1449, std. dev.: 0.0271) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.35% (20.3410 => 20.0656, std. dev.: 0.0581) MultiSource/Applications/spiff/spiff: -1.14% (3.0263 => 2.9917, std. dev.: 0.0015) MultiSource/Benchmarks/nbench/nbench: -1.01% (11.2619 => 11.1486, std. dev.: 0.0018) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.83s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu May 3 03:05:01 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 3 May 2012 05:05:01 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120503100501.E84B32A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/506?compare_to=505&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 506, Order: 156062, Start Time: 2012-05-03 09:08:14, End Time: 2012-05-03 10:05:34 To: 505, Order: 156059, Start Time: 2012-05-03 07:44:57, End Time: 2012-05-03 08:42:31 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (65 on baseline) Performance Improvements: 1 (24 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 891 (799 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -3.30% (3.8901 => 3.7617, std. dev.: 0.0493) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.31% (2.0176 => 2.2862, std. dev.: 0.0137) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.41% (0.2721 => 0.2841, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.99% (0.3130 => 0.3255, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.98% (3.9660 => 4.1237, std. dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.30% (0.5265 => 0.5439, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.21% (1.4563 => 1.5030, std. dev.: 0.0034) MultiSource/Applications/SPASS/SPASS: 3.16% (13.8202 => 14.2572, std. dev.: 0.0049) MultiSource/Benchmarks/nbench/nbench: 2.99% (1.0594 => 1.0911, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.93% (0.6959 => 0.7163, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.87% (1.2193 => 1.2543, std. dev.: 0.0014) MultiSource/Applications/kimwitu++/kc: 2.84% (16.6129 => 17.0843, std. dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.77% (0.5637 => 0.5793, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.73% (1.1364 => 1.1674, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 2.66% (0.8310 => 0.8531, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.59% (0.9199 => 0.9437, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: 2.57% (0.7506 => 0.7699, std. dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.46% (0.4791 => 0.4909, std. dev.: 0.0037) MultiSource/Benchmarks/MallocBench/gs/gs: 2.41% (3.8646 => 3.9577, std. dev.: 0.0038) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.36% (13.2842 => 13.5975, std. dev.: 0.0251) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.31% (0.5577 => 0.5706, std. dev.: 0.0017) MultiSource/Applications/hbd/hbd: 2.15% (1.3693 => 1.3988, std. dev.: 0.0068) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.13% (0.7710 => 0.7874, std. dev.: 0.0035) MultiSource/Applications/Burg/burg: 2.08% (1.1061 => 1.1291, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.05% (3.6692 => 3.7444, std. dev.: 0.0047) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.05% (1.1333 => 1.1565, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.01% (0.7460 => 0.7610, std. dev.: 0.0014) MultiSource/Applications/siod/siod: 2.01% (2.1791 => 2.2229, std. dev.: 0.0035) MultiSource/Applications/lambda-0_1_3/lambda: 2.00% (0.7038 => 0.7179, std. dev.: 0.0022) MultiSource/Applications/minisat/minisat: 2.00% (0.6744 => 0.6879, std. dev.: 0.0048) MultiSource/Applications/treecc/treecc: 2.00% (1.9270 => 1.9655, std. dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.94% (1.3245 => 1.3502, std. dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 1.86% (1.2749 => 1.2986, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.83% (0.6283 => 0.6398, std. dev.: 0.0031) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.80% (1.3813 => 1.4062, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.77% (1.3819 => 1.4064, std. dev.: 0.0030) SingleSource/UnitTests/ObjC++/property-reference: 1.73% (0.7061 => 0.7183, std. dev.: 0.0031) MultiSource/Applications/hexxagon/hexxagon: 1.70% (1.2292 => 1.2501, std. dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 1.60% (14.8535 => 15.0905, std. dev.: 0.0080) MultiSource/Applications/ClamAV/clamscan: 1.58% (14.5298 => 14.7592, std. dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.57% (2.1007 => 2.1337, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 1.55% (6.5754 => 6.6770, std. dev.: 0.0118) MultiSource/Applications/d/make_dparser: 1.49% (3.1889 => 3.2364, std. dev.: 0.0017) MultiSource/Applications/sqlite3/sqlite3: 1.43% (16.2614 => 16.4933, std. dev.: 0.0193) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.39% (1.9828 => 2.0103, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.37% (7.2180 => 7.3171, std. dev.: 0.0077) MultiSource/Applications/oggenc/oggenc: 1.26% (4.6629 => 4.7215, std. dev.: 0.0146) MultiSource/Benchmarks/Bullet/bullet: 1.25% (33.2944 => 33.7092, std. dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.24% (3.2742 => 3.3147, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.19% (1.5188 => 1.5369, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.16% (4.3801 => 4.4308, std. dev.: 0.0028) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.02% (4.4433 => 4.4884, std. dev.: 0.0019) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 23.79% (1.8175 => 2.2499, std. dev.: 0.0599) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6754, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: 3.70% (7.4271 => 7.7022, std. dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.69% (1.7688 => 1.8341, std. dev.: 0.0056) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 3.27% (0.9692 => 1.0009, std. dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 3.01% (12.0921 => 12.4557, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.75% (8.8259 => 9.0683, std. dev.: 0.0127) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.59% (7.9275 => 8.1330, std. dev.: 0.0069) SingleSource/Benchmarks/Misc/ffbench: 2.22% (0.8273 => 0.8457, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.28% (2.0200 => 2.0459, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0034) MultiSource/Benchmarks/sim/sim: 1.06% (5.0168 => 5.0701, std. dev.: 0.0102) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.29% (0.2670 => 0.2502, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.81% (0.3511 => 0.3307, std. dev.: 0.0047) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.46% (0.8818 => 0.8689, std. dev.: 0.0009) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/richards_benchmark: -12.58% (1.1560 => 1.0106, std. dev.: 0.0049) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.12% (1.0460 => 0.9401, std. dev.: 0.0013) SingleSource/Benchmarks/McGill/chomp: -9.67% (1.2308 => 1.1118, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.56% (0.3139 => 0.2933, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9473, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.59% (1.3780 => 1.3147, std. dev.: 0.0050) MultiSource/Benchmarks/FreeBench/neural/neural: -4.33% (0.2333 => 0.2232, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.61% (0.3458 => 0.3333, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.59% (1.9762 => 1.9052, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout/lists: -2.16% (6.3560 => 6.2186, std. dev.: 0.0107) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.99% (6.6320 => 6.5001, std. dev.: 0.0034) MultiSource/Applications/minisat/minisat: -1.86% (9.3358 => 9.1617, std. dev.: 0.0195) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3446, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.67% (7.1097 => 6.9911, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/heapsort: -1.57% (3.9173 => 3.8559, std. dev.: 0.0077) MultiSource/Benchmarks/Bullet/bullet: -1.51% (7.3305 => 7.2198, std. dev.: 0.0056) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.33% (20.3410 => 20.0697, std. dev.: 0.0269) MultiSource/Applications/spiff/spiff: -1.20% (3.0263 => 2.9901, std. dev.: 0.0020) MultiSource/Applications/lua/lua: -1.19% (26.5159 => 26.2016, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.04% (3.8887 => 3.8482, std. dev.: 0.0081) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.84s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu May 3 08:25:03 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 3 May 2012 10:25:03 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120503152503.8DD1B2A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/507?compare_to=506&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 507, Order: 156063, Start Time: 2012-05-03 14:28:18, End Time: 2012-05-03 15:25:36 To: 506, Order: 156062, Start Time: 2012-05-03 09:08:14, End Time: 2012-05-03 10:05:34 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (66 on baseline) Performance Improvements: 0 (23 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (799 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.17% (2.0176 => 2.2834, std. dev.: 0.0129) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.52% (0.2721 => 0.2844, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.03% (0.3130 => 0.3256, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.83% (3.9660 => 4.1178, std. dev.: 0.0068) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.23% (1.4563 => 1.5033, std. dev.: 0.0030) MultiSource/Applications/SPASS/SPASS: 3.21% (13.8202 => 14.2642, std. dev.: 0.0089) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.21% (0.5265 => 0.5434, std. dev.: 0.0018) MultiSource/Benchmarks/nbench/nbench: 2.96% (1.0594 => 1.0908, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.85% (1.2193 => 1.2540, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.85% (0.6959 => 0.7157, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.75% (0.5637 => 0.5792, std. dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 2.74% (16.6129 => 17.0682, std. dev.: 0.0190) MultiSource/Benchmarks/Prolangs-C/football/football: 2.71% (0.8310 => 0.8535, std. dev.: 0.0017) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.68% (1.1364 => 1.1669, std. dev.: 0.0012) MultiSource/Applications/spiff/spiff: 2.68% (0.7506 => 0.7707, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.51% (0.9199 => 0.9430, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.46% (0.4791 => 0.4909, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.45% (0.7710 => 0.7899, std. dev.: 0.0020) MultiSource/Benchmarks/MallocBench/gs/gs: 2.41% (3.8646 => 3.9577, std. dev.: 0.0065) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.37% (13.2842 => 13.5985, std. dev.: 0.0116) MultiSource/Applications/hbd/hbd: 2.22% (1.3693 => 1.3997, std. dev.: 0.0027) MultiSource/Applications/Burg/burg: 2.21% (1.1061 => 1.1305, std. dev.: 0.0031) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.18% (0.7460 => 0.7623, std. dev.: 0.0009) MultiSource/Applications/treecc/treecc: 2.16% (1.9270 => 1.9687, std. dev.: 0.0009) MultiSource/Applications/siod/siod: 2.15% (2.1791 => 2.2260, std. dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.08% (1.1333 => 1.1569, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.04% (0.5577 => 0.5691, std. dev.: 0.0019) MultiSource/Applications/lambda-0_1_3/lambda: 1.96% (0.7038 => 0.7176, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.95% (1.3245 => 1.3503, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.91% (3.6692 => 3.7393, std. dev.: 0.0111) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.87% (1.3819 => 1.4078, std. dev.: 0.0022) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.85% (1.3813 => 1.4069, std. dev.: 0.0011) MultiSource/Applications/SIBsim4/SIBsim4: 1.84% (1.2749 => 1.2984, std. dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 1.80% (1.2292 => 1.2513, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.72% (0.6283 => 0.6391, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: 1.69% (0.6744 => 0.6858, std. dev.: 0.0032) SingleSource/UnitTests/ObjC++/property-reference: 1.69% (0.7061 => 0.7180, std. dev.: 0.0024) MultiSource/Applications/JM/lencod/lencod: 1.61% (14.8535 => 15.0920, std. dev.: 0.0083) MultiSource/Applications/JM/ldecod/ldecod: 1.58% (6.5754 => 6.6793, std. dev.: 0.0166) MultiSource/Applications/ClamAV/clamscan: 1.54% (14.5298 => 14.7540, std. dev.: 0.0069) MultiSource/Applications/d/make_dparser: 1.54% (3.1889 => 3.2381, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.51% (2.1007 => 2.1324, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.42% (1.9828 => 2.0110, std. dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: 1.41% (16.2614 => 16.4913, std. dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.31% (7.2180 => 7.3127, std. dev.: 0.0049) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.23% (4.3801 => 4.4339, std. dev.: 0.0085) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.22% (3.2742 => 3.3143, std. dev.: 0.0011) MultiSource/Benchmarks/Bullet/bullet: 1.19% (33.2944 => 33.6919, std. dev.: 0.0200) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.18% (0.8698 => 0.8801, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.15% (1.5188 => 1.5363, std. dev.: 0.0011) MultiSource/Applications/oggenc/oggenc: 1.15% (4.6629 => 4.7165, std. dev.: 0.0130) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.09% (4.4433 => 4.4918, std. dev.: 0.0015) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.10% (1.8175 => 2.2555, std. dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6755, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8146, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.72% (1.7688 => 1.8346, std. dev.: 0.0169) SingleSource/Benchmarks/Misc/salsa20: 3.65% (7.4271 => 7.6979, std. dev.: 0.0054) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 3.27% (0.9692 => 1.0009, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4545, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.54% (8.8259 => 9.0501, std. dev.: 0.0061) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.33% (7.9275 => 8.1120, std. dev.: 0.0060) SingleSource/Benchmarks/Misc/ffbench: 2.19% (0.8273 => 0.8454, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 1.41% (5.0168 => 5.0874, std. dev.: 0.0065) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.28% (2.0200 => 2.0458, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0034) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.33% (0.2670 => 0.2501, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.72% (0.3511 => 0.3310, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.56% (0.8818 => 0.8680, std. dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/richards_benchmark: -12.13% (1.1560 => 1.0158, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.11% (1.0460 => 0.9402, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -9.79% (1.2308 => 1.1103, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.59% (0.3139 => 0.2932, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9472, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.54% (1.3780 => 1.3154, std. dev.: 0.0072) MultiSource/Benchmarks/FreeBench/neural/neural: -4.33% (0.2333 => 0.2232, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.69% (1.9762 => 1.9033, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/lists: -2.12% (6.3560 => 6.2211, std. dev.: 0.0100) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -2.00% (6.6320 => 6.4996, std. dev.: 0.0065) MultiSource/Applications/minisat/minisat: -1.85% (9.3358 => 9.1630, std. dev.: 0.0280) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.66% (7.1097 => 6.9916, std. dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: -1.49% (7.3305 => 7.2211, std. dev.: 0.0097) SingleSource/Benchmarks/Shootout/heapsort: -1.49% (3.9173 => 3.8589, std. dev.: 0.0064) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.44% (20.3410 => 20.0480, std. dev.: 0.0610) MultiSource/Applications/lua/lua: -1.29% (26.5159 => 26.1741, std. dev.: 0.0076) MultiSource/Applications/spiff/spiff: -1.14% (3.0263 => 2.9918, std. dev.: 0.0020) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.52s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu May 3 09:55:20 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 3 May 2012 11:55:20 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120503165520.279B12A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/508?compare_to=507&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 508, Order: 156067, Start Time: 2012-05-03 15:58:30, End Time: 2012-05-03 16:55:53 To: 507, Order: 156063, Start Time: 2012-05-03 14:28:18, End Time: 2012-05-03 15:25:36 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (64 on baseline) Performance Improvements: 0 (24 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (800 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.22% (2.0176 => 2.2843, std. dev.: 0.0057) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.41% (0.2721 => 0.2841, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.90% (0.3130 => 0.3252, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.86% (3.9660 => 4.1189, std. dev.: 0.0123) MultiSource/Applications/SPASS/SPASS: 3.23% (13.8202 => 14.2672, std. dev.: 0.0101) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.23% (0.5265 => 0.5435, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.16% (1.4563 => 1.5023, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.02% (0.6959 => 0.7169, std. dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 2.93% (1.0594 => 1.0904, std. dev.: 0.0011) MultiSource/Applications/spiff/spiff: 2.89% (0.7506 => 0.7723, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.80% (1.2193 => 1.2534, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.79% (1.1364 => 1.1681, std. dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: 2.79% (16.6129 => 17.0761, std. dev.: 0.0220) MultiSource/Benchmarks/Prolangs-C/football/football: 2.78% (0.8310 => 0.8541, std. dev.: 0.0030) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.72% (0.7710 => 0.7920, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.47% (0.9199 => 0.9426, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.43% (0.5637 => 0.5774, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.36% (1.3819 => 1.4145, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.34% (13.2842 => 13.5952, std. dev.: 0.0028) MultiSource/Applications/treecc/treecc: 2.10% (1.9270 => 1.9675, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: 2.09% (3.8646 => 3.9455, std. dev.: 0.0051) MultiSource/Applications/siod/siod: 2.09% (2.1791 => 2.2247, std. dev.: 0.0016) MultiSource/Applications/hbd/hbd: 2.09% (1.3693 => 1.3979, std. dev.: 0.0072) MultiSource/Applications/Burg/burg: 2.07% (1.1061 => 1.1290, std. dev.: 0.0067) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.02% (0.7460 => 0.7611, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.02% (1.1333 => 1.1562, std. dev.: 0.0058) MultiSource/Applications/SIBsim4/SIBsim4: 1.94% (1.2749 => 1.2996, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.94% (0.5577 => 0.5685, std. dev.: 0.0021) MultiSource/Applications/lambda-0_1_3/lambda: 1.92% (0.7038 => 0.7173, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.91% (3.6692 => 3.7392, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.90% (1.3245 => 1.3496, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.88% (1.3813 => 1.4072, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.83% (0.6283 => 0.6398, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 1.73% (1.2292 => 1.2505, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 1.73% (0.7061 => 0.7183, std. dev.: 0.0022) MultiSource/Applications/minisat/minisat: 1.65% (0.6744 => 0.6855, std. dev.: 0.0017) MultiSource/Applications/JM/lencod/lencod: 1.61% (14.8535 => 15.0930, std. dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.59% (2.1007 => 2.1342, std. dev.: 0.0010) MultiSource/Applications/JM/ldecod/ldecod: 1.54% (6.5754 => 6.6766, std. dev.: 0.0033) MultiSource/Applications/sqlite3/sqlite3: 1.42% (16.2614 => 16.4928, std. dev.: 0.0020) MultiSource/Applications/d/make_dparser: 1.41% (3.1889 => 3.2340, std. dev.: 0.0015) MultiSource/Applications/ClamAV/clamscan: 1.41% (14.5298 => 14.7343, std. dev.: 0.0214) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.32% (3.2742 => 3.3173, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.28% (7.2180 => 7.3107, std. dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.19% (1.5188 => 1.5369, std. dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 1.15% (33.2944 => 33.6762, std. dev.: 0.0208) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.10% (4.3801 => 4.4285, std. dev.: 0.0121) MultiSource/Applications/oggenc/oggenc: 1.09% (4.6629 => 4.7139, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.03% (4.4433 => 4.4889, std. dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: 1.02% (8.4961 => 8.5827, std. dev.: 0.0083) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 23.48% (1.8175 => 2.2443, std. dev.: 0.0571) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7298, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6755, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.67% (1.7688 => 1.8337, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: 3.58% (7.4271 => 7.6931, std. dev.: 0.0034) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 3.24% (0.9692 => 1.0006, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 3.05% (8.8259 => 9.0953, std. dev.: 0.0136) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4545, std. dev.: 0.0033) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.55% (7.9275 => 8.1299, std. dev.: 0.0044) SingleSource/Benchmarks/Misc/ffbench: 2.21% (0.8273 => 0.8456, std. dev.: 0.0001) MultiSource/Benchmarks/sim/sim: 1.37% (5.0168 => 5.0855, std. dev.: 0.0077) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.27% (2.0200 => 2.0456, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.33% (0.2670 => 0.2501, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.81% (0.3511 => 0.3307, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.51% (0.8818 => 0.8685, std. dev.: 0.0018) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/richards_benchmark: -12.12% (1.1560 => 1.0159, std. dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.13% (1.0460 => 0.9400, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -9.85% (1.2308 => 1.1096, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.50% (0.3139 => 0.2935, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.15% (1.3780 => 1.3071, std. dev.: 0.0103) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9473, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.33% (0.2333 => 0.2232, std. dev.: 0.0016) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.65% (1.9762 => 1.9040, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout/lists: -2.16% (6.3560 => 6.2189, std. dev.: 0.0068) MultiSource/Applications/minisat/minisat: -2.06% (9.3358 => 9.1435, std. dev.: 0.0057) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.88% (6.6320 => 6.5071, std. dev.: 0.0037) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.76% (20.3410 => 19.9829, std. dev.: 0.0917) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.67% (7.1097 => 6.9912, std. dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -1.52% (7.3305 => 7.2188, std. dev.: 0.0061) SingleSource/Benchmarks/Shootout/heapsort: -1.45% (3.9173 => 3.8606, std. dev.: 0.0038) MultiSource/Applications/lua/lua: -1.31% (26.5159 => 26.1693, std. dev.: 0.0191) MultiSource/Applications/spiff/spiff: -1.20% (3.0263 => 2.9900, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.08% (3.8887 => 3.8468, std. dev.: 0.0093) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.61s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu May 3 11:18:10 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 3 May 2012 13:18:10 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120503181810.52BFE2A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/509?compare_to=508&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 509, Order: 156078, Start Time: 2012-05-03 17:21:31, End Time: 2012-05-03 18:18:43 To: 508, Order: 156067, Start Time: 2012-05-03 15:58:30, End Time: 2012-05-03 16:55:53 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (58 on baseline) Performance Improvements: 0 (24 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (806 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.72% (2.0176 => 2.2743, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.41% (0.2721 => 0.2841, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.71% (0.3130 => 0.3246, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.60% (3.9660 => 4.1088, std. dev.: 0.0092) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.13% (0.5265 => 0.5430, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.97% (1.4563 => 1.4995, std. dev.: 0.0020) MultiSource/Applications/SPASS/SPASS: 2.89% (13.8202 => 14.2196, std. dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.78% (1.2193 => 1.2532, std. dev.: 0.0017) MultiSource/Benchmarks/nbench/nbench: 2.78% (1.0594 => 1.0888, std. dev.: 0.0029) MultiSource/Applications/kimwitu++/kc: 2.68% (16.6129 => 17.0585, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.63% (0.6959 => 0.7142, std. dev.: 0.0016) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.60% (1.1364 => 1.1659, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/football/football: 2.59% (0.8310 => 0.8525, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.40% (0.9199 => 0.9420, std. dev.: 0.0016) MultiSource/Applications/spiff/spiff: 2.37% (0.7506 => 0.7684, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.31% (0.5637 => 0.5767, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.30% (13.2842 => 13.5897, std. dev.: 0.0065) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.17% (0.4791 => 0.4895, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 2.08% (3.8646 => 3.9450, std. dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.90% (0.5577 => 0.5683, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.87% (1.1333 => 1.1545, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.87% (0.7710 => 0.7854, std. dev.: 0.0021) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.85% (0.7460 => 0.7598, std. dev.: 0.0037) MultiSource/Applications/hbd/hbd: 1.85% (1.3693 => 1.3946, std. dev.: 0.0034) MultiSource/Applications/SIBsim4/SIBsim4: 1.81% (1.2749 => 1.2980, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.80% (3.6692 => 3.7351, std. dev.: 0.0006) MultiSource/Applications/siod/siod: 1.77% (2.1791 => 2.2177, std. dev.: 0.0030) MultiSource/Applications/treecc/treecc: 1.76% (1.9270 => 1.9610, std. dev.: 0.0013) MultiSource/Applications/Burg/burg: 1.74% (1.1061 => 1.1254, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.74% (1.3245 => 1.3476, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.74% (1.3813 => 1.4053, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.61% (1.3819 => 1.4041, std. dev.: 0.0021) MultiSource/Applications/JM/lencod/lencod: 1.56% (14.8535 => 15.0851, std. dev.: 0.0027) MultiSource/Applications/JM/ldecod/ldecod: 1.52% (6.5754 => 6.6755, std. dev.: 0.0027) SingleSource/UnitTests/ObjC++/property-reference: 1.43% (0.7061 => 0.7162, std. dev.: 0.0030) MultiSource/Applications/hexxagon/hexxagon: 1.39% (1.2292 => 1.2463, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 1.22% (16.2614 => 16.4604, std. dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.19% (2.1007 => 2.1258, std. dev.: 0.0096) MultiSource/Applications/ClamAV/clamscan: 1.19% (14.5298 => 14.7030, std. dev.: 0.0129) MultiSource/Applications/d/make_dparser: 1.19% (3.1889 => 3.2268, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.15% (3.2742 => 3.3117, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.12% (7.2180 => 7.2990, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.10% (4.3801 => 4.4283, std. dev.: 0.0061) MultiSource/Benchmarks/Bullet/bullet: 1.04% (33.2944 => 33.6411, std. dev.: 0.0136) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 23.35% (1.8175 => 2.2419, std. dev.: 0.0246) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.87% (1.5824 => 1.6753, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 3.66% (7.4271 => 7.6989, std. dev.: 0.0030) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.60% (1.7688 => 1.8324, std. dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 3.29% (0.9692 => 1.0011, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 2.98% (12.0921 => 12.4519, std. dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.80% (8.8259 => 9.0734, std. dev.: 0.0092) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.60% (7.9275 => 8.1340, std. dev.: 0.0096) SingleSource/Benchmarks/Misc/ffbench: 2.24% (0.8273 => 0.8458, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.29% (2.0200 => 2.0461, std. dev.: 0.0008) MultiSource/Benchmarks/sim/sim: 1.26% (5.0168 => 5.0801, std. dev.: 0.0062) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2139, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -14.60% (0.4657 => 0.3977, std. dev.: 0.0083) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.37% (0.2670 => 0.2500, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.18% (0.3511 => 0.3294, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.33% (0.8818 => 0.8701, std. dev.: 0.0024) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/richards_benchmark: -12.54% (1.1560 => 1.0110, std. dev.: 0.0050) SingleSource/Benchmarks/McGill/chomp: -10.68% (1.2308 => 1.0993, std. dev.: 0.0062) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.12% (1.0460 => 0.9401, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.50% (0.3139 => 0.2935, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.88% (1.3780 => 1.3107, std. dev.: 0.0059) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9474, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.33% (0.2333 => 0.2232, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.73% (0.3458 => 0.3329, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -3.70% (1.9762 => 1.9031, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout/lists: -2.30% (6.3560 => 6.2100, std. dev.: 0.0145) MultiSource/Applications/minisat/minisat: -2.05% (9.3358 => 9.1442, std. dev.: 0.0193) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.90% (6.6320 => 6.5057, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3446, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.67% (7.1097 => 6.9910, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/heapsort: -1.52% (3.9173 => 3.8578, std. dev.: 0.0049) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.51% (20.3410 => 20.0329, std. dev.: 0.0874) MultiSource/Benchmarks/Bullet/bullet: -1.50% (7.3305 => 7.2208, std. dev.: 0.0086) MultiSource/Applications/spiff/spiff: -1.15% (3.0263 => 2.9916, std. dev.: 0.0015) MultiSource/Applications/lua/lua: -1.11% (26.5159 => 26.2216, std. dev.: 0.0102) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.65s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu May 3 12:41:20 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 3 May 2012 14:41:20 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120503194120.366152A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/510?compare_to=509&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 510, Order: 156083, Start Time: 2012-05-03 18:44:29, End Time: 2012-05-03 19:41:53 To: 509, Order: 156078, Start Time: 2012-05-03 17:21:31, End Time: 2012-05-03 18:18:43 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (65 on baseline) Performance Improvements: 0 (23 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (800 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.18% (2.0176 => 2.2836, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.34% (0.2721 => 0.2839, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.03% (0.3130 => 0.3256, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.83% (3.9660 => 4.1178, std. dev.: 0.0033) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.32% (1.4563 => 1.5047, std. dev.: 0.0025) MultiSource/Applications/SPASS/SPASS: 3.21% (13.8202 => 14.2642, std. dev.: 0.0109) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.17% (0.5265 => 0.5432, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.06% (0.6959 => 0.7172, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 3.00% (1.0594 => 1.0912, std. dev.: 0.0020) MultiSource/Applications/kimwitu++/kc: 2.99% (16.6129 => 17.1092, std. dev.: 0.0161) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.77% (1.2193 => 1.2531, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/football/football: 2.62% (0.8310 => 0.8528, std. dev.: 0.0007) MultiSource/Applications/spiff/spiff: 2.60% (0.7506 => 0.7701, std. dev.: 0.0022) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.60% (1.1364 => 1.1659, std. dev.: 0.0017) MultiSource/Applications/hbd/hbd: 2.59% (1.3693 => 1.4048, std. dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.51% (0.9199 => 0.9430, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.47% (13.2842 => 13.6127, std. dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.45% (0.5637 => 0.5775, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.40% (0.4791 => 0.4906, std. dev.: 0.0016) MultiSource/Applications/lambda-0_1_3/lambda: 2.29% (0.7038 => 0.7199, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.26% (0.5577 => 0.5703, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/gs/gs: 2.24% (3.8646 => 3.9510, std. dev.: 0.0031) MultiSource/Applications/Burg/burg: 2.12% (1.1061 => 1.1296, std. dev.: 0.0032) MultiSource/Applications/siod/siod: 2.07% (2.1791 => 2.2241, std. dev.: 0.0015) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.02% (0.7710 => 0.7866, std. dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.02% (1.1333 => 1.1562, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.97% (1.3245 => 1.3506, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.93% (0.7460 => 0.7604, std. dev.: 0.0007) MultiSource/Applications/treecc/treecc: 1.92% (1.9270 => 1.9640, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.90% (1.3813 => 1.4076, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 1.88% (1.2292 => 1.2523, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.86% (3.6692 => 3.7375, std. dev.: 0.0069) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.85% (1.3819 => 1.4074, std. dev.: 0.0007) MultiSource/Applications/SIBsim4/SIBsim4: 1.80% (1.2749 => 1.2978, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.78% (0.6283 => 0.6395, std. dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: 1.76% (6.5754 => 6.6912, std. dev.: 0.0054) MultiSource/Applications/minisat/minisat: 1.69% (0.6744 => 0.6858, std. dev.: 0.0019) MultiSource/Benchmarks/Bullet/bullet: 1.69% (33.2944 => 33.8565, std. dev.: 0.0142) SingleSource/UnitTests/ObjC++/property-reference: 1.69% (0.7061 => 0.7180, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.65% (1.9828 => 2.0156, std. dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.65% (2.1007 => 2.1354, std. dev.: 0.0073) MultiSource/Applications/JM/lencod/lencod: 1.59% (14.8535 => 15.0893, std. dev.: 0.0019) MultiSource/Applications/d/make_dparser: 1.38% (3.1889 => 3.2330, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.36% (7.2180 => 7.3160, std. dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.31% (1.5188 => 1.5387, std. dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 1.29% (14.5298 => 14.7177, std. dev.: 0.0182) MultiSource/Applications/sqlite3/sqlite3: 1.29% (16.2614 => 16.4712, std. dev.: 0.0060) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.29% (4.9865 => 5.0508, std. dev.: 0.0065) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.26% (0.8698 => 0.8808, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.19% (3.2742 => 3.3131, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.01% (4.3801 => 4.4245, std. dev.: 0.0142) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.29% (1.8175 => 2.2590, std. dev.: 0.0218) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6755, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8147, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 3.65% (7.4271 => 7.6979, std. dev.: 0.0077) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.63% (1.7688 => 1.8330, std. dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 3.29% (0.9692 => 1.0011, std. dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4545, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.90% (8.8259 => 9.0815, std. dev.: 0.0062) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.38% (7.9275 => 8.1165, std. dev.: 0.0104) SingleSource/Benchmarks/Misc/ffbench: 2.19% (0.8273 => 0.8454, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.30% (2.0200 => 2.0463, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0005) MultiSource/Benchmarks/sim/sim: 1.01% (5.0168 => 5.0674, std. dev.: 0.0129) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.37% (0.2670 => 0.2500, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.01% (0.3511 => 0.3300, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.62% (0.8818 => 0.8675, std. dev.: 0.0026) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/richards_benchmark: -12.79% (1.1560 => 1.0081, std. dev.: 0.0017) SingleSource/Benchmarks/McGill/chomp: -10.60% (1.2308 => 1.1003, std. dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.12% (1.0460 => 0.9401, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.59% (0.3139 => 0.2932, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9472, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.35% (1.3780 => 1.3181, std. dev.: 0.0021) MultiSource/Benchmarks/FreeBench/neural/neural: -4.33% (0.2333 => 0.2232, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -3.64% (1.9762 => 1.9043, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -2.40% (6.3560 => 6.2032, std. dev.: 0.0057) MultiSource/Applications/minisat/minisat: -2.04% (9.3358 => 9.1451, std. dev.: 0.0365) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.99% (6.6320 => 6.4999, std. dev.: 0.0039) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.66% (7.1097 => 6.9915, std. dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -1.56% (7.3305 => 7.2164, std. dev.: 0.0087) MultiSource/Applications/lua/lua: -1.42% (26.5159 => 26.1401, std. dev.: 0.0485) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.32% (20.3410 => 20.0730, std. dev.: 0.0384) SingleSource/Benchmarks/Shootout/heapsort: -1.26% (3.9173 => 3.8680, std. dev.: 0.0013) MultiSource/Applications/spiff/spiff: -1.21% (3.0263 => 2.9897, std. dev.: 0.0018) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.80s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu May 3 14:04:39 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 3 May 2012 16:04:39 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120503210439.CC2BF2A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/511?compare_to=510&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 511, Order: 156090, Start Time: 2012-05-03 20:07:59, End Time: 2012-05-03 21:05:12 To: 510, Order: 156083, Start Time: 2012-05-03 18:44:29, End Time: 2012-05-03 19:41:53 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (53 on baseline) Performance Improvements: 2 (24 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 890 (811 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: -1.02% (2.0156 => 1.9950, std. dev.: 0.0016) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.01% (5.0508 => 4.9996, std. dev.: 0.0016) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.97% (2.0176 => 2.2793, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.37% (0.2721 => 0.2840, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.64% (0.3130 => 0.3244, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.28% (3.9660 => 4.0962, std. dev.: 0.0038) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.84% (1.4563 => 1.4977, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.77% (0.5265 => 0.5411, std. dev.: 0.0044) MultiSource/Applications/SPASS/SPASS: 2.70% (13.8202 => 14.1933, std. dev.: 0.0076) MultiSource/Benchmarks/nbench/nbench: 2.60% (1.0594 => 1.0869, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.40% (1.2193 => 1.2486, std. dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.40% (0.6959 => 0.7126, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: 2.36% (0.7506 => 0.7683, std. dev.: 0.0021) MultiSource/Applications/kimwitu++/kc: 2.26% (16.6129 => 16.9889, std. dev.: 0.0151) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.17% (1.1364 => 1.1611, std. dev.: 0.0073) SingleSource/UnitTests/ObjC++/property-reference-object: 2.15% (0.5818 => 0.5943, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 2.08% (0.7061 => 0.7208, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.03% (0.9199 => 0.9386, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.97% (0.5637 => 0.5748, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 1.90% (0.5748 => 0.5857, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.81% (13.2842 => 13.5248, std. dev.: 0.0023) MultiSource/Benchmarks/MallocBench/gs/gs: 1.71% (3.8646 => 3.9306, std. dev.: 0.0020) MultiSource/Applications/lambda-0_1_3/lambda: 1.69% (0.7038 => 0.7157, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 1.69% (1.3693 => 1.3924, std. dev.: 0.0066) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.67% (1.3819 => 1.4050, std. dev.: 0.0041) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.67% (1.3813 => 1.4043, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.62% (0.7460 => 0.7581, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 1.62% (1.1061 => 1.1240, std. dev.: 0.0016) MultiSource/Applications/siod/siod: 1.58% (2.1791 => 2.2135, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.49% (1.3245 => 1.3443, std. dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.48% (1.1333 => 1.1501, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.48% (0.7710 => 0.7824, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.46% (3.6692 => 3.7227, std. dev.: 0.0018) MultiSource/Applications/treecc/treecc: 1.42% (1.9270 => 1.9543, std. dev.: 0.0008) MultiSource/Applications/SIBsim4/SIBsim4: 1.34% (1.2749 => 1.2920, std. dev.: 0.0019) MultiSource/Applications/JM/lencod/lencod: 1.33% (14.8535 => 15.0508, std. dev.: 0.0026) MultiSource/Benchmarks/Bullet/bullet: 1.21% (33.2944 => 33.6962, std. dev.: 0.0065) MultiSource/Applications/sqlite3/sqlite3: 1.16% (16.2614 => 16.4496, std. dev.: 0.0018) MultiSource/Applications/JM/ldecod/ldecod: 1.12% (6.5754 => 6.6493, std. dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.08% (2.1007 => 2.1233, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 1.00% (1.2292 => 1.2415, std. dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.14% (1.8175 => 2.2563, std. dev.: 0.0499) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.90% (1.5824 => 1.6757, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 3.59% (7.4271 => 7.6939, std. dev.: 0.0079) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.57% (1.7688 => 1.8319, std. dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 3.33% (8.8259 => 9.1200, std. dev.: 0.0051) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 3.29% (0.9692 => 1.0011, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4540, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.60% (7.9275 => 8.1337, std. dev.: 0.0091) SingleSource/Benchmarks/Misc/ffbench: 2.20% (0.8273 => 0.8455, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.28% (2.0200 => 2.0459, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: 1.13% (5.0168 => 5.0735, std. dev.: 0.0053) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.04% (0.3511 => 0.3299, std. dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.84% (0.2670 => 0.2514, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.54% (0.8818 => 0.8682, std. dev.: 0.0018) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/richards_benchmark: -13.01% (1.1560 => 1.0056, std. dev.: 0.0046) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.12% (1.0460 => 0.9401, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -9.78% (1.2308 => 1.1104, std. dev.: 0.0016) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.50% (0.3139 => 0.2935, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9471, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.73% (1.3780 => 1.3128, std. dev.: 0.0091) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.33% (0.2333 => 0.2232, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.68% (1.9762 => 1.9035, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: -2.13% (9.3358 => 9.1371, std. dev.: 0.0135) SingleSource/Benchmarks/Shootout/lists: -2.04% (6.3560 => 6.2265, std. dev.: 0.0062) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.89% (6.6320 => 6.5065, std. dev.: 0.0040) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.66% (7.1097 => 6.9915, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.64% (20.3410 => 20.0078, std. dev.: 0.1021) MultiSource/Benchmarks/Bullet/bullet: -1.50% (7.3305 => 7.2202, std. dev.: 0.0116) SingleSource/Benchmarks/Shootout/heapsort: -1.34% (3.9173 => 3.8648, std. dev.: 0.0036) MultiSource/Applications/lua/lua: -1.23% (26.5159 => 26.1907, std. dev.: 0.0201) MultiSource/Applications/spiff/spiff: -1.06% (3.0263 => 2.9942, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: -1.01% (11.2619 => 11.1482, std. dev.: 0.0018) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.60s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu May 3 15:27:26 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 3 May 2012 17:27:26 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120503222726.F29AC2A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/512?compare_to=511&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 512, Order: 156097, Start Time: 2012-05-03 21:30:50, End Time: 2012-05-03 22:27:59 To: 511, Order: 156090, Start Time: 2012-05-03 20:07:59, End Time: 2012-05-03 21:05:12 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (49 on baseline) Performance Improvements: 0 (25 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (814 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.94% (2.0176 => 2.2787, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.48% (0.2721 => 0.2843, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.58% (0.3130 => 0.3242, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.38% (3.9660 => 4.0999, std. dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: 2.94% (13.8202 => 14.2264, std. dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.81% (0.5265 => 0.5413, std. dev.: 0.0035) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.72% (1.4563 => 1.4959, std. dev.: 0.0023) MultiSource/Applications/kimwitu++/kc: 2.52% (16.6129 => 17.0313, std. dev.: 0.0107) MultiSource/Benchmarks/nbench/nbench: 2.48% (1.0594 => 1.0857, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.43% (1.2193 => 1.2489, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/football/football: 2.25% (0.8310 => 0.8497, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.15% (1.1364 => 1.1608, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.07% (0.9199 => 0.9389, std. dev.: 0.0056) MultiSource/Applications/spiff/spiff: 2.05% (0.7506 => 0.7660, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.93% (0.5637 => 0.5746, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.89% (13.2842 => 13.5356, std. dev.: 0.0061) SingleSource/UnitTests/ObjC++/property-reference-object: 1.80% (0.5818 => 0.5923, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 1.72% (3.8646 => 3.9312, std. dev.: 0.0019) MultiSource/Applications/siod/siod: 1.71% (2.1791 => 2.2163, std. dev.: 0.0063) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.69% (0.7710 => 0.7840, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference: 1.64% (0.7061 => 0.7177, std. dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.62% (1.1333 => 1.1517, std. dev.: 0.0016) MultiSource/Applications/Burg/burg: 1.54% (1.1061 => 1.1231, std. dev.: 0.0058) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.53% (0.7460 => 0.7574, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.51% (3.6692 => 3.7245, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.49% (1.3813 => 1.4019, std. dev.: 0.0019) MultiSource/Applications/treecc/treecc: 1.48% (1.9270 => 1.9556, std. dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 1.48% (1.2749 => 1.2938, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.47% (1.3819 => 1.4022, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.45% (1.3245 => 1.3437, std. dev.: 0.0013) MultiSource/Applications/hbd/hbd: 1.44% (1.3693 => 1.3890, std. dev.: 0.0061) MultiSource/Applications/JM/lencod/lencod: 1.21% (14.8535 => 15.0325, std. dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.18% (2.1007 => 2.1255, std. dev.: 0.0071) MultiSource/Applications/JM/ldecod/ldecod: 1.18% (6.5754 => 6.6528, std. dev.: 0.0113) MultiSource/Applications/sqlite3/sqlite3: 1.08% (16.2614 => 16.4365, std. dev.: 0.0028) MultiSource/Applications/d/make_dparser: 1.00% (3.1889 => 3.2208, std. dev.: 0.0031) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.49% (1.8175 => 2.2626, std. dev.: 0.0086) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.90% (1.5824 => 1.6757, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 3.74% (7.4271 => 7.7047, std. dev.: 0.0064) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.69% (1.7688 => 1.8341, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 3.29% (0.9692 => 1.0011, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4548, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.65% (8.8259 => 9.0599, std. dev.: 0.0229) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.39% (7.9275 => 8.1173, std. dev.: 0.0116) SingleSource/Benchmarks/Misc/ffbench: 2.25% (0.8273 => 0.8459, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.29% (2.0200 => 2.0461, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -9.92% (0.4657 => 0.4195, std. dev.: 0.0163) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.98% (0.3511 => 0.3301, std. dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.73% (0.2670 => 0.2517, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.61% (0.8818 => 0.8676, std. dev.: 0.0011) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/richards_benchmark: -12.94% (1.1560 => 1.0064, std. dev.: 0.0075) SingleSource/Benchmarks/McGill/chomp: -10.63% (1.2308 => 1.1000, std. dev.: 0.0083) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.12% (1.0460 => 0.9401, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.63% (0.3139 => 0.2931, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9473, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.70% (1.3780 => 1.3132, std. dev.: 0.0030) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.33% (0.2333 => 0.2232, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -3.66% (1.9762 => 1.9038, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/lists: -2.21% (6.3560 => 6.2156, std. dev.: 0.0071) MultiSource/Applications/minisat/minisat: -2.09% (9.3358 => 9.1403, std. dev.: 0.0031) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.81% (6.6320 => 6.5118, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3446, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.66% (7.1097 => 6.9918, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/heapsort: -1.34% (3.9173 => 3.8648, std. dev.: 0.0188) MultiSource/Benchmarks/Bullet/bullet: -1.29% (7.3305 => 7.2362, std. dev.: 0.0101) MultiSource/Applications/spiff/spiff: -1.10% (3.0263 => 2.9931, std. dev.: 0.0012) MultiSource/Applications/lua/lua: -1.04% (26.5159 => 26.2404, std. dev.: 0.0129) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.01% (20.3410 => 20.1346, std. dev.: 0.0346) MultiSource/Benchmarks/nbench/nbench: -1.00% (11.2619 => 11.1491, std. dev.: 0.0040) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.08s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu May 3 16:50:30 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 3 May 2012 18:50:30 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120503235030.CB1F22A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/513?compare_to=512&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 513, Order: 156113, Start Time: 2012-05-03 22:53:43, End Time: 2012-05-03 23:51:04 To: 512, Order: 156097, Start Time: 2012-05-03 21:30:50, End Time: 2012-05-03 22:27:59 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (68 on baseline) Performance Improvements: 0 (23 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 891 (797 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: 1.35% (1.9340 => 1.9602, std. dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.13% (2.0176 => 2.2826, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.78% (0.2721 => 0.2851, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.22% (0.3130 => 0.3262, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.91% (3.9660 => 4.1212, std. dev.: 0.0035) MultiSource/Applications/SPASS/SPASS: 3.31% (13.8202 => 14.2774, std. dev.: 0.0135) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.17% (0.5265 => 0.5432, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.14% (1.4563 => 1.5021, std. dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.13% (0.6959 => 0.7177, std. dev.: 0.0065) MultiSource/Applications/kimwitu++/kc: 3.08% (16.6129 => 17.1254, std. dev.: 0.0086) MultiSource/Benchmarks/nbench/nbench: 3.07% (1.0594 => 1.0919, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.99% (1.2193 => 1.2558, std. dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.67% (0.4791 => 0.4919, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 2.67% (0.8310 => 0.8532, std. dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.66% (0.9199 => 0.9444, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.66% (0.5637 => 0.5787, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.64% (1.1364 => 1.1664, std. dev.: 0.0022) MultiSource/Applications/spiff/spiff: 2.58% (0.7506 => 0.7700, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 2.35% (3.8646 => 3.9554, std. dev.: 0.0038) MultiSource/Applications/lambda-0_1_3/lambda: 2.26% (0.7038 => 0.7197, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.20% (0.7710 => 0.7880, std. dev.: 0.0017) MultiSource/Applications/Burg/burg: 2.13% (1.1061 => 1.1297, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 2.12% (2.1791 => 2.2253, std. dev.: 0.0065) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.12% (1.1333 => 1.1573, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.12% (0.5577 => 0.5695, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.11% (1.3245 => 1.3524, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.09% (13.2842 => 13.5613, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.08% (1.3819 => 1.4107, std. dev.: 0.0058) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.08% (0.7460 => 0.7615, std. dev.: 0.0017) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.06% (1.3813 => 1.4097, std. dev.: 0.0018) MultiSource/Applications/treecc/treecc: 2.05% (1.9270 => 1.9665, std. dev.: 0.0060) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.96% (0.6283 => 0.6406, std. dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: 1.84% (1.2749 => 1.2984, std. dev.: 0.0012) MultiSource/Applications/minisat/minisat: 1.79% (0.6744 => 0.6865, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.75% (3.6692 => 3.7335, std. dev.: 0.0062) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.75% (2.1007 => 2.1375, std. dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: 1.59% (14.8535 => 15.0898, std. dev.: 0.0070) MultiSource/Applications/hexxagon/hexxagon: 1.58% (1.2292 => 1.2486, std. dev.: 0.0011) MultiSource/Applications/JM/ldecod/ldecod: 1.57% (6.5754 => 6.6787, std. dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.53% (3.2742 => 3.3242, std. dev.: 0.0019) SingleSource/UnitTests/ObjC++/property-reference: 1.47% (0.7061 => 0.7165, std. dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.43% (1.5188 => 1.5405, std. dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: 1.43% (16.2614 => 16.4937, std. dev.: 0.0073) MultiSource/Applications/d/make_dparser: 1.39% (3.1889 => 3.2332, std. dev.: 0.0063) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.31% (0.8698 => 0.8812, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.25% (1.9828 => 2.0075, std. dev.: 0.0046) MultiSource/Applications/oggenc/oggenc: 1.24% (4.6629 => 4.7208, std. dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: 1.23% (14.5298 => 14.7080, std. dev.: 0.0175) MultiSource/Benchmarks/Bullet/bullet: 1.17% (33.2944 => 33.6853, std. dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.17% (7.2180 => 7.3027, std. dev.: 0.0028) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.13% (4.3801 => 4.4298, std. dev.: 0.0023) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.03% (4.9865 => 5.0378, std. dev.: 0.0016) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 23.92% (1.8175 => 2.2523, std. dev.: 0.0457) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.90% (1.5824 => 1.6757, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.66% (1.7688 => 1.8336, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/salsa20: 3.61% (7.4271 => 7.6955, std. dev.: 0.0044) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 3.24% (0.9692 => 1.0006, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4544, std. dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.94% (8.8259 => 9.0850, std. dev.: 0.0080) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.43% (7.9275 => 8.1205, std. dev.: 0.0090) SingleSource/Benchmarks/Misc/ffbench: 2.20% (0.8273 => 0.8455, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: 1.40% (5.0168 => 5.0871, std. dev.: 0.0082) MultiSource/Applications/lemon/lemon: 1.31% (1.4298 => 1.4486, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/bisort/bisort: 1.31% (0.8239 => 0.8347, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.24% (2.0200 => 2.0450, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2135, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -12.84% (0.4657 => 0.4059, std. dev.: 0.0101) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.03% (0.2670 => 0.2509, std. dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.61% (0.3511 => 0.3314, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/richards_benchmark: -12.47% (1.1560 => 1.0119, std. dev.: 0.0056) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.11% (1.0460 => 0.9402, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -9.90% (1.2308 => 1.1090, std. dev.: 0.0013) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.53% (0.3139 => 0.2934, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.94% (1.3780 => 1.3099, std. dev.: 0.0068) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9473, std. dev.: 0.0004) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.33% (0.2333 => 0.2232, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.67% (0.3458 => 0.3331, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -3.62% (1.9762 => 1.9047, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/lists: -2.16% (6.3560 => 6.2189, std. dev.: 0.0175) MultiSource/Applications/minisat/minisat: -2.07% (9.3358 => 9.1427, std. dev.: 0.0091) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -2.00% (6.6320 => 6.4995, std. dev.: 0.0042) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3446, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.67% (7.1097 => 6.9912, std. dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: -1.54% (7.3305 => 7.2178, std. dev.: 0.0253) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.49% (20.3410 => 20.0377, std. dev.: 0.0434) SingleSource/Benchmarks/Shootout/heapsort: -1.35% (3.9173 => 3.8643, std. dev.: 0.0019) MultiSource/Applications/lua/lua: -1.26% (26.5159 => 26.1823, std. dev.: 0.0071) MultiSource/Applications/spiff/spiff: -1.23% (3.0263 => 2.9891, std. dev.: 0.0024) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.54s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu May 3 18:13:27 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 3 May 2012 20:13:27 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120504011327.91DC72A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/514?compare_to=513&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 514, Order: 156132, Start Time: 2012-05-04 00:16:46, End Time: 2012-05-04 01:14:00 To: 513, Order: 156113, Start Time: 2012-05-03 22:53:43, End Time: 2012-05-03 23:51:04 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (48 on baseline) Performance Improvements: 6 (36 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 886 (804 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -7.44% (0.4059 => 0.3757, std. dev.: 0.0056) SingleSource/UnitTests/ObjC++/property-reference-object: -2.06% (0.5886 => 0.5765, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: -1.93% (0.5802 => 0.5690, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: -1.76% (0.7165 => 0.7039, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.24% (2.0075 => 1.9827, std. dev.: 0.0033) MultiSource/Applications/kimwitu++/kc: -1.06% (17.1254 => 16.9432, std. dev.: 0.0018) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.05% (2.0176 => 2.2808, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.86% (0.2721 => 0.2826, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.30% (3.9660 => 4.0967, std. dev.: 0.0089) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.23% (0.3130 => 0.3231, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.96% (0.6959 => 0.7165, std. dev.: 0.0057) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.85% (1.4563 => 1.4978, std. dev.: 0.0018) MultiSource/Applications/SPASS/SPASS: 2.79% (13.8202 => 14.2055, std. dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.70% (0.5265 => 0.5407, std. dev.: 0.0037) MultiSource/Benchmarks/nbench/nbench: 2.37% (1.0594 => 1.0845, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.31% (1.2193 => 1.2475, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: 2.23% (0.8310 => 0.8495, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.16% (0.9199 => 0.9398, std. dev.: 0.0024) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.16% (1.1364 => 1.1609, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.01% (0.7710 => 0.7865, std. dev.: 0.0011) MultiSource/Applications/kimwitu++/kc: 1.99% (16.6129 => 16.9432, std. dev.: 0.0018) MultiSource/Applications/spiff/spiff: 1.99% (0.7506 => 0.7655, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.95% (0.5637 => 0.5747, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.80% (13.2842 => 13.5238, std. dev.: 0.0033) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.77% (1.3819 => 1.4063, std. dev.: 0.0029) MultiSource/Applications/siod/siod: 1.61% (2.1791 => 2.2142, std. dev.: 0.0063) MultiSource/Benchmarks/MallocBench/gs/gs: 1.59% (3.8646 => 3.9261, std. dev.: 0.0034) MultiSource/Applications/Burg/burg: 1.57% (1.1061 => 1.1235, std. dev.: 0.0007) MultiSource/Applications/hbd/hbd: 1.56% (1.3693 => 1.3906, std. dev.: 0.0051) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.48% (1.1333 => 1.1501, std. dev.: 0.0046) MultiSource/Applications/lambda-0_1_3/lambda: 1.45% (0.7038 => 0.7140, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.45% (0.7460 => 0.7568, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.43% (1.3813 => 1.4011, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.43% (1.3245 => 1.3434, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.39% (3.6692 => 3.7203, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 1.31% (1.9270 => 1.9523, std. dev.: 0.0054) MultiSource/Applications/SIBsim4/SIBsim4: 1.13% (1.2749 => 1.2893, std. dev.: 0.0011) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.32% (1.8175 => 2.2596, std. dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.85% (1.5824 => 1.6750, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.64% (1.7688 => 1.8332, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/salsa20: 3.63% (7.4271 => 7.6969, std. dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 3.29% (0.9692 => 1.0011, std. dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 3.04% (8.8259 => 9.0940, std. dev.: 0.0161) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4539, std. dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.63% (7.9275 => 8.1362, std. dev.: 0.0054) SingleSource/Benchmarks/Misc/ffbench: 2.26% (0.8273 => 0.8460, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.33% (1.4298 => 1.4488, std. dev.: 0.0043) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.28% (2.0200 => 2.0459, std. dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 1.18% (5.0168 => 5.0762, std. dev.: 0.0136) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 1.00% (13.3668 => 13.5006, std. dev.: 0.0245) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -19.33% (0.4657 => 0.3757, std. dev.: 0.0056) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.30% (0.2670 => 0.2475, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.47% (0.3511 => 0.3284, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.45% (0.3650 => 0.3524, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -3.39% (0.3623 => 0.3500, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -3.33% (0.3601 => 0.3481, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -3.21% (0.3646 => 0.3529, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -3.19% (0.3663 => 0.3546, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -3.15% (0.3940 => 0.3816, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: -3.13% (0.3578 => 0.3466, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -2.93% (0.3789 => 0.3678, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -2.80% (0.4003 => 0.3891, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -2.78% (0.3914 => 0.3805, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.67% (0.8818 => 0.8671, std. dev.: 0.0011) MultiSource/Applications/lua/lua: -1.10% (3.7467 => 3.7053, std. dev.: 0.0043) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/richards_benchmark: -12.63% (1.1560 => 1.0100, std. dev.: 0.0046) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.11% (1.0460 => 0.9402, std. dev.: 0.0014) SingleSource/Benchmarks/McGill/chomp: -9.84% (1.2308 => 1.1097, std. dev.: 0.0039) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.56% (0.3139 => 0.2933, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.97% (1.3780 => 1.3095, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9475, std. dev.: 0.0005) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/neural/neural: -4.33% (0.2333 => 0.2232, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.67% (1.9762 => 1.9037, std. dev.: 0.0006) MultiSource/Applications/minisat/minisat: -2.03% (9.3358 => 9.1466, std. dev.: 0.0110) SingleSource/Benchmarks/Shootout/lists: -1.99% (6.3560 => 6.2298, std. dev.: 0.0089) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.96% (6.6320 => 6.5017, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3444, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.67% (7.1097 => 6.9913, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/heapsort: -1.43% (3.9173 => 3.8611, std. dev.: 0.0145) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.33% (20.3410 => 20.0695, std. dev.: 0.0578) MultiSource/Benchmarks/Bullet/bullet: -1.27% (7.3305 => 7.2371, std. dev.: 0.0177) MultiSource/Applications/lua/lua: -1.27% (26.5159 => 26.1791, std. dev.: 0.0217) MultiSource/Applications/spiff/spiff: -1.21% (3.0263 => 2.9896, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.03% (3.8887 => 3.8485, std. dev.: 0.0068) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.23s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu May 3 19:39:29 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 3 May 2012 21:39:29 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120504023929.4364C2A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/515?compare_to=514&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 515, Order: 156142, Start Time: 2012-05-04 01:42:47, End Time: 2012-05-04 02:40:02 To: 514, Order: 156132, Start Time: 2012-05-04 00:16:46, End Time: 2012-05-04 01:14:00 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (49 on baseline) Performance Improvements: 3 (27 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 888 (812 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout-C++/hash2: 2.78% (0.4322 => 0.4442, std. dev.: 0.0005) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.98% (22.6590 => 21.0781, std. dev.: 0.0191) SingleSource/Benchmarks/Misc-C++/bigfib: -1.85% (0.6263 => 0.6147, std. dev.: 0.0006) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/hash: -1.37% (0.7518 => 0.7415, std. dev.: 0.0004) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.53% (2.0176 => 2.2906, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.15% (0.2721 => 0.2834, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.77% (0.3130 => 0.3248, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.54% (3.9660 => 4.1063, std. dev.: 0.0055) MultiSource/Applications/SPASS/SPASS: 3.03% (13.8202 => 14.2385, std. dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.87% (0.5265 => 0.5416, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.66% (0.6959 => 0.7144, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 2.63% (0.4328 => 0.4442, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 2.54% (1.0594 => 1.0863, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.43% (1.2193 => 1.2489, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.38% (1.1364 => 1.1634, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.27% (0.9199 => 0.9408, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.24% (0.7710 => 0.7883, std. dev.: 0.0037) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.21% (1.3819 => 1.4125, std. dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.20% (0.5637 => 0.5761, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/football/football: 2.15% (0.8310 => 0.8489, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.04% (1.4563 => 1.4860, std. dev.: 0.0018) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.96% (1.3813 => 1.4084, std. dev.: 0.0053) MultiSource/Applications/kimwitu++/kc: 1.92% (16.6129 => 16.9314, std. dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.90% (0.5577 => 0.5683, std. dev.: 0.0010) MultiSource/Applications/hbd/hbd: 1.71% (1.3693 => 1.3927, std. dev.: 0.0070) MultiSource/Applications/siod/siod: 1.66% (2.1791 => 2.2153, std. dev.: 0.0020) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.62% (0.7460 => 0.7581, std. dev.: 0.0008) MultiSource/Applications/Burg/burg: 1.61% (1.1061 => 1.1239, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.59% (13.2842 => 13.4953, std. dev.: 0.0042) MultiSource/Benchmarks/MallocBench/gs/gs: 1.59% (3.8646 => 3.9259, std. dev.: 0.0009) MultiSource/Applications/treecc/treecc: 1.56% (1.9270 => 1.9570, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.56% (1.3245 => 1.3451, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.45% (3.6692 => 3.7224, std. dev.: 0.0022) MultiSource/Applications/hexxagon/hexxagon: 1.27% (1.2292 => 1.2448, std. dev.: 0.0047) MultiSource/Applications/SIBsim4/SIBsim4: 1.26% (1.2749 => 1.2910, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.16% (2.1007 => 2.1250, std. dev.: 0.0091) MultiSource/Applications/JM/ldecod/ldecod: 1.11% (6.5754 => 6.6485, std. dev.: 0.0028) MultiSource/Applications/JM/lencod/lencod: 1.07% (14.8535 => 15.0125, std. dev.: 0.0069) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 23.94% (1.8175 => 2.2526, std. dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.84% (1.5824 => 1.6748, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 3.70% (7.4271 => 7.7016, std. dev.: 0.0021) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.67% (1.7688 => 1.8337, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 3.27% (0.9692 => 1.0009, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4535, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.80% (8.8259 => 9.0732, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/ffbench: 2.24% (0.8273 => 0.8458, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.08% (7.9275 => 8.0923, std. dev.: 0.0181) MultiSource/Benchmarks/sim/sim: 1.31% (5.0168 => 5.0826, std. dev.: 0.0056) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.27% (2.0200 => 2.0456, std. dev.: 0.0005) MultiSource/Applications/lemon/lemon: 1.24% (1.4298 => 1.4475, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -20.70% (0.4657 => 0.3693, std. dev.: 0.0051) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.58% (22.5627 => 21.0781, std. dev.: 0.0191) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.55% (0.2670 => 0.2495, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.07% (0.3511 => 0.3298, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.47% (0.8818 => 0.8600, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: -1.65% (0.6250 => 0.6147, std. dev.: 0.0006) MultiSource/Applications/lua/lua: -1.20% (3.7467 => 3.7016, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/richards_benchmark: -12.37% (1.1560 => 1.0130, std. dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.12% (1.0460 => 0.9401, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -9.77% (1.2308 => 1.1105, std. dev.: 0.0058) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.59% (0.3139 => 0.2932, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.91% (1.3780 => 1.3104, std. dev.: 0.0059) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9472, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.33% (0.2333 => 0.2232, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -3.67% (1.9762 => 1.9036, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout/lists: -2.34% (6.3560 => 6.2075, std. dev.: 0.0116) MultiSource/Applications/minisat/minisat: -2.06% (9.3358 => 9.1432, std. dev.: 0.0154) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.92% (6.6320 => 6.5044, std. dev.: 0.0029) MultiSource/Applications/spiff/spiff: -1.76% (3.0263 => 2.9731, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.67% (7.1097 => 6.9911, std. dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -1.53% (7.3305 => 7.2185, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout/heapsort: -1.41% (3.9173 => 3.8622, std. dev.: 0.0147) MultiSource/Applications/lua/lua: -1.29% (26.5159 => 26.1735, std. dev.: 0.0181) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.05% (20.3410 => 20.1276, std. dev.: 0.0288) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.65s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu May 3 21:03:07 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 3 May 2012 23:03:07 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120504040307.58DF02A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/516?compare_to=515&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 516, Order: 156147, Start Time: 2012-05-04 03:06:18, End Time: 2012-05-04 04:03:41 To: 515, Order: 156142, Start Time: 2012-05-04 01:42:47, End Time: 2012-05-04 02:40:02 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (53 on baseline) Performance Improvements: 0 (26 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 891 (809 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 1.62% (7.9417 => 8.0705, std. dev.: 0.0082) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.15% (2.0176 => 2.2830, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.30% (0.2721 => 0.2838, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.48% (0.3130 => 0.3239, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.46% (3.9660 => 4.1034, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.00% (0.5265 => 0.5423, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 2.91% (0.4328 => 0.4454, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 2.75% (13.8202 => 14.1997, std. dev.: 0.0099) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.64% (0.6959 => 0.7143, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.55% (1.2193 => 1.2504, std. dev.: 0.0014) MultiSource/Benchmarks/nbench/nbench: 2.42% (1.0594 => 1.0850, std. dev.: 0.0019) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.32% (1.1364 => 1.1628, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.27% (0.9199 => 0.9408, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.15% (1.4563 => 1.4876, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.11% (0.5637 => 0.5756, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: 2.05% (0.8310 => 0.8480, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.96% (1.3819 => 1.4090, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.96% (0.7710 => 0.7861, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.92% (0.5577 => 0.5684, std. dev.: 0.0016) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.89% (0.7460 => 0.7601, std. dev.: 0.0050) MultiSource/Applications/hbd/hbd: 1.86% (1.3693 => 1.3948, std. dev.: 0.0050) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.82% (1.3813 => 1.4064, std. dev.: 0.0030) MultiSource/Applications/kimwitu++/kc: 1.80% (16.6129 => 16.9121, std. dev.: 0.0118) MultiSource/Benchmarks/MallocBench/gs/gs: 1.68% (3.8646 => 3.9295, std. dev.: 0.0015) MultiSource/Applications/lambda-0_1_3/lambda: 1.68% (0.7038 => 0.7156, std. dev.: 0.0011) MultiSource/Applications/Burg/burg: 1.65% (1.1061 => 1.1244, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.60% (13.2842 => 13.4966, std. dev.: 0.0185) MultiSource/Applications/siod/siod: 1.56% (2.1791 => 2.2130, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.56% (1.3245 => 1.3451, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 1.53% (1.9270 => 1.9564, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.45% (3.6692 => 3.7224, std. dev.: 0.0014) MultiSource/Applications/hexxagon/hexxagon: 1.37% (1.2292 => 1.2460, std. dev.: 0.0013) MultiSource/Applications/SIBsim4/SIBsim4: 1.17% (1.2749 => 1.2898, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.14% (1.9828 => 2.0054, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.13% (2.1007 => 2.1245, std. dev.: 0.0013) MultiSource/Applications/JM/ldecod/ldecod: 1.13% (6.5754 => 6.6498, std. dev.: 0.0152) MultiSource/Applications/JM/lencod/lencod: 1.05% (14.8535 => 15.0097, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.02% (7.2180 => 7.2913, std. dev.: 0.0140) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.46% (1.8175 => 2.2620, std. dev.: 0.0482) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.90% (1.5824 => 1.6758, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8146, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 3.82% (7.4271 => 7.7109, std. dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.65% (1.7688 => 1.8334, std. dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 3.26% (0.9692 => 1.0008, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4550, std. dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.52% (8.8259 => 9.0482, std. dev.: 0.0172) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.43% (7.9275 => 8.1198, std. dev.: 0.0151) SingleSource/Benchmarks/Misc/ffbench: 2.21% (0.8273 => 0.8456, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: 1.57% (5.0168 => 5.0955, std. dev.: 0.0044) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.23% (2.0200 => 2.0449, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0035) MultiSource/Applications/lemon/lemon: 1.16% (1.4298 => 1.4464, std. dev.: 0.0022) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.63% (22.5627 => 21.0674, std. dev.: 0.0143) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.25% (0.2670 => 0.2503, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.07% (0.3511 => 0.3298, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.68% (0.8818 => 0.8582, std. dev.: 0.0034) MultiSource/Applications/lua/lua: -1.20% (3.7467 => 3.7017, std. dev.: 0.0111) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/richards_benchmark: -12.67% (1.1560 => 1.0095, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.12% (1.0460 => 0.9401, std. dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: -9.82% (1.2308 => 1.1099, std. dev.: 0.0031) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.53% (0.3139 => 0.2934, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.99% (1.3780 => 1.3093, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9473, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.33% (0.2333 => 0.2232, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: -3.64% (1.9762 => 1.9043, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: -2.11% (9.3358 => 9.1389, std. dev.: 0.0184) SingleSource/Benchmarks/Shootout/lists: -2.05% (6.3560 => 6.2260, std. dev.: 0.0075) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.93% (6.6320 => 6.5037, std. dev.: 0.0076) MultiSource/Applications/spiff/spiff: -1.86% (3.0263 => 2.9699, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.67% (7.1097 => 6.9913, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout/heapsort: -1.54% (3.9173 => 3.8571, std. dev.: 0.0081) MultiSource/Benchmarks/Bullet/bullet: -1.51% (7.3305 => 7.2196, std. dev.: 0.0025) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.27% (20.3410 => 20.0823, std. dev.: 0.0431) MultiSource/Applications/lua/lua: -1.19% (26.5159 => 26.2011, std. dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.07% (3.8887 => 3.8469, std. dev.: 0.0021) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.28s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu May 3 22:26:26 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 4 May 2012 00:26:26 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120504052626.3ACED2A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/517?compare_to=516&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 517, Order: 156153, Start Time: 2012-05-04 04:29:55, End Time: 2012-05-04 05:26:59 To: 516, Order: 156147, Start Time: 2012-05-04 03:06:18, End Time: 2012-05-04 04:03:41 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (48 on baseline) Performance Improvements: 0 (26 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (814 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.85% (2.0176 => 2.2768, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.19% (0.2721 => 0.2835, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.39% (0.3130 => 0.3236, std. dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.27% (3.9660 => 4.0957, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.81% (0.5265 => 0.5413, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 2.75% (0.4328 => 0.4447, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 2.60% (13.8202 => 14.1802, std. dev.: 0.0155) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.40% (1.2193 => 1.2486, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.26% (1.1364 => 1.1621, std. dev.: 0.0032) MultiSource/Benchmarks/nbench/nbench: 2.24% (1.0594 => 1.0831, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.24% (0.5637 => 0.5763, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.13% (0.9199 => 0.9395, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.95% (0.7710 => 0.7860, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.89% (1.4563 => 1.4838, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/football/football: 1.88% (0.8310 => 0.8466, std. dev.: 0.0005) MultiSource/Applications/hbd/hbd: 1.87% (1.3693 => 1.3949, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.72% (1.3813 => 1.4051, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.68% (1.3819 => 1.4051, std. dev.: 0.0014) MultiSource/Applications/kimwitu++/kc: 1.62% (16.6129 => 16.8824, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.62% (13.2842 => 13.4988, std. dev.: 0.0026) MultiSource/Benchmarks/MallocBench/gs/gs: 1.49% (3.8646 => 3.9220, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.43% (1.3245 => 1.3435, std. dev.: 0.0021) MultiSource/Applications/treecc/treecc: 1.43% (1.9270 => 1.9546, std. dev.: 0.0096) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.41% (0.7460 => 0.7565, std. dev.: 0.0012) MultiSource/Applications/siod/siod: 1.27% (2.1791 => 2.2067, std. dev.: 0.0024) MultiSource/Applications/hexxagon/hexxagon: 1.24% (1.2292 => 1.2445, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.17% (3.6692 => 3.7122, std. dev.: 0.0010) MultiSource/Applications/SIBsim4/SIBsim4: 1.05% (1.2749 => 1.2883, std. dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 1.04% (14.8535 => 15.0075, std. dev.: 0.0090) MultiSource/Applications/JM/ldecod/ldecod: 1.01% (6.5754 => 6.6416, std. dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.00% (1.9828 => 2.0027, std. dev.: 0.0010) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.32% (1.8175 => 2.2596, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7298, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.86% (1.5824 => 1.6752, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8146, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 3.67% (7.4271 => 7.6996, std. dev.: 0.0060) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.62% (1.7688 => 1.8328, std. dev.: 0.0017) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 3.26% (0.9692 => 1.0008, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 3.01% (12.0921 => 12.4559, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.73% (8.8259 => 9.0668, std. dev.: 0.0175) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.31% (7.9275 => 8.1110, std. dev.: 0.0058) SingleSource/Benchmarks/Misc/ffbench: 2.22% (0.8273 => 0.8457, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9601, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.31% (1.4298 => 1.4486, std. dev.: 0.0039) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.29% (2.0200 => 2.0460, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 1.15% (13.3668 => 13.5203, std. dev.: 0.0261) MultiSource/Benchmarks/sim/sim: 1.04% (5.0168 => 5.0692, std. dev.: 0.0068) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.58% (22.5627 => 21.0788, std. dev.: 0.0105) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.18% (0.2670 => 0.2505, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.67% (0.3511 => 0.3312, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.67% (0.8818 => 0.8583, std. dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/bigfib: -1.71% (0.6250 => 0.6143, std. dev.: 0.0005) MultiSource/Applications/lua/lua: -1.40% (3.7467 => 3.6944, std. dev.: 0.0052) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/richards_benchmark: -12.29% (1.1560 => 1.0139, std. dev.: 0.0042) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.12% (1.0460 => 0.9401, std. dev.: 0.0009) SingleSource/Benchmarks/McGill/chomp: -9.85% (1.2308 => 1.1096, std. dev.: 0.0018) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.53% (0.3139 => 0.2934, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/perlin: -4.83% (6.2497 => 5.9478, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.43% (1.3780 => 1.3169, std. dev.: 0.0064) MultiSource/Benchmarks/FreeBench/neural/neural: -4.33% (0.2333 => 0.2232, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.72% (1.9762 => 1.9027, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.59% (0.3458 => 0.3334, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -2.11% (6.6320 => 6.4919, std. dev.: 0.0098) SingleSource/Benchmarks/Shootout/lists: -2.05% (6.3560 => 6.2257, std. dev.: 0.0052) MultiSource/Applications/minisat/minisat: -2.03% (9.3358 => 9.1463, std. dev.: 0.0148) MultiSource/Applications/spiff/spiff: -1.85% (3.0263 => 2.9703, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.67% (7.1097 => 6.9911, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/heapsort: -1.47% (3.9173 => 3.8598, std. dev.: 0.0042) MultiSource/Applications/lua/lua: -1.32% (26.5159 => 26.1663, std. dev.: 0.0179) MultiSource/Benchmarks/Bullet/bullet: -1.22% (7.3305 => 7.2408, std. dev.: 0.0147) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.18% (20.3410 => 20.1005, std. dev.: 0.0208) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.34s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu May 3 23:49:41 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 4 May 2012 01:49:41 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120504064941.D177A2A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/518?compare_to=517&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 518, Order: 156156, Start Time: 2012-05-04 05:53:12, End Time: 2012-05-04 06:50:15 To: 517, Order: 156153, Start Time: 2012-05-04 04:29:55, End Time: 2012-05-04 05:26:59 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (51 on baseline) Performance Improvements: 1 (29 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 891 (808 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -5.14% (0.3888 => 0.3688, std. dev.: 0.0042) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.07% (2.0176 => 2.2812, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.34% (0.2721 => 0.2839, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.32% (3.9660 => 4.0976, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.29% (0.3130 => 0.3233, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.77% (0.5265 => 0.5411, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/hash2: 2.73% (0.4328 => 0.4446, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 2.69% (13.8202 => 14.1921, std. dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.44% (1.2193 => 1.2491, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.40% (0.6959 => 0.7126, std. dev.: 0.0022) MultiSource/Benchmarks/nbench/nbench: 2.30% (1.0594 => 1.0838, std. dev.: 0.0026) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.17% (1.1364 => 1.1611, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.09% (0.9199 => 0.9391, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.06% (0.5637 => 0.5753, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 1.97% (0.8310 => 0.8474, std. dev.: 0.0020) MultiSource/Applications/hbd/hbd: 1.89% (1.3693 => 1.3952, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.88% (1.4563 => 1.4837, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.83% (13.2842 => 13.5267, std. dev.: 0.0126) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.76% (1.3813 => 1.4056, std. dev.: 0.0013) MultiSource/Applications/kimwitu++/kc: 1.73% (16.6129 => 16.9011, std. dev.: 0.0080) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.73% (0.7710 => 0.7843, std. dev.: 0.0038) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.60% (1.3819 => 1.4040, std. dev.: 0.0022) MultiSource/Applications/siod/siod: 1.54% (2.1791 => 2.2127, std. dev.: 0.0085) MultiSource/Benchmarks/MallocBench/gs/gs: 1.53% (3.8646 => 3.9237, std. dev.: 0.0024) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.49% (0.7460 => 0.7571, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.46% (1.3245 => 1.3439, std. dev.: 0.0013) MultiSource/Applications/Burg/burg: 1.41% (1.1061 => 1.1217, std. dev.: 0.0041) MultiSource/Applications/hexxagon/hexxagon: 1.33% (1.2292 => 1.2455, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 1.32% (1.9270 => 1.9525, std. dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.20% (3.6692 => 3.7132, std. dev.: 0.0021) MultiSource/Applications/JM/lencod/lencod: 1.18% (14.8535 => 15.0291, std. dev.: 0.0038) MultiSource/Applications/sqlite3/sqlite3: 1.08% (16.2614 => 16.4373, std. dev.: 0.0047) MultiSource/Benchmarks/Bullet/bullet: 1.07% (33.2944 => 33.6498, std. dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.04% (1.9828 => 2.0035, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.04% (7.2180 => 7.2930, std. dev.: 0.0036) MultiSource/Applications/JM/ldecod/ldecod: 1.02% (6.5754 => 6.6427, std. dev.: 0.0042) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.06% (1.8175 => 2.2548, std. dev.: 0.0600) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.87% (1.5824 => 1.6753, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 3.72% (7.4271 => 7.7032, std. dev.: 0.0024) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.63% (1.7688 => 1.8330, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 3.22% (0.9692 => 1.0004, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 3.01% (8.8259 => 9.0913, std. dev.: 0.0101) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4538, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.52% (7.9275 => 8.1276, std. dev.: 0.0145) SingleSource/Benchmarks/Misc/ffbench: 2.24% (0.8273 => 0.8458, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0006) MultiSource/Applications/lemon/lemon: 1.36% (1.4298 => 1.4492, std. dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.24% (2.0200 => 2.0451, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2135, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: 1.17% (5.0168 => 5.0754, std. dev.: 0.0022) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -20.81% (0.4657 => 0.3688, std. dev.: 0.0042) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.63% (22.5627 => 21.0678, std. dev.: 0.0114) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.07% (0.2670 => 0.2508, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.98% (0.3511 => 0.3301, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.59% (0.8818 => 0.8590, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/bigfib: -1.62% (0.6250 => 0.6149, std. dev.: 0.0005) MultiSource/Applications/lua/lua: -1.25% (3.7467 => 3.6998, std. dev.: 0.0037) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/richards_benchmark: -12.01% (1.1560 => 1.0172, std. dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.12% (1.0460 => 0.9401, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -9.51% (1.2308 => 1.1138, std. dev.: 0.0067) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.53% (0.3139 => 0.2934, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.27% (1.3780 => 1.3054, std. dev.: 0.0067) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9472, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.33% (0.2333 => 0.2232, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.70% (1.9762 => 1.9031, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.67% (0.3458 => 0.3331, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -2.34% (6.3560 => 6.2074, std. dev.: 0.0097) MultiSource/Applications/minisat/minisat: -2.01% (9.3358 => 9.1479, std. dev.: 0.0056) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.97% (6.6320 => 6.5013, std. dev.: 0.0072) MultiSource/Applications/spiff/spiff: -1.78% (3.0263 => 2.9725, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.66% (7.1097 => 6.9914, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/heapsort: -1.55% (3.9173 => 3.8567, std. dev.: 0.0053) MultiSource/Benchmarks/Bullet/bullet: -1.51% (7.3305 => 7.2198, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.51% (20.3410 => 20.0344, std. dev.: 0.0720) MultiSource/Applications/lua/lua: -1.18% (26.5159 => 26.2018, std. dev.: 0.0135) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.18% (3.8887 => 3.8427, std. dev.: 0.0062) MultiSource/Benchmarks/nbench/nbench: -1.01% (11.2619 => 11.1476, std. dev.: 0.0008) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.28s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri May 4 01:17:40 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 4 May 2012 03:17:40 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120504081740.3CE8E2A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/519?compare_to=518&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 519, Order: 156159, Start Time: 2012-05-04 07:20:49, End Time: 2012-05-04 08:18:13 To: 518, Order: 156156, Start Time: 2012-05-04 05:53:12, End Time: 2012-05-04 06:50:15 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (56 on baseline) Performance Improvements: 0 (26 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (806 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.07% (2.0176 => 2.2813, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.48% (0.2721 => 0.2843, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.80% (0.3130 => 0.3249, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.67% (3.9660 => 4.1115, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.15% (0.5265 => 0.5431, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 3.12% (13.8202 => 14.2516, std. dev.: 0.0155) SingleSource/Benchmarks/Shootout-C++/hash2: 2.96% (0.4328 => 0.4456, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.70% (0.6959 => 0.7147, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.67% (1.2193 => 1.2519, std. dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/hash: 2.61% (0.4062 => 0.4168, std. dev.: 0.0037) MultiSource/Benchmarks/nbench/nbench: 2.61% (1.0594 => 1.0870, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.50% (1.1364 => 1.1648, std. dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.40% (0.9199 => 0.9420, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.32% (0.5637 => 0.5768, std. dev.: 0.0008) MultiSource/Applications/kimwitu++/kc: 2.29% (16.6129 => 16.9931, std. dev.: 0.0112) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.21% (1.4563 => 1.4885, std. dev.: 0.0035) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.08% (0.7710 => 0.7870, std. dev.: 0.0037) MultiSource/Applications/lambda-0_1_3/lambda: 2.00% (0.7038 => 0.7179, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.99% (0.5577 => 0.5688, std. dev.: 0.0020) MultiSource/Applications/siod/siod: 1.91% (2.1791 => 2.2207, std. dev.: 0.0066) MultiSource/Benchmarks/MallocBench/gs/gs: 1.90% (3.8646 => 3.9381, std. dev.: 0.0037) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.88% (1.3819 => 1.4079, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.85% (1.3813 => 1.4069, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.84% (13.2842 => 13.5282, std. dev.: 0.0115) MultiSource/Applications/Burg/burg: 1.84% (1.1061 => 1.1264, std. dev.: 0.0065) MultiSource/Applications/treecc/treecc: 1.82% (1.9270 => 1.9620, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 1.74% (1.3693 => 1.3931, std. dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.72% (1.3245 => 1.3473, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.45% (3.6692 => 3.7223, std. dev.: 0.0010) MultiSource/Applications/spiff/spiff: 1.41% (0.7506 => 0.7612, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 1.39% (1.2292 => 1.2463, std. dev.: 0.0016) MultiSource/Applications/JM/lencod/lencod: 1.39% (14.8535 => 15.0599, std. dev.: 0.0036) MultiSource/Applications/d/make_dparser: 1.34% (3.1889 => 3.2317, std. dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.34% (1.9828 => 2.0093, std. dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.30% (2.1007 => 2.1281, std. dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 1.29% (33.2944 => 33.7225, std. dev.: 0.0266) MultiSource/Applications/JM/ldecod/ldecod: 1.27% (6.5754 => 6.6587, std. dev.: 0.0026) MultiSource/Applications/sqlite3/sqlite3: 1.23% (16.2614 => 16.4614, std. dev.: 0.0252) MultiSource/Applications/SIBsim4/SIBsim4: 1.20% (1.2749 => 1.2902, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.17% (7.2180 => 7.3023, std. dev.: 0.0094) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 23.79% (1.8175 => 2.2498, std. dev.: 0.0199) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.86% (1.5824 => 1.6752, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8146, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 3.64% (7.4271 => 7.6972, std. dev.: 0.0054) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.59% (1.7688 => 1.8323, std. dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 3.28% (0.9692 => 1.0010, std. dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4538, std. dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.84% (8.8259 => 9.0767, std. dev.: 0.0187) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.58% (7.9275 => 8.1323, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/ffbench: 2.19% (0.8273 => 0.8454, std. dev.: 0.0022) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.29% (1.4298 => 1.4482, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.25% (2.0200 => 2.0452, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) MultiSource/Benchmarks/sim/sim: 1.05% (5.0168 => 5.0696, std. dev.: 0.0025) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.29% (0.2670 => 0.2502, std. dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.23% (22.5627 => 21.1572, std. dev.: 0.0079) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.98% (0.3511 => 0.3301, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.67% (0.8818 => 0.8583, std. dev.: 0.0045) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/richards_benchmark: -12.24% (1.1560 => 1.0145, std. dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.12% (1.0460 => 0.9401, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.12% (1.2308 => 1.1063, std. dev.: 0.0022) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.31% (0.3139 => 0.2941, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.16% (1.3780 => 1.3069, std. dev.: 0.0062) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9472, std. dev.: 0.0004) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/neural/neural: -4.33% (0.2333 => 0.2232, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -3.70% (1.9762 => 1.9030, std. dev.: 0.0012) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.67% (0.3458 => 0.3331, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: -2.11% (9.3358 => 9.1389, std. dev.: 0.0067) SingleSource/Benchmarks/Shootout/lists: -2.08% (6.3560 => 6.2236, std. dev.: 0.0153) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.85% (6.6320 => 6.5091, std. dev.: 0.0024) MultiSource/Applications/spiff/spiff: -1.77% (3.0263 => 2.9727, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.66% (7.1097 => 6.9914, std. dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.56% (20.3410 => 20.0234, std. dev.: 0.0533) MultiSource/Benchmarks/Bullet/bullet: -1.47% (7.3305 => 7.2226, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout/heapsort: -1.38% (3.9173 => 3.8634, std. dev.: 0.0016) MultiSource/Applications/lua/lua: -1.20% (26.5159 => 26.1982, std. dev.: 0.0142) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.14% (3.8887 => 3.8443, std. dev.: 0.0031) MultiSource/Benchmarks/nbench/nbench: -1.02% (11.2619 => 11.1470, std. dev.: 0.0029) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.39s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri May 4 02:41:44 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 4 May 2012 04:41:44 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120504094144.352642A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/520?compare_to=519&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 520, Order: 156161, Start Time: 2012-05-04 08:44:57, End Time: 2012-05-04 09:42:17 To: 519, Order: 156159, Start Time: 2012-05-04 07:20:49, End Time: 2012-05-04 08:18:13 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (54 on baseline) Performance Improvements: 0 (26 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (808 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.05% (2.0176 => 2.2808, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.45% (0.2721 => 0.2842, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.87% (0.3130 => 0.3251, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.77% (3.9660 => 4.1155, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/hash2: 3.12% (0.4328 => 0.4463, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.11% (0.5265 => 0.5429, std. dev.: 0.0022) MultiSource/Applications/SPASS/SPASS: 2.94% (13.8202 => 14.2268, std. dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.92% (0.6959 => 0.7162, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 2.59% (1.0594 => 1.0868, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.56% (1.2193 => 1.2505, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash: 2.51% (0.4062 => 0.4164, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.50% (0.5637 => 0.5778, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.45% (1.1364 => 1.1642, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.44% (0.7710 => 0.7898, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.38% (0.9199 => 0.9418, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.22% (1.4563 => 1.4886, std. dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C/football/football: 2.19% (0.8310 => 0.8492, std. dev.: 0.0014) MultiSource/Applications/kimwitu++/kc: 2.13% (16.6129 => 16.9669, std. dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.03% (0.5577 => 0.5690, std. dev.: 0.0017) MultiSource/Applications/hbd/hbd: 1.96% (1.3693 => 1.3961, std. dev.: 0.0083) MultiSource/Applications/siod/siod: 1.79% (2.1791 => 2.2181, std. dev.: 0.0148) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.78% (1.3245 => 1.3481, std. dev.: 0.0077) MultiSource/Benchmarks/MallocBench/gs/gs: 1.77% (3.8646 => 3.9329, std. dev.: 0.0043) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.77% (1.3813 => 1.4057, std. dev.: 0.0008) MultiSource/Applications/lambda-0_1_3/lambda: 1.75% (0.7038 => 0.7161, std. dev.: 0.0016) MultiSource/Applications/treecc/treecc: 1.70% (1.9270 => 1.9597, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.66% (1.3819 => 1.4049, std. dev.: 0.0018) MultiSource/Benchmarks/Bullet/bullet: 1.63% (33.2944 => 33.8374, std. dev.: 0.0171) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.62% (0.7460 => 0.7581, std. dev.: 0.0019) MultiSource/Applications/hexxagon/hexxagon: 1.61% (1.2292 => 1.2490, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.60% (13.2842 => 13.4967, std. dev.: 0.0161) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.58% (1.9828 => 2.0141, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.53% (3.6692 => 3.7252, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference: 1.44% (0.7061 => 0.7163, std. dev.: 0.0010) MultiSource/Applications/JM/lencod/lencod: 1.32% (14.8535 => 15.0493, std. dev.: 0.0032) MultiSource/Applications/SIBsim4/SIBsim4: 1.25% (1.2749 => 1.2908, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.24% (7.2180 => 7.3075, std. dev.: 0.0043) MultiSource/Applications/JM/ldecod/ldecod: 1.16% (6.5754 => 6.6515, std. dev.: 0.0052) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.14% (2.1007 => 2.1246, std. dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 23.98% (1.8175 => 2.2534, std. dev.: 0.0190) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7298, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.89% (1.5824 => 1.6756, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8143, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 3.72% (7.4271 => 7.7031, std. dev.: 0.0035) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.62% (1.7688 => 1.8329, std. dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 3.25% (0.9692 => 1.0007, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4534, std. dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.77% (8.8259 => 9.0701, std. dev.: 0.0215) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.51% (7.9275 => 8.1265, std. dev.: 0.0068) SingleSource/Benchmarks/Misc/ffbench: 2.20% (0.8273 => 0.8455, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.30% (1.4298 => 1.4484, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.27% (2.0200 => 2.0457, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.46% (22.5627 => 21.1044, std. dev.: 0.0073) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.22% (0.2670 => 0.2504, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.87% (0.3511 => 0.3305, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.86% (0.8818 => 0.8566, std. dev.: 0.0012) MultiSource/Applications/lua/lua: -1.04% (3.7467 => 3.7078, std. dev.: 0.0098) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/richards_benchmark: -12.85% (1.1560 => 1.0075, std. dev.: 0.0114) SingleSource/Benchmarks/McGill/chomp: -10.21% (1.2308 => 1.1051, std. dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.12% (1.0460 => 0.9401, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.59% (0.3139 => 0.2932, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9473, std. dev.: 0.0003) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.62% (1.3780 => 1.3143, std. dev.: 0.0016) MultiSource/Benchmarks/FreeBench/neural/neural: -4.33% (0.2333 => 0.2232, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -3.73% (1.9762 => 1.9024, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.61% (0.3458 => 0.3333, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: -2.12% (9.3358 => 9.1378, std. dev.: 0.0134) SingleSource/Benchmarks/Shootout/lists: -2.11% (6.3560 => 6.2221, std. dev.: 0.0063) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.94% (6.6320 => 6.5032, std. dev.: 0.0072) MultiSource/Applications/spiff/spiff: -1.83% (3.0263 => 2.9708, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.66% (7.1097 => 6.9914, std. dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -1.60% (7.3305 => 7.2134, std. dev.: 0.0050) SingleSource/Benchmarks/Shootout/heapsort: -1.50% (3.9173 => 3.8584, std. dev.: 0.0038) MultiSource/Applications/lua/lua: -1.39% (26.5159 => 26.1474, std. dev.: 0.0212) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.17% (20.3410 => 20.1039, std. dev.: 0.0064) MultiSource/Benchmarks/nbench/nbench: -1.01% (11.2619 => 11.1479, std. dev.: 0.0018) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.81s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri May 4 04:11:44 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 4 May 2012 06:11:44 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120504111144.5B5842A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/521?compare_to=520&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 521, Order: 156162, Start Time: 2012-05-04 10:15:08, End Time: 2012-05-04 11:12:19 To: 520, Order: 156161, Start Time: 2012-05-04 08:44:57, End Time: 2012-05-04 09:42:17 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (54 on baseline) Performance Improvements: 0 (28 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (806 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.10% (2.0176 => 2.2819, std. dev.: 0.0058) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.45% (0.2721 => 0.2842, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.67% (0.3130 => 0.3245, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.46% (3.9660 => 4.1034, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 3.37% (0.4328 => 0.4474, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.06% (0.5265 => 0.5426, std. dev.: 0.0021) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.97% (0.7710 => 0.7939, std. dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: 2.91% (13.8202 => 14.2229, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 2.83% (0.4062 => 0.4177, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.67% (0.6959 => 0.7145, std. dev.: 0.0036) MultiSource/Applications/hbd/hbd: 2.64% (1.3693 => 1.4054, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.58% (1.2193 => 1.2507, std. dev.: 0.0016) MultiSource/Benchmarks/nbench/nbench: 2.44% (1.0594 => 1.0853, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.26% (1.1364 => 1.1621, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.25% (0.5637 => 0.5764, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.16% (0.9199 => 0.9398, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.11% (1.4563 => 1.4871, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/football/football: 1.95% (0.8310 => 0.8472, std. dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: 1.91% (1.2292 => 1.2527, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.91% (1.9828 => 2.0207, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.90% (13.2842 => 13.5363, std. dev.: 0.0037) MultiSource/Applications/kimwitu++/kc: 1.84% (16.6129 => 16.9192, std. dev.: 0.0062) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.81% (1.3819 => 1.4069, std. dev.: 0.0011) MultiSource/Benchmarks/Bullet/bullet: 1.78% (33.2944 => 33.8861, std. dev.: 0.0266) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.62% (0.6283 => 0.6385, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.62% (1.3245 => 1.3460, std. dev.: 0.0013) MultiSource/Applications/Burg/burg: 1.62% (1.1061 => 1.1240, std. dev.: 0.0016) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.61% (0.7460 => 0.7580, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/gs/gs: 1.57% (3.8646 => 3.9252, std. dev.: 0.0044) MultiSource/Applications/treecc/treecc: 1.55% (1.9270 => 1.9568, std. dev.: 0.0026) SingleSource/UnitTests/ObjC++/property-reference: 1.52% (0.7061 => 0.7168, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.36% (3.6692 => 3.7190, std. dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.29% (7.2180 => 7.3110, std. dev.: 0.0015) MultiSource/Applications/JM/lencod/lencod: 1.15% (14.8535 => 15.0241, std. dev.: 0.0137) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.15% (2.1007 => 2.1248, std. dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 1.11% (16.2614 => 16.4427, std. dev.: 0.0052) MultiSource/Applications/SIBsim4/SIBsim4: 1.10% (1.2749 => 1.2889, std. dev.: 0.0022) MultiSource/Applications/JM/ldecod/ldecod: 1.06% (6.5754 => 6.6448, std. dev.: 0.0160) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.02% (1.8175 => 2.2541, std. dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7298, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6754, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 3.66% (7.4271 => 7.6992, std. dev.: 0.0035) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.63% (1.7688 => 1.8330, std. dev.: 0.0060) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 3.27% (0.9692 => 1.0009, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4540, std. dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.61% (8.8259 => 9.0564, std. dev.: 0.0236) SingleSource/Benchmarks/Misc/ffbench: 2.24% (0.8273 => 0.8458, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.19% (7.9275 => 8.1010, std. dev.: 0.0277) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.26% (1.4298 => 1.4478, std. dev.: 0.0007) MultiSource/Benchmarks/sim/sim: 1.26% (5.0168 => 5.0798, std. dev.: 0.0075) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.25% (2.0200 => 2.0453, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -14.37% (0.4657 => 0.3988, std. dev.: 0.0178) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.52% (0.2670 => 0.2496, std. dev.: 0.0031) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.36% (22.5627 => 21.1277, std. dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.95% (0.3511 => 0.3302, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.02% (0.8818 => 0.8552, std. dev.: 0.0005) MultiSource/Applications/lua/lua: -1.19% (3.7467 => 3.7022, std. dev.: 0.0129) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/richards_benchmark: -12.74% (1.1560 => 1.0087, std. dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.12% (1.0460 => 0.9401, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -9.98% (1.2308 => 1.1080, std. dev.: 0.0239) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.53% (0.3139 => 0.2934, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9474, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.33% (1.3780 => 1.3183, std. dev.: 0.0123) MultiSource/Benchmarks/FreeBench/neural/neural: -4.33% (0.2333 => 0.2232, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.64% (1.9762 => 1.9042, std. dev.: 0.0113) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.61% (0.3458 => 0.3333, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -2.12% (6.3560 => 6.2211, std. dev.: 0.0099) MultiSource/Applications/minisat/minisat: -1.99% (9.3358 => 9.1502, std. dev.: 0.0138) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.98% (6.6320 => 6.5010, std. dev.: 0.0050) MultiSource/Applications/spiff/spiff: -1.86% (3.0263 => 2.9699, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.67% (7.1097 => 6.9912, std. dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -1.56% (7.3305 => 7.2158, std. dev.: 0.0104) SingleSource/Benchmarks/Shootout/heapsort: -1.55% (3.9173 => 3.8565, std. dev.: 0.0068) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.44% (20.3410 => 20.0474, std. dev.: 0.0479) MultiSource/Applications/lua/lua: -1.29% (26.5159 => 26.1746, std. dev.: 0.0289) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.07% (3.8887 => 3.8470, std. dev.: 0.0103) MultiSource/Benchmarks/nbench/nbench: -1.01% (11.2619 => 11.1485, std. dev.: 0.0010) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.12s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri May 4 05:35:03 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 4 May 2012 07:35:03 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120504123503.B54182A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/522?compare_to=521&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 522, Order: 156165, Start Time: 2012-05-04 11:38:32, End Time: 2012-05-04 12:35:38 To: 521, Order: 156162, Start Time: 2012-05-04 10:15:08, End Time: 2012-05-04 11:12:19 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (48 on baseline) Performance Improvements: 0 (27 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 891 (813 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/SPASS/SPASS: 1.00% (10.7719 => 10.8800, std. dev.: 0.0202) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.81% (2.0176 => 2.2761, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.26% (0.2721 => 0.2837, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.30% (3.9660 => 4.0968, std. dev.: 0.0101) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.19% (0.3130 => 0.3230, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 2.84% (0.4328 => 0.4451, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.72% (0.5265 => 0.5408, std. dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: 2.68% (13.8202 => 14.1906, std. dev.: 0.0098) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.49% (1.2193 => 1.2497, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 2.40% (1.0594 => 1.0848, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 2.38% (1.3693 => 1.4019, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.24% (1.1364 => 1.1618, std. dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.18% (0.6959 => 0.7111, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.09% (0.5637 => 0.5755, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 2.06% (0.8310 => 0.8481, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.03% (0.9199 => 0.9386, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.00% (0.7710 => 0.7864, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.79% (1.4563 => 1.4823, std. dev.: 0.0060) MultiSource/Applications/kimwitu++/kc: 1.58% (16.6129 => 16.8748, std. dev.: 0.0070) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.53% (1.3813 => 1.4024, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.51% (0.7460 => 0.7573, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.48% (1.3819 => 1.4024, std. dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.47% (13.2842 => 13.4794, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.35% (1.3245 => 1.3424, std. dev.: 0.0016) MultiSource/Applications/SIBsim4/SIBsim4: 1.30% (1.2749 => 1.2915, std. dev.: 0.0017) MultiSource/Applications/Burg/burg: 1.29% (1.1061 => 1.1204, std. dev.: 0.0020) MultiSource/Benchmarks/MallocBench/gs/gs: 1.27% (3.8646 => 3.9138, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.26% (3.6692 => 3.7154, std. dev.: 0.0011) MultiSource/Benchmarks/Bullet/bullet: 1.25% (33.2944 => 33.7096, std. dev.: 0.0017) MultiSource/Applications/treecc/treecc: 1.20% (1.9270 => 1.9501, std. dev.: 0.0006) MultiSource/Applications/siod/siod: 1.17% (2.1791 => 2.2045, std. dev.: 0.0021) MultiSource/Applications/sqlite3/sqlite3: 1.03% (16.2614 => 16.4281, std. dev.: 0.0011) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.15% (1.8175 => 2.2565, std. dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.86% (1.5824 => 1.6751, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 3.80% (7.4271 => 7.7095, std. dev.: 0.0027) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.55% (1.7688 => 1.8316, std. dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 3.22% (0.9692 => 1.0004, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 3.01% (12.0921 => 12.4556, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.84% (8.8259 => 9.0764, std. dev.: 0.0037) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.41% (7.9275 => 8.1182, std. dev.: 0.0051) SingleSource/Benchmarks/Misc/ffbench: 2.24% (0.8273 => 0.8458, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.28% (1.4298 => 1.4481, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.24% (2.0200 => 2.0450, std. dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 1.23% (10.7476 => 10.8800, std. dev.: 0.0202) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2135, std. dev.: 0.0001) MultiSource/Benchmarks/sim/sim: 1.11% (5.0168 => 5.0727, std. dev.: 0.0140) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.48% (22.5627 => 21.1008, std. dev.: 0.0056) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.37% (0.2670 => 0.2500, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.27% (0.3511 => 0.3291, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.73% (0.8818 => 0.8577, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: -1.62% (0.6250 => 0.6149, std. dev.: 0.0006) MultiSource/Applications/lua/lua: -1.41% (3.7467 => 3.6938, std. dev.: 0.0052) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/richards_benchmark: -12.30% (1.1560 => 1.0138, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.13% (1.0460 => 0.9400, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -10.11% (1.2308 => 1.1064, std. dev.: 0.0043) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.50% (0.3139 => 0.2935, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.27% (1.3780 => 1.3054, std. dev.: 0.0068) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9472, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.33% (0.2333 => 0.2232, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.73% (0.3458 => 0.3329, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.68% (1.9762 => 1.9034, std. dev.: 0.0005) MultiSource/Applications/minisat/minisat: -2.00% (9.3358 => 9.1491, std. dev.: 0.0041) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.87% (6.6320 => 6.5083, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout/lists: -1.82% (6.3560 => 6.2401, std. dev.: 0.0014) MultiSource/Applications/spiff/spiff: -1.75% (3.0263 => 2.9734, std. dev.: 0.0093) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.67% (7.1097 => 6.9911, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.62% (20.3410 => 20.0107, std. dev.: 0.0567) MultiSource/Benchmarks/Bullet/bullet: -1.48% (7.3305 => 7.2219, std. dev.: 0.0002) MultiSource/Applications/lua/lua: -1.45% (26.5159 => 26.1301, std. dev.: 0.0221) SingleSource/Benchmarks/Shootout/heapsort: -1.45% (3.9173 => 3.8606, std. dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.09% (3.8887 => 3.8462, std. dev.: 0.0052) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.24s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri May 4 07:39:13 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 4 May 2012 09:39:13 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120504143913.D4DB72A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/523?compare_to=522&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 523, Order: 156169, Start Time: 2012-05-04 13:42:44, End Time: 2012-05-04 14:39:48 To: 522, Order: 156165, Start Time: 2012-05-04 11:38:32, End Time: 2012-05-04 12:35:38 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (45 on baseline) Performance Improvements: 1 (28 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 890 (815 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 1.51% (7.9533 => 8.0736, std. dev.: 0.0108) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -9.95% (0.4120 => 0.3710, std. dev.: 0.0036) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.19% (2.0176 => 2.2635, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.41% (0.2721 => 0.2841, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.29% (0.3130 => 0.3233, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.18% (3.9660 => 4.0923, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 2.80% (0.4328 => 0.4449, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.79% (0.5265 => 0.5412, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 2.79% (13.8202 => 14.2058, std. dev.: 0.0110) MultiSource/Benchmarks/nbench/nbench: 2.41% (1.0594 => 1.0849, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.40% (1.2193 => 1.2486, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.31% (0.6959 => 0.7120, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.25% (0.5637 => 0.5764, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.20% (1.1364 => 1.1614, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.08% (0.9199 => 0.9390, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: 2.00% (0.8310 => 0.8476, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.90% (1.3819 => 1.4081, std. dev.: 0.0014) MultiSource/Applications/hbd/hbd: 1.89% (1.3693 => 1.3952, std. dev.: 0.0059) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.82% (1.3813 => 1.4065, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.82% (0.7710 => 0.7850, std. dev.: 0.0030) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.79% (1.4563 => 1.4824, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.58% (0.7460 => 0.7578, std. dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 1.49% (16.6129 => 16.8602, std. dev.: 0.0172) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.48% (13.2842 => 13.4803, std. dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.40% (1.3245 => 1.3431, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: 1.32% (3.8646 => 3.9157, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.32% (3.6692 => 3.7176, std. dev.: 0.0025) MultiSource/Applications/Burg/burg: 1.28% (1.1061 => 1.1203, std. dev.: 0.0047) MultiSource/Applications/treecc/treecc: 1.25% (1.9270 => 1.9510, std. dev.: 0.0054) MultiSource/Applications/siod/siod: 1.18% (2.1791 => 2.2048, std. dev.: 0.0013) MultiSource/Benchmarks/Bullet/bullet: 1.15% (33.2944 => 33.6764, std. dev.: 0.0028) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 23.81% (1.8175 => 2.2502, std. dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7298, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6754, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 3.76% (7.4271 => 7.7067, std. dev.: 0.0032) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.67% (1.7688 => 1.8337, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 3.28% (0.9692 => 1.0010, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4534, std. dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.57% (8.8259 => 9.0526, std. dev.: 0.0172) SingleSource/Benchmarks/Misc/ffbench: 2.25% (0.8273 => 0.8459, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.19% (7.9275 => 8.1010, std. dev.: 0.0175) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0009) MultiSource/Applications/lemon/lemon: 1.28% (1.4298 => 1.4481, std. dev.: 0.0005) MultiSource/Benchmarks/sim/sim: 1.28% (5.0168 => 5.0809, std. dev.: 0.0031) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.27% (2.0200 => 2.0456, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -20.33% (0.4657 => 0.3710, std. dev.: 0.0036) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.40% (0.2670 => 0.2499, std. dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.33% (22.5627 => 21.1353, std. dev.: 0.0063) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.18% (0.3511 => 0.3294, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.46% (0.8818 => 0.8601, std. dev.: 0.0004) MultiSource/Applications/lua/lua: -1.44% (3.7467 => 3.6928, std. dev.: 0.0042) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/richards_benchmark: -12.91% (1.1560 => 1.0068, std. dev.: 0.0055) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.12% (1.0460 => 0.9401, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -9.99% (1.2308 => 1.1079, std. dev.: 0.0041) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.56% (0.3139 => 0.2933, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.05% (1.3780 => 1.3084, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9474, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.33% (0.2333 => 0.2232, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.67% (0.3458 => 0.3331, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.67% (1.9762 => 1.9037, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -2.24% (6.3560 => 6.2138, std. dev.: 0.0096) MultiSource/Applications/minisat/minisat: -2.04% (9.3358 => 9.1457, std. dev.: 0.0095) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.90% (6.6320 => 6.5061, std. dev.: 0.0034) MultiSource/Benchmarks/Bullet/bullet: -1.80% (7.3305 => 7.1983, std. dev.: 0.0153) MultiSource/Applications/spiff/spiff: -1.77% (3.0263 => 2.9728, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3444, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: -1.67% (7.1097 => 6.9911, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/heapsort: -1.39% (3.9173 => 3.8629, std. dev.: 0.0027) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.28% (20.3410 => 20.0814, std. dev.: 0.0547) MultiSource/Applications/lua/lua: -1.11% (26.5159 => 26.2222, std. dev.: 0.0258) MultiSource/Benchmarks/nbench/nbench: -1.01% (11.2619 => 11.1480, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.00% (3.8887 => 3.8498, std. dev.: 0.0059) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.25s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri May 4 10:01:04 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 4 May 2012 12:01:04 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120504170104.79A532A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/524?compare_to=523&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 524, Order: 156172, Start Time: 2012-05-04 16:04:30, End Time: 2012-05-04 17:01:39 To: 523, Order: 156169, Start Time: 2012-05-04 13:42:44, End Time: 2012-05-04 14:39:48 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (51 on baseline) Performance Improvements: 0 (27 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 891 (810 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/SPASS/SPASS: 1.08% (10.7726 => 10.8891, std. dev.: 0.0211) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.30% (2.0176 => 2.2657, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.37% (0.2721 => 0.2840, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.44% (3.9660 => 4.1025, std. dev.: 0.0113) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.35% (0.3130 => 0.3235, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.87% (0.5265 => 0.5416, std. dev.: 0.0022) MultiSource/Applications/SPASS/SPASS: 2.81% (13.8202 => 14.2080, std. dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/hash2: 2.77% (0.4328 => 0.4448, std. dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.62% (0.6959 => 0.7141, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.59% (1.2193 => 1.2509, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 2.51% (1.0594 => 1.0860, std. dev.: 0.0020) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.38% (1.1364 => 1.1635, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.36% (0.5637 => 0.5770, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.33% (0.9199 => 0.9413, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/football/football: 2.20% (0.8310 => 0.8493, std. dev.: 0.0030) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.15% (0.7710 => 0.7876, std. dev.: 0.0048) MultiSource/Applications/kimwitu++/kc: 1.99% (16.6129 => 16.9428, std. dev.: 0.0089) MultiSource/Applications/hbd/hbd: 1.96% (1.3693 => 1.3962, std. dev.: 0.0037) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.94% (0.7460 => 0.7605, std. dev.: 0.0049) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.94% (1.4563 => 1.4845, std. dev.: 0.0020) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.88% (1.3813 => 1.4073, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.85% (0.5577 => 0.5680, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.77% (1.3819 => 1.4063, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.71% (1.3245 => 1.3471, std. dev.: 0.0065) MultiSource/Benchmarks/MallocBench/gs/gs: 1.70% (3.8646 => 3.9304, std. dev.: 0.0060) MultiSource/Applications/Burg/burg: 1.66% (1.1061 => 1.1245, std. dev.: 0.0026) MultiSource/Applications/siod/siod: 1.60% (2.1791 => 2.2139, std. dev.: 0.0005) MultiSource/Applications/treecc/treecc: 1.50% (1.9270 => 1.9559, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.49% (13.2842 => 13.4827, std. dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.42% (3.6692 => 3.7214, std. dev.: 0.0021) MultiSource/Applications/lambda-0_1_3/lambda: 1.42% (0.7038 => 0.7138, std. dev.: 0.0021) MultiSource/Applications/hexxagon/hexxagon: 1.35% (1.2292 => 1.2458, std. dev.: 0.0009) MultiSource/Applications/SIBsim4/SIBsim4: 1.33% (1.2749 => 1.2919, std. dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: 1.27% (33.2944 => 33.7189, std. dev.: 0.0287) MultiSource/Applications/JM/lencod/lencod: 1.09% (14.8535 => 15.0149, std. dev.: 0.0113) MultiSource/Applications/JM/ldecod/ldecod: 1.05% (6.5754 => 6.6444, std. dev.: 0.0030) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.06% (1.8175 => 2.2547, std. dev.: 0.0377) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6755, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.70% (1.7688 => 1.8342, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: 3.69% (7.4271 => 7.7009, std. dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 3.26% (0.9692 => 1.0008, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 3.01% (12.0921 => 12.4558, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.71% (8.8259 => 9.0653, std. dev.: 0.0141) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.45% (7.9275 => 8.1218, std. dev.: 0.0047) SingleSource/Benchmarks/Misc/ffbench: 2.24% (0.8273 => 0.8458, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9601, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 1.32% (10.7476 => 10.8891, std. dev.: 0.0211) MultiSource/Applications/lemon/lemon: 1.31% (1.4298 => 1.4486, std. dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.27% (2.0200 => 2.0456, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.47% (22.5627 => 21.1033, std. dev.: 0.0173) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.37% (0.2670 => 0.2500, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.12% (0.3511 => 0.3296, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.10% (0.8818 => 0.8633, std. dev.: 0.0056) SingleSource/Benchmarks/Misc-C++/bigfib: -1.62% (0.6250 => 0.6149, std. dev.: 0.0007) MultiSource/Applications/lua/lua: -1.20% (3.7467 => 3.7018, std. dev.: 0.0017) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/richards_benchmark: -12.77% (1.1560 => 1.0084, std. dev.: 0.0069) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.12% (1.0460 => 0.9401, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -9.84% (1.2308 => 1.1097, std. dev.: 0.0018) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.56% (0.3139 => 0.2933, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9472, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.78% (1.3780 => 1.3121, std. dev.: 0.0013) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.33% (0.2333 => 0.2232, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.67% (1.9762 => 1.9036, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.59% (0.3458 => 0.3334, std. dev.: 0.0000) MultiSource/Applications/minisat/minisat: -2.04% (9.3358 => 9.1458, std. dev.: 0.0118) SingleSource/Benchmarks/Shootout/lists: -2.02% (6.3560 => 6.2274, std. dev.: 0.0170) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.91% (6.6320 => 6.5052, std. dev.: 0.0030) MultiSource/Applications/spiff/spiff: -1.87% (3.0263 => 2.9696, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3446, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.67% (7.1097 => 6.9913, std. dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -1.49% (7.3305 => 7.2211, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout/heapsort: -1.35% (3.9173 => 3.8644, std. dev.: 0.0035) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.35% (20.3410 => 20.0672, std. dev.: 0.0163) MultiSource/Applications/lua/lua: -1.14% (26.5159 => 26.2126, std. dev.: 0.0126) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.06% (3.8887 => 3.8475, std. dev.: 0.0032) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.24s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri May 4 11:24:27 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 4 May 2012 13:24:27 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120504182427.955DE2A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/525?compare_to=524&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 525, Order: 156178, Start Time: 2012-05-04 17:27:56, End Time: 2012-05-04 18:25:02 To: 524, Order: 156172, Start Time: 2012-05-04 16:04:30, End Time: 2012-05-04 17:01:39 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (45 on baseline) Performance Improvements: 0 (28 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (815 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.05% (2.0176 => 2.2808, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.15% (0.2721 => 0.2834, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.32% (3.9660 => 4.0978, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 2.77% (0.4328 => 0.4448, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 2.73% (13.8202 => 14.1975, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.66% (0.5265 => 0.5405, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.56% (0.6959 => 0.7137, std. dev.: 0.0031) MultiSource/Benchmarks/nbench/nbench: 2.36% (1.0594 => 1.0844, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.26% (1.2193 => 1.2469, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.13% (1.1364 => 1.1606, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.05% (0.9199 => 0.9388, std. dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: 2.01% (16.6129 => 16.9467, std. dev.: 0.0103) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.99% (0.5637 => 0.5749, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 1.93% (0.8310 => 0.8470, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.80% (1.4563 => 1.4825, std. dev.: 0.0016) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.67% (0.7710 => 0.7839, std. dev.: 0.0015) MultiSource/Applications/lambda-0_1_3/lambda: 1.53% (0.7038 => 0.7146, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 1.51% (1.3693 => 1.3900, std. dev.: 0.0038) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.49% (1.3813 => 1.4019, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.48% (1.3245 => 1.3441, std. dev.: 0.0024) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.47% (0.7460 => 0.7570, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/gs/gs: 1.47% (3.8646 => 3.9213, std. dev.: 0.0046) MultiSource/Applications/siod/siod: 1.44% (2.1791 => 2.2105, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.41% (13.2842 => 13.4719, std. dev.: 0.0056) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.40% (1.3819 => 1.4013, std. dev.: 0.0024) MultiSource/Applications/Burg/burg: 1.39% (1.1061 => 1.1215, std. dev.: 0.0015) MultiSource/Applications/hexxagon/hexxagon: 1.24% (1.2292 => 1.2445, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.17% (3.6692 => 3.7123, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.09% (2.1007 => 2.1235, std. dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 23.83% (1.8175 => 2.2506, std. dev.: 0.0053) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.86% (1.5824 => 1.6752, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.65% (1.7688 => 1.8334, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/salsa20: 3.59% (7.4271 => 7.6941, std. dev.: 0.0048) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 3.25% (0.9692 => 1.0007, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 3.03% (8.8259 => 9.0933, std. dev.: 0.0131) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4534, std. dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.29% (7.9275 => 8.1090, std. dev.: 0.0179) SingleSource/Benchmarks/Misc/ffbench: 2.24% (0.8273 => 0.8458, std. dev.: 0.0011) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9601, std. dev.: 0.0011) MultiSource/Benchmarks/sim/sim: 1.54% (5.0168 => 5.0940, std. dev.: 0.0034) MultiSource/Applications/lemon/lemon: 1.31% (1.4298 => 1.4486, std. dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.29% (2.0200 => 2.0460, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.51% (22.5627 => 21.0941, std. dev.: 0.0173) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.48% (0.2670 => 0.2497, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.04% (0.3511 => 0.3299, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.57% (0.8818 => 0.8591, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.82% (0.6576 => 0.6456, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: -1.78% (0.6250 => 0.6139, std. dev.: 0.0003) MultiSource/Applications/lua/lua: -1.28% (3.7467 => 3.6986, std. dev.: 0.0040) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/richards_benchmark: -12.55% (1.1560 => 1.0109, std. dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.11% (1.0460 => 0.9402, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.05% (1.2308 => 1.1071, std. dev.: 0.0028) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.56% (0.3139 => 0.2933, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.46% (1.3780 => 1.3027, std. dev.: 0.0067) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9474, std. dev.: 0.0003) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.33% (0.2333 => 0.2232, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.75% (1.9762 => 1.9020, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.97% (6.3560 => 6.2306, std. dev.: 0.0065) MultiSource/Applications/minisat/minisat: -1.94% (9.3358 => 9.1548, std. dev.: 0.0140) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.89% (6.6320 => 6.5064, std. dev.: 0.0021) MultiSource/Applications/spiff/spiff: -1.85% (3.0263 => 2.9703, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.67% (7.1097 => 6.9913, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.66% (20.3410 => 20.0033, std. dev.: 0.0692) MultiSource/Benchmarks/Bullet/bullet: -1.52% (7.3305 => 7.2188, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout/heapsort: -1.45% (3.9173 => 3.8605, std. dev.: 0.0057) MultiSource/Applications/lua/lua: -1.29% (26.5159 => 26.1732, std. dev.: 0.0375) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.03% (3.8887 => 3.8487, std. dev.: 0.0129) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.57s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri May 4 12:47:58 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 4 May 2012 14:47:58 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120504194758.9CA3E2A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/526?compare_to=525&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 526, Order: 156185, Start Time: 2012-05-04 18:51:20, End Time: 2012-05-04 19:48:33 To: 525, Order: 156178, Start Time: 2012-05-04 17:27:56, End Time: 2012-05-04 18:25:02 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (47 on baseline) Performance Improvements: 0 (28 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (813 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.01% (2.0176 => 2.2801, std. dev.: 0.0160) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.15% (0.2721 => 0.2834, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.58% (0.3130 => 0.3242, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.38% (3.9660 => 4.1001, std. dev.: 0.0152) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.15% (0.5265 => 0.5431, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/hash2: 2.80% (0.4328 => 0.4449, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 2.79% (13.8202 => 14.2053, std. dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.51% (0.6959 => 0.7134, std. dev.: 0.0031) MultiSource/Benchmarks/nbench/nbench: 2.50% (1.0594 => 1.0859, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.39% (1.2193 => 1.2485, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.33% (0.9199 => 0.9413, std. dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 2.32% (16.6129 => 16.9979, std. dev.: 0.0135) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.29% (0.5637 => 0.5766, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.18% (1.1364 => 1.1612, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: 2.08% (0.8310 => 0.8483, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.99% (1.4563 => 1.4853, std. dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: 1.88% (0.7038 => 0.7170, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.75% (0.7710 => 0.7845, std. dev.: 0.0008) MultiSource/Applications/siod/siod: 1.69% (2.1791 => 2.2159, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.66% (1.3245 => 1.3465, std. dev.: 0.0045) MultiSource/Benchmarks/MallocBench/gs/gs: 1.63% (3.8646 => 3.9277, std. dev.: 0.0104) MultiSource/Applications/Burg/burg: 1.63% (1.1061 => 1.1241, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.50% (1.3813 => 1.4020, std. dev.: 0.0005) MultiSource/Applications/treecc/treecc: 1.47% (1.9270 => 1.9553, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.44% (1.3819 => 1.4018, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.43% (0.7460 => 0.7567, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.40% (13.2842 => 13.4698, std. dev.: 0.0131) MultiSource/Applications/hbd/hbd: 1.39% (1.3693 => 1.3884, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.30% (2.1007 => 2.1281, std. dev.: 0.0071) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.21% (3.6692 => 3.7137, std. dev.: 0.0031) MultiSource/Applications/hexxagon/hexxagon: 1.19% (1.2292 => 1.2438, std. dev.: 0.0006) MultiSource/Applications/SIBsim4/SIBsim4: 1.12% (1.2749 => 1.2892, std. dev.: 0.0012) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.03% (1.8175 => 2.2543, std. dev.: 0.0056) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7298, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6755, std. dev.: 0.0058) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8146, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: 3.64% (7.4271 => 7.6974, std. dev.: 0.0080) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.58% (1.7688 => 1.8322, std. dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 3.22% (0.9692 => 1.0004, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 2.98% (12.0921 => 12.4524, std. dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.38% (7.9275 => 8.1164, std. dev.: 0.0139) SingleSource/Benchmarks/Misc/ffbench: 2.21% (0.8273 => 0.8456, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.29% (2.0200 => 2.0461, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: 1.27% (1.4298 => 1.4479, std. dev.: 0.0008) MultiSource/Benchmarks/sim/sim: 1.25% (5.0168 => 5.0797, std. dev.: 0.0087) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0035) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -15.48% (0.4657 => 0.3936, std. dev.: 0.0088) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.48% (0.2670 => 0.2497, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.39% (22.5627 => 21.1203, std. dev.: 0.0056) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.04% (0.3511 => 0.3299, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.64% (0.8818 => 0.8585, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.89% (0.6576 => 0.6452, std. dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/bigfib: -1.63% (0.6250 => 0.6148, std. dev.: 0.0003) MultiSource/Applications/lua/lua: -1.27% (3.7467 => 3.6990, std. dev.: 0.0010) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/richards_benchmark: -12.67% (1.1560 => 1.0095, std. dev.: 0.0053) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.12% (1.0460 => 0.9401, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -9.99% (1.2308 => 1.1078, std. dev.: 0.0040) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.59% (0.3139 => 0.2932, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9473, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.58% (1.3780 => 1.3149, std. dev.: 0.0044) MultiSource/Benchmarks/FreeBench/neural/neural: -4.33% (0.2333 => 0.2232, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.73% (0.3458 => 0.3329, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -3.71% (1.9762 => 1.9028, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/lists: -2.17% (6.3560 => 6.2183, std. dev.: 0.0085) MultiSource/Applications/minisat/minisat: -2.01% (9.3358 => 9.1477, std. dev.: 0.0257) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.87% (6.6320 => 6.5079, std. dev.: 0.0026) MultiSource/Applications/spiff/spiff: -1.77% (3.0263 => 2.9728, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3444, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.67% (20.3410 => 20.0019, std. dev.: 0.0443) SingleSource/Benchmarks/Misc/ReedSolomon: -1.66% (7.1097 => 6.9915, std. dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -1.51% (7.3305 => 7.2199, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout/heapsort: -1.40% (3.9173 => 3.8623, std. dev.: 0.0004) MultiSource/Applications/lua/lua: -1.30% (26.5159 => 26.1724, std. dev.: 0.0152) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.33s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri May 4 14:11:15 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 4 May 2012 16:11:15 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120504211115.902CE2A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/527?compare_to=526&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 527, Order: 156194, Start Time: 2012-05-04 20:14:48, End Time: 2012-05-04 21:11:50 To: 526, Order: 156185, Start Time: 2012-05-04 18:51:20, End Time: 2012-05-04 19:48:33 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (42 on baseline) Performance Improvements: 8 (41 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 883 (805 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 7.66% (3.7692 => 4.0578, std. dev.: 0.0747) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC++/property-reference-object: -2.78% (0.5870 => 0.5707, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: -2.63% (0.3879 => 0.3777, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -2.63% (0.3958 => 0.3854, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: -2.61% (0.5785 => 0.5634, std. dev.: 0.0019) SingleSource/UnitTests/ObjC/block-byref-aggr: -2.59% (0.3936 => 0.3834, std. dev.: 0.0030) SingleSource/UnitTests/ObjC++/property-reference: -2.47% (0.7139 => 0.6963, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.41% (1.9969 => 1.9688, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: -1.08% (1.2438 => 1.2304, std. dev.: 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.74% (2.0176 => 2.2747, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.12% (0.2721 => 0.2833, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.32% (0.3130 => 0.3234, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.95% (3.9660 => 4.0829, std. dev.: 0.0053) MultiSource/Applications/SPASS/SPASS: 2.45% (13.8202 => 14.1583, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.30% (0.5265 => 0.5386, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.23% (0.6959 => 0.7114, std. dev.: 0.0036) MultiSource/Benchmarks/nbench/nbench: 2.22% (1.0594 => 1.0829, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.07% (1.2193 => 1.2445, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.98% (1.1364 => 1.1589, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.93% (0.9199 => 0.9377, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/football/football: 1.91% (0.8310 => 0.8469, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.84% (0.5637 => 0.5741, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.49% (1.4563 => 1.4780, std. dev.: 0.0024) MultiSource/Applications/siod/siod: 1.45% (2.1791 => 2.2108, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.44% (1.3819 => 1.4018, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.39% (1.3813 => 1.4005, std. dev.: 0.0012) MultiSource/Applications/kimwitu++/kc: 1.38% (16.6129 => 16.8415, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.32% (13.2842 => 13.4601, std. dev.: 0.0034) MultiSource/Benchmarks/MallocBench/gs/gs: 1.27% (3.8646 => 3.9138, std. dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.27% (1.3245 => 1.3413, std. dev.: 0.0022) MultiSource/Applications/treecc/treecc: 1.11% (1.9270 => 1.9483, std. dev.: 0.0050) MultiSource/Applications/Burg/burg: 1.10% (1.1061 => 1.1183, std. dev.: 0.0012) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 23.90% (1.8175 => 2.2518, std. dev.: 0.0444) MultiSource/Benchmarks/llubenchmark/llu: 7.55% (3.7731 => 4.0578, std. dev.: 0.0747) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.89% (1.5824 => 1.6756, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8146, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 3.78% (7.4271 => 7.7075, std. dev.: 0.0022) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.64% (1.7688 => 1.8332, std. dev.: 0.0046) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 3.26% (0.9692 => 1.0008, std. dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4539, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.76% (8.8259 => 9.0695, std. dev.: 0.0119) SingleSource/Benchmarks/Misc/ffbench: 2.59% (0.8273 => 0.8487, std. dev.: 0.0038) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.43% (7.9275 => 8.1205, std. dev.: 0.0143) SingleSource/Benchmarks/Dhrystone/fldry: 1.92% (1.9290 => 1.9660, std. dev.: 0.0050) MultiSource/Benchmarks/sim/sim: 1.48% (5.0168 => 5.0908, std. dev.: 0.0031) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.29% (2.0200 => 2.0460, std. dev.: 0.0042) MultiSource/Applications/lemon/lemon: 1.20% (1.4298 => 1.4469, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 1.10% (5.3167 => 5.3751, std. dev.: 0.0057) MultiSource/Applications/JM/lencod/lencod: 1.00% (7.6086 => 7.6847, std. dev.: 0.0045) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -17.67% (0.4657 => 0.3834, std. dev.: 0.0030) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.62% (22.5627 => 21.0692, std. dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.48% (0.2670 => 0.2497, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.95% (0.3511 => 0.3302, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.47% (0.3650 => 0.3487, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -4.44% (0.3623 => 0.3462, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -4.39% (0.3601 => 0.3443, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: -4.33% (0.3578 => 0.3423, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: -4.31% (0.3646 => 0.3489, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -4.20% (0.3663 => 0.3509, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/property: -4.14% (0.3940 => 0.3777, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -4.04% (0.3789 => 0.3636, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -3.83% (0.3914 => 0.3764, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: -3.72% (0.4003 => 0.3854, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: -2.69% (0.6250 => 0.6082, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.64% (0.8818 => 0.8585, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/Hello: -1.98% (0.5748 => 0.5634, std. dev.: 0.0019) SingleSource/UnitTests/ObjC++/property-reference-object: -1.91% (0.5818 => 0.5707, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.70% (0.6576 => 0.6464, std. dev.: 0.0025) MultiSource/Applications/lua/lua: -1.41% (3.7467 => 3.6937, std. dev.: 0.0016) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/richards_benchmark: -12.83% (1.1560 => 1.0077, std. dev.: 0.0059) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.12% (1.0460 => 0.9401, std. dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: -9.87% (1.2308 => 1.1093, std. dev.: 0.0037) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.59% (0.3139 => 0.2932, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.46% (1.3780 => 1.3028, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9473, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.33% (0.2333 => 0.2232, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.76% (0.3458 => 0.3328, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -3.67% (1.9762 => 1.9036, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout/lists: -2.17% (6.3560 => 6.2180, std. dev.: 0.0097) MultiSource/Applications/minisat/minisat: -2.02% (9.3358 => 9.1474, std. dev.: 0.0123) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.93% (6.6320 => 6.5039, std. dev.: 0.0015) MultiSource/Applications/spiff/spiff: -1.80% (3.0263 => 2.9718, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3444, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.66% (7.1097 => 6.9915, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.57% (20.3410 => 20.0226, std. dev.: 0.0570) SingleSource/Benchmarks/Shootout/heapsort: -1.41% (3.9173 => 3.8619, std. dev.: 0.0094) MultiSource/Benchmarks/Bullet/bullet: -1.38% (7.3305 => 7.2291, std. dev.: 0.0132) MultiSource/Applications/lua/lua: -1.31% (26.5159 => 26.1677, std. dev.: 0.0180) MultiSource/Benchmarks/nbench/nbench: -1.00% (11.2619 => 11.1491, std. dev.: 0.0019) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.67s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri May 4 15:35:07 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 4 May 2012 17:35:07 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120504223507.4CB192A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/528?compare_to=527&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 528, Order: 156202, Start Time: 2012-05-04 21:38:42, End Time: 2012-05-04 22:35:42 To: 527, Order: 156194, Start Time: 2012-05-04 20:14:48, End Time: 2012-05-04 21:11:50 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 3 (45 on baseline) Performance Improvements: 1 (39 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 888 (804 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC++/property-reference-object: 1.77% (0.5707 => 0.5808, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 1.61% (0.6963 => 0.7075, std. dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.75% (4.3766 => 4.4533, std. dev.: 0.0044) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -7.21% (4.0578 => 3.7651, std. dev.: 0.0425) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.37% (2.0176 => 2.2671, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.75% (0.2721 => 0.2823, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.26% (0.3130 => 0.3232, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.97% (3.9660 => 4.0839, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.72% (0.5265 => 0.5408, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 2.55% (13.8202 => 14.1731, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.31% (1.2193 => 1.2475, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.29% (0.5637 => 0.5766, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.23% (0.6959 => 0.7114, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 2.19% (1.0594 => 1.0826, std. dev.: 0.0036) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.04% (1.1364 => 1.1596, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/football/football: 2.02% (0.8310 => 0.8478, std. dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.99% (0.9199 => 0.9382, std. dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 1.91% (16.6129 => 16.9303, std. dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.62% (3.2742 => 3.3273, std. dev.: 0.0061) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.62% (1.4563 => 1.4799, std. dev.: 0.0016) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.56% (0.7710 => 0.7830, std. dev.: 0.0014) MultiSource/Applications/hbd/hbd: 1.42% (1.3693 => 1.3888, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.37% (1.3819 => 1.4009, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.37% (13.2842 => 13.4667, std. dev.: 0.0056) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.37% (0.7460 => 0.7562, std. dev.: 0.0014) MultiSource/Applications/siod/siod: 1.31% (2.1791 => 2.2076, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 1.29% (1.1061 => 1.1204, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.27% (1.3813 => 1.3988, std. dev.: 0.0029) MultiSource/Benchmarks/MallocBench/gs/gs: 1.26% (3.8646 => 3.9132, std. dev.: 0.0016) MultiSource/Applications/treecc/treecc: 1.14% (1.9270 => 1.9489, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.12% (1.3245 => 1.3394, std. dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 23.98% (1.8175 => 2.2533, std. dev.: 0.0491) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7298, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6754, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 3.66% (7.4271 => 7.6988, std. dev.: 0.0081) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.53% (1.7688 => 1.8313, std. dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 3.25% (0.9692 => 1.0007, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.02% (12.0921 => 12.4569, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.70% (8.8259 => 9.0642, std. dev.: 0.0201) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.67% (7.9275 => 8.1395, std. dev.: 0.0042) SingleSource/Benchmarks/Misc/ffbench: 2.25% (0.8273 => 0.8459, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/bisort/bisort: 1.30% (0.8239 => 0.8346, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.29% (2.0200 => 2.0461, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.17% (1.4298 => 1.4465, std. dev.: 0.0010) MultiSource/Benchmarks/sim/sim: 1.14% (5.0168 => 5.0738, std. dev.: 0.0116) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.07% (4.4062 => 4.4533, std. dev.: 0.0044) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.45% (0.2670 => 0.2471, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.49% (0.3511 => 0.3283, std. dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.34% (22.5627 => 21.1314, std. dev.: 0.0053) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.86% (0.3650 => 0.3509, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: -3.73% (0.3623 => 0.3488, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -3.69% (0.3601 => 0.3468, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -3.59% (0.3646 => 0.3515, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -3.58% (0.3663 => 0.3532, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: -3.55% (0.3940 => 0.3800, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -3.52% (0.3578 => 0.3452, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -3.40% (0.3789 => 0.3660, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -3.22% (0.3914 => 0.3788, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.14% (0.8818 => 0.8541, std. dev.: 0.0036) SingleSource/UnitTests/ObjC/parameter-passing: -3.10% (0.4003 => 0.3879, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: -2.11% (0.6250 => 0.6118, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.70% (0.6576 => 0.6464, std. dev.: 0.0001) MultiSource/Applications/lua/lua: -1.46% (3.7467 => 3.6921, std. dev.: 0.0056) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.21% (0.9108 => 0.8998, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/richards_benchmark: -12.81% (1.1560 => 1.0079, std. dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.12% (1.0460 => 0.9401, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -9.77% (1.2308 => 1.1105, std. dev.: 0.0033) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.59% (0.3139 => 0.2932, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.20% (1.3780 => 1.3064, std. dev.: 0.0118) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9473, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.33% (0.2333 => 0.2232, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.67% (0.3458 => 0.3331, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.67% (1.9762 => 1.9037, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout/lists: -2.08% (6.3560 => 6.2236, std. dev.: 0.0045) MultiSource/Applications/minisat/minisat: -2.06% (9.3358 => 9.1437, std. dev.: 0.0048) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.86% (6.6320 => 6.5084, std. dev.: 0.0049) MultiSource/Applications/spiff/spiff: -1.76% (3.0263 => 2.9731, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3446, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.66% (7.1097 => 6.9918, std. dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -1.57% (7.3305 => 7.2155, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout/heapsort: -1.39% (3.9173 => 3.8629, std. dev.: 0.0048) MultiSource/Applications/lua/lua: -1.34% (26.5159 => 26.1607, std. dev.: 0.0127) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.04% (20.3410 => 20.1292, std. dev.: 0.0110) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.02% (3.8887 => 3.8491, std. dev.: 0.0032) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.42s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri May 4 16:58:58 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 4 May 2012 18:58:58 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120504235858.DE8362A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/529?compare_to=528&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 529, Order: 156215, Start Time: 2012-05-04 23:02:34, End Time: 2012-05-04 23:59:33 To: 528, Order: 156202, Start Time: 2012-05-04 21:38:42, End Time: 2012-05-04 22:35:42 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (39 on baseline) Performance Improvements: 1 (38 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 890 (811 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 1.18% (3.7651 => 3.8097, std. dev.: 0.0098) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.67% (4.4533 => 4.3788, std. dev.: 0.0128) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.26% (2.0176 => 2.2650, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.40% (3.9660 => 4.1007, std. dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.32% (0.5265 => 0.5387, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 2.31% (13.8202 => 14.1399, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.09% (0.5637 => 0.5755, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.00% (0.6959 => 0.7098, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.91% (0.9199 => 0.9375, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.90% (1.2193 => 1.2425, std. dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 1.90% (1.0594 => 1.0795, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 1.87% (0.8310 => 0.8465, std. dev.: 0.0024) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.83% (0.7710 => 0.7851, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.80% (1.1364 => 1.1568, std. dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 1.55% (16.6129 => 16.8706, std. dev.: 0.0067) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.43% (1.4563 => 1.4771, std. dev.: 0.0021) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.38% (0.7460 => 0.7563, std. dev.: 0.0006) MultiSource/Applications/Burg/burg: 1.29% (1.1061 => 1.1204, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.20% (1.3813 => 1.3979, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.19% (1.3819 => 1.3984, std. dev.: 0.0016) MultiSource/Benchmarks/MallocBench/gs/gs: 1.14% (3.8646 => 3.9087, std. dev.: 0.0063) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.13% (13.2842 => 13.4342, std. dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.06% (1.3245 => 1.3385, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 1.05% (2.1791 => 2.2020, std. dev.: 0.0020) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 23.98% (1.8175 => 2.2534, std. dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7298, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.86% (1.5824 => 1.6752, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8146, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.70% (1.7688 => 1.8342, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/salsa20: 3.54% (7.4271 => 7.6900, std. dev.: 0.0033) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 3.27% (0.9692 => 1.0009, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.01% (12.0921 => 12.4559, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.70% (8.8259 => 9.0646, std. dev.: 0.0096) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.32% (7.9275 => 8.1117, std. dev.: 0.0085) SingleSource/Benchmarks/Misc/ffbench: 2.19% (0.8273 => 0.8454, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: 1.37% (5.0168 => 5.0854, std. dev.: 0.0074) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.27% (2.0200 => 2.0456, std. dev.: 0.0004) MultiSource/Applications/lemon/lemon: 1.23% (1.4298 => 1.4474, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2135, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 1.05% (10.7476 => 10.8606, std. dev.: 0.0390) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -19.73% (0.4657 => 0.3738, std. dev.: 0.0171) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.38% (0.2670 => 0.2473, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.95% (0.3511 => 0.3267, std. dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.61% (22.5627 => 21.0719, std. dev.: 0.0092) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.86% (0.3650 => 0.3509, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-3: -3.78% (0.3623 => 0.3486, std. dev.: 0.0024) SingleSource/UnitTests/ObjC/exceptions-2: -3.67% (0.3601 => 0.3469, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -3.61% (0.3578 => 0.3449, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: -3.55% (0.3663 => 0.3533, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -3.54% (0.3646 => 0.3517, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.45% (0.8818 => 0.8514, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: -3.40% (0.3940 => 0.3806, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -3.33% (0.3789 => 0.3663, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -3.24% (0.3914 => 0.3787, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -3.10% (0.4003 => 0.3879, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.95% (0.6576 => 0.6448, std. dev.: 0.0023) MultiSource/Applications/lua/lua: -1.71% (3.7467 => 3.6827, std. dev.: 0.0051) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.27% (0.9108 => 0.8992, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/richards_benchmark: -12.83% (1.1560 => 1.0077, std. dev.: 0.0088) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.11% (1.0460 => 0.9402, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -9.73% (1.2308 => 1.1110, std. dev.: 0.0030) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.59% (0.3139 => 0.2932, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9472, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.62% (1.3780 => 1.3144, std. dev.: 0.0033) MultiSource/Benchmarks/FreeBench/neural/neural: -4.33% (0.2333 => 0.2232, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.73% (0.3458 => 0.3329, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.64% (1.9762 => 1.9043, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -2.12% (6.3560 => 6.2211, std. dev.: 0.0119) MultiSource/Applications/minisat/minisat: -2.01% (9.3358 => 9.1486, std. dev.: 0.0156) MultiSource/Applications/spiff/spiff: -1.77% (3.0263 => 2.9726, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.77% (6.6320 => 6.5149, std. dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.69% (20.3410 => 19.9982, std. dev.: 0.0560) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3444, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.67% (7.1097 => 6.9913, std. dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -1.48% (7.3305 => 7.2217, std. dev.: 0.0006) MultiSource/Applications/lua/lua: -1.42% (26.5159 => 26.1392, std. dev.: 0.0197) SingleSource/Benchmarks/Shootout/heapsort: -1.41% (3.9173 => 3.8620, std. dev.: 0.0060) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.92s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri May 4 19:40:10 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 4 May 2012 21:40:10 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120505024010.1A5B02A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/530?compare_to=529&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 530, Order: 156222, Start Time: 2012-05-05 01:43:38, End Time: 2012-05-05 02:40:44 To: 529, Order: 156215, Start Time: 2012-05-04 23:02:34, End Time: 2012-05-04 23:59:33 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 10 (56 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 882 (798 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.29% (2.2650 => 2.2942, std. dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 1.29% (4.6553 => 4.7153, std. dev.: 0.0060) MultiSource/Benchmarks/nbench/nbench: 1.27% (1.0795 => 1.0932, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.20% (0.8992 => 0.9100, std. dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.19% (3.6936 => 3.7375, std. dev.: 0.0039) MultiSource/Benchmarks/mafft/pairlocalalign: 1.14% (8.4861 => 8.5827, std. dev.: 0.0100) MultiSource/Applications/SPASS/SPASS: 1.06% (14.1399 => 14.2901, std. dev.: 0.0038) MultiSource/Applications/kimwitu++/kc: 1.04% (16.8706 => 17.0468, std. dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.02% (1.2425 => 1.2552, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.00% (4.4354 => 4.4799, std. dev.: 0.0020) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.71% (2.0176 => 2.2942, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.37% (0.2721 => 0.2840, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.79% (3.9660 => 4.1164, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.77% (0.3130 => 0.3248, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 3.40% (13.8202 => 14.2901, std. dev.: 0.0038) MultiSource/Benchmarks/nbench/nbench: 3.19% (1.0594 => 1.0932, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.04% (0.5265 => 0.5425, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.03% (0.6959 => 0.7170, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.94% (1.2193 => 1.2552, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 2.87% (0.4328 => 0.4452, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: 2.80% (0.8310 => 0.8543, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.69% (0.9199 => 0.9446, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.68% (1.1364 => 1.1669, std. dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 2.61% (16.6129 => 17.0468, std. dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.59% (0.5637 => 0.5783, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.30% (1.4563 => 1.4898, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.21% (0.4791 => 0.4897, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 2.14% (3.8646 => 3.9473, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.03% (0.5577 => 0.5690, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 2.01% (2.1791 => 2.2228, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.96% (1.3245 => 1.3505, std. dev.: 0.0005) MultiSource/Applications/Burg/burg: 1.94% (1.1061 => 1.1276, std. dev.: 0.0000) MultiSource/Applications/hbd/hbd: 1.91% (1.3693 => 1.3955, std. dev.: 0.0025) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.87% (0.7710 => 0.7854, std. dev.: 0.0032) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.86% (3.6692 => 3.7375, std. dev.: 0.0039) MultiSource/Applications/lambda-0_1_3/lambda: 1.86% (0.7038 => 0.7169, std. dev.: 0.0024) MultiSource/Applications/treecc/treecc: 1.81% (1.9270 => 1.9618, std. dev.: 0.0024) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.79% (1.3813 => 1.4060, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.77% (1.3819 => 1.4064, std. dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.75% (0.6283 => 0.6393, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.70% (13.2842 => 13.5100, std. dev.: 0.0055) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.68% (3.2742 => 3.3291, std. dev.: 0.0205) MultiSource/Applications/minisat/minisat: 1.66% (0.6744 => 0.6856, std. dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 1.46% (14.8535 => 15.0700, std. dev.: 0.0054) MultiSource/Applications/JM/ldecod/ldecod: 1.42% (6.5754 => 6.6686, std. dev.: 0.0056) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.42% (1.5188 => 1.5403, std. dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: 1.20% (16.2614 => 16.4568, std. dev.: 0.0128) MultiSource/Applications/oggenc/oggenc: 1.12% (4.6629 => 4.7153, std. dev.: 0.0060) MultiSource/Applications/d/make_dparser: 1.09% (3.1889 => 3.2237, std. dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: 1.02% (8.4961 => 8.5827, std. dev.: 0.0100) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 23.86% (1.8175 => 2.2512, std. dev.: 0.0525) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.86% (1.5824 => 1.6752, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8146, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 3.64% (7.4271 => 7.6975, std. dev.: 0.0059) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.64% (1.7688 => 1.8331, std. dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 3.27% (0.9692 => 1.0009, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4540, std. dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.73% (8.8259 => 9.0669, std. dev.: 0.0138) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.45% (7.9275 => 8.1219, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/ffbench: 2.20% (0.8273 => 0.8455, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9601, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.36% (1.4298 => 1.4492, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.26% (2.0200 => 2.0454, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 1.08% (5.0168 => 5.0712, std. dev.: 0.0058) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -20.68% (0.4657 => 0.3694, std. dev.: 0.0042) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.89% (0.2670 => 0.2486, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.21% (0.3511 => 0.3293, std. dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.70% (22.5627 => 21.2769, std. dev.: 0.0059) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.62% (0.3650 => 0.3518, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-3: -3.48% (0.3623 => 0.3497, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -3.42% (0.3601 => 0.3478, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -3.37% (0.3646 => 0.3523, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -3.35% (0.3578 => 0.3458, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -3.25% (0.3663 => 0.3544, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -3.12% (0.3940 => 0.3817, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -3.06% (0.3789 => 0.3673, std. dev.: 0.0017) SingleSource/UnitTests/ObjC/exceptions: -2.94% (0.3914 => 0.3799, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.78% (0.8818 => 0.8573, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: -2.67% (0.4003 => 0.3896, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/richards_benchmark: -12.56% (1.1560 => 1.0108, std. dev.: 0.0043) SingleSource/Benchmarks/McGill/chomp: -10.74% (1.2308 => 1.0986, std. dev.: 0.0075) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.12% (1.0460 => 0.9401, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.56% (0.3139 => 0.2933, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9472, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -3.68% (1.9762 => 1.9034, std. dev.: 0.0048) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.59% (0.3458 => 0.3334, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -2.12% (6.3560 => 6.2211, std. dev.: 0.0056) MultiSource/Applications/minisat/minisat: -2.00% (9.3358 => 9.1487, std. dev.: 0.0095) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.98% (6.6320 => 6.5010, std. dev.: 0.0058) MultiSource/Applications/spiff/spiff: -1.75% (3.0263 => 2.9732, std. dev.: 0.0099) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.66% (7.1097 => 6.9917, std. dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -1.54% (7.3305 => 7.2179, std. dev.: 0.0059) SingleSource/Benchmarks/Shootout/heapsort: -1.36% (3.9173 => 3.8639, std. dev.: 0.0066) MultiSource/Applications/lua/lua: -1.23% (26.5159 => 26.1907, std. dev.: 0.0325) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.05% (20.3410 => 20.1270, std. dev.: 0.0286) MultiSource/Benchmarks/nbench/nbench: -1.03% (11.2619 => 11.1461, std. dev.: 0.0045) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.95s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri May 4 21:04:07 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 4 May 2012 23:04:07 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120505040407.BDB532A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/531?compare_to=530&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 531, Order: 156226, Start Time: 2012-05-05 03:07:36, End Time: 2012-05-05 04:04:42 To: 530, Order: 156222, Start Time: 2012-05-05 01:43:38, End Time: 2012-05-05 02:40:44 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (60 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (792 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.76% (2.0176 => 2.2952, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.37% (0.2721 => 0.2840, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.96% (0.3130 => 0.3254, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.89% (3.9660 => 4.1202, std. dev.: 0.0044) MultiSource/Benchmarks/nbench/nbench: 3.32% (1.0594 => 1.0946, std. dev.: 0.0021) MultiSource/Applications/SPASS/SPASS: 3.28% (13.8202 => 14.2732, std. dev.: 0.0165) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.02% (0.5265 => 0.5424, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash2: 2.96% (0.4328 => 0.4456, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.95% (0.6959 => 0.7164, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/football/football: 2.92% (0.8310 => 0.8553, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.86% (1.2193 => 1.2542, std. dev.: 0.0017) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.74% (1.1364 => 1.1675, std. dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: 2.69% (16.6129 => 17.0594, std. dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.62% (0.9199 => 0.9440, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.59% (0.5637 => 0.5783, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.36% (1.4563 => 1.4906, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.34% (0.4791 => 0.4903, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.10% (0.5577 => 0.5694, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.08% (0.7710 => 0.7870, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.07% (2.1007 => 2.1441, std. dev.: 0.0012) MultiSource/Applications/siod/siod: 2.04% (2.1791 => 2.2235, std. dev.: 0.0017) MultiSource/Benchmarks/MallocBench/gs/gs: 2.02% (3.8646 => 3.9428, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.02% (1.3819 => 1.4098, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.01% (0.7460 => 0.7610, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.01% (1.3245 => 1.3511, std. dev.: 0.0013) MultiSource/Applications/hbd/hbd: 1.92% (1.3693 => 1.3956, std. dev.: 0.0029) MultiSource/Applications/lambda-0_1_3/lambda: 1.92% (0.7038 => 0.7173, std. dev.: 0.0006) MultiSource/Applications/Burg/burg: 1.90% (1.1061 => 1.1271, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.87% (3.6692 => 3.7377, std. dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.85% (0.6283 => 0.6399, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 1.81% (1.9270 => 1.9618, std. dev.: 0.0019) MultiSource/Applications/SIBsim4/SIBsim4: 1.80% (1.2749 => 1.2978, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.78% (3.2742 => 3.3325, std. dev.: 0.0116) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.77% (1.3813 => 1.4058, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.68% (13.2842 => 13.5078, std. dev.: 0.0080) MultiSource/Applications/minisat/minisat: 1.66% (0.6744 => 0.6856, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.57% (1.5188 => 1.5426, std. dev.: 0.0022) MultiSource/Applications/JM/lencod/lencod: 1.52% (14.8535 => 15.0788, std. dev.: 0.0029) MultiSource/Applications/JM/ldecod/ldecod: 1.47% (6.5754 => 6.6722, std. dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: 1.33% (16.2614 => 16.4780, std. dev.: 0.0022) MultiSource/Applications/hexxagon/hexxagon: 1.20% (1.2292 => 1.2440, std. dev.: 0.0006) MultiSource/Applications/d/make_dparser: 1.16% (3.1889 => 3.2259, std. dev.: 0.0054) MultiSource/Benchmarks/mafft/pairlocalalign: 1.14% (8.4961 => 8.5927, std. dev.: 0.0052) MultiSource/Applications/oggenc/oggenc: 1.13% (4.6629 => 4.7157, std. dev.: 0.0010) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.36% (1.8175 => 2.2602, std. dev.: 0.0508) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.86% (1.5824 => 1.6752, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.69% (1.7688 => 1.8340, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/salsa20: 3.65% (7.4271 => 7.6979, std. dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 3.29% (0.9692 => 1.0011, std. dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4546, std. dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.90% (8.8259 => 9.0820, std. dev.: 0.0170) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.55% (7.9275 => 8.1294, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/ffbench: 2.19% (0.8273 => 0.8454, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: 1.46% (5.0168 => 5.0902, std. dev.: 0.0022) MultiSource/Applications/lemon/lemon: 1.29% (1.4298 => 1.4483, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.28% (2.0200 => 2.0459, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -18.02% (0.4657 => 0.3818, std. dev.: 0.0258) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.89% (0.2670 => 0.2486, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.27% (0.3511 => 0.3291, std. dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.65% (22.5627 => 21.2879, std. dev.: 0.0117) SingleSource/UnitTests/ObjC/exceptions-3: -3.59% (0.3623 => 0.3493, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.53% (0.3650 => 0.3521, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-2: -3.47% (0.3601 => 0.3476, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -3.35% (0.3646 => 0.3524, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -3.30% (0.3663 => 0.3542, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -3.30% (0.3578 => 0.3460, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -3.17% (0.3940 => 0.3815, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -2.96% (0.3789 => 0.3677, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -2.91% (0.3914 => 0.3800, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -2.70% (0.4003 => 0.3895, std. dev.: 0.0000) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/richards_benchmark: -12.77% (1.1560 => 1.0084, std. dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.12% (1.0460 => 0.9401, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -9.96% (1.2308 => 1.1082, std. dev.: 0.0036) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.44% (0.3139 => 0.2937, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.23% (1.3780 => 1.3059, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9472, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.33% (0.2333 => 0.2232, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.73% (0.3458 => 0.3329, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -3.70% (1.9762 => 1.9030, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout/lists: -2.21% (6.3560 => 6.2156, std. dev.: 0.0087) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -2.00% (6.6320 => 6.4991, std. dev.: 0.0028) MultiSource/Applications/minisat/minisat: -1.97% (9.3358 => 9.1518, std. dev.: 0.0060) MultiSource/Applications/spiff/spiff: -1.73% (3.0263 => 2.9739, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.67% (7.1097 => 6.9912, std. dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -1.53% (7.3305 => 7.2180, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.46% (20.3410 => 20.0446, std. dev.: 0.0687) SingleSource/Benchmarks/Shootout/heapsort: -1.33% (3.9173 => 3.8652, std. dev.: 0.0017) MultiSource/Applications/lua/lua: -1.27% (26.5159 => 26.1797, std. dev.: 0.0141) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.07% (3.8887 => 3.8470, std. dev.: 0.0033) MultiSource/Benchmarks/nbench/nbench: -1.00% (11.2619 => 11.1491, std. dev.: 0.0026) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.46s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri May 4 22:51:50 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 5 May 2012 00:51:50 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120505055150.087112A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/532?compare_to=531&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 532, Order: 156228, Start Time: 2012-05-05 04:55:11, End Time: 2012-05-05 05:52:25 To: 531, Order: 156226, Start Time: 2012-05-05 03:07:36, End Time: 2012-05-05 04:04:42 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (54 on baseline) Performance Improvements: 0 (30 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (804 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.79% (2.0176 => 2.2757, std. dev.: 0.0131) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.01% (0.2721 => 0.2830, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.74% (0.3130 => 0.3247, std. dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.60% (3.9660 => 4.1088, std. dev.: 0.0019) MultiSource/Applications/SPASS/SPASS: 3.21% (13.8202 => 14.2639, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.04% (0.5265 => 0.5425, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.96% (0.6959 => 0.7165, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 2.82% (1.0594 => 1.0893, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/football/football: 2.64% (0.8310 => 0.8529, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.60% (1.2193 => 1.2510, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.49% (0.9199 => 0.9428, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash2: 2.43% (0.4328 => 0.4433, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.41% (1.1364 => 1.1638, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.36% (0.5637 => 0.5770, std. dev.: 0.0016) MultiSource/Applications/kimwitu++/kc: 2.30% (16.6129 => 16.9945, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.27% (1.4563 => 1.4894, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/gs/gs: 2.19% (3.8646 => 3.9491, std. dev.: 0.0036) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.17% (0.7710 => 0.7877, std. dev.: 0.0006) MultiSource/Applications/siod/siod: 2.09% (2.1791 => 2.2247, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.04% (0.5577 => 0.5691, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.01% (0.7460 => 0.7610, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 1.93% (0.7038 => 0.7174, std. dev.: 0.0019) MultiSource/Applications/Burg/burg: 1.92% (1.1061 => 1.1273, std. dev.: 0.0060) MultiSource/Applications/treecc/treecc: 1.80% (1.9270 => 1.9616, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.74% (2.1007 => 2.1372, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.73% (1.3245 => 1.3474, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.70% (13.2842 => 13.5101, std. dev.: 0.0056) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.68% (1.3813 => 1.4045, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.68% (1.3819 => 1.4051, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.57% (3.6692 => 3.7268, std. dev.: 0.0056) MultiSource/Applications/SIBsim4/SIBsim4: 1.51% (1.2749 => 1.2941, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.40% (1.5188 => 1.5401, std. dev.: 0.0011) MultiSource/Applications/hbd/hbd: 1.36% (1.3693 => 1.3879, std. dev.: 0.0028) MultiSource/Applications/JM/ldecod/ldecod: 1.32% (6.5754 => 6.6622, std. dev.: 0.0136) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.30% (3.2742 => 3.3167, std. dev.: 0.0007) MultiSource/Applications/JM/lencod/lencod: 1.26% (14.8535 => 15.0413, std. dev.: 0.0170) MultiSource/Applications/sqlite3/sqlite3: 1.16% (16.2614 => 16.4504, std. dev.: 0.0179) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.03% (7.2180 => 7.2924, std. dev.: 0.0048) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.79% (1.8175 => 2.2680, std. dev.: 0.0423) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6754, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8146, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 3.75% (7.4271 => 7.7053, std. dev.: 0.0021) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.61% (1.7688 => 1.8327, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 3.29% (0.9692 => 1.0011, std. dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: 2.98% (12.0921 => 12.4522, std. dev.: 0.0022) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.94% (8.8259 => 9.0852, std. dev.: 0.0149) SingleSource/Benchmarks/Misc/ffbench: 2.25% (0.8273 => 0.8459, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.16% (7.9275 => 8.0986, std. dev.: 0.0236) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: 1.35% (5.0168 => 5.0844, std. dev.: 0.0081) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.30% (2.0200 => 2.0462, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.27% (1.4298 => 1.4480, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -17.91% (0.4657 => 0.3823, std. dev.: 0.0278) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.30% (0.2670 => 0.2475, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.32% (0.3511 => 0.3289, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.97% (22.5627 => 21.2160, std. dev.: 0.0035) SingleSource/UnitTests/ObjC/instance-method-metadata: -2.93% (0.3650 => 0.3543, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-3: -2.93% (0.3623 => 0.3517, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.77% (0.8818 => 0.8574, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: -1.84% (0.6250 => 0.6135, std. dev.: 0.0015) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/richards_benchmark: -13.04% (1.1560 => 1.0053, std. dev.: 0.0068) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.12% (1.0460 => 0.9401, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -9.98% (1.2308 => 1.1080, std. dev.: 0.0036) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.56% (0.3139 => 0.2933, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.91% (1.3780 => 1.3104, std. dev.: 0.0105) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9474, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.33% (0.2333 => 0.2232, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.73% (0.3458 => 0.3329, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -3.65% (1.9762 => 1.9040, std. dev.: 0.0085) SingleSource/Benchmarks/Shootout/lists: -2.02% (6.3560 => 6.2275, std. dev.: 0.0033) MultiSource/Applications/spiff/spiff: -1.88% (3.0263 => 2.9693, std. dev.: 0.0019) MultiSource/Applications/minisat/minisat: -1.86% (9.3358 => 9.1620, std. dev.: 0.0162) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.85% (6.6320 => 6.5094, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/ReedSolomon: -1.67% (7.1097 => 6.9913, std. dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -1.53% (7.3305 => 7.2185, std. dev.: 0.0073) SingleSource/Benchmarks/Shootout/heapsort: -1.41% (3.9173 => 3.8621, std. dev.: 0.0076) MultiSource/Applications/lua/lua: -1.27% (26.5159 => 26.1791, std. dev.: 0.0378) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.25% (20.3410 => 20.0860, std. dev.: 0.0238) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.10% (3.8887 => 3.8459, std. dev.: 0.0063) MultiSource/Benchmarks/nbench/nbench: -1.01% (11.2619 => 11.1485, std. dev.: 0.0018) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.09s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat May 5 01:42:30 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 5 May 2012 03:42:30 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120505084230.21B492A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/533?compare_to=532&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 533, Order: 156231, Start Time: 2012-05-05 07:45:39, End Time: 2012-05-05 08:43:05 To: 532, Order: 156228, Start Time: 2012-05-05 04:55:11, End Time: 2012-05-05 05:52:25 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (53 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (800 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.78% (2.0176 => 2.2754, std. dev.: 0.0065) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.15% (0.2721 => 0.2834, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.80% (0.3130 => 0.3249, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.49% (3.9660 => 4.1044, std. dev.: 0.0056) MultiSource/Applications/SPASS/SPASS: 2.98% (13.8202 => 14.2325, std. dev.: 0.0165) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.89% (0.6959 => 0.7160, std. dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.87% (0.5265 => 0.5416, std. dev.: 0.0036) MultiSource/Benchmarks/nbench/nbench: 2.66% (1.0594 => 1.0876, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/hash2: 2.66% (0.4328 => 0.4443, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 2.62% (0.8310 => 0.8528, std. dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.52% (1.2193 => 1.2500, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.44% (1.1364 => 1.1641, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.43% (0.5637 => 0.5774, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.42% (0.9199 => 0.9422, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.41% (0.7710 => 0.7896, std. dev.: 0.0012) MultiSource/Applications/kimwitu++/kc: 2.29% (16.6129 => 16.9938, std. dev.: 0.0115) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.12% (0.5577 => 0.5695, std. dev.: 0.0017) MultiSource/Applications/treecc/treecc: 2.01% (1.9270 => 1.9657, std. dev.: 0.0013) MultiSource/Applications/siod/siod: 1.98% (2.1791 => 2.2223, std. dev.: 0.0060) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.91% (1.4563 => 1.4841, std. dev.: 0.0030) MultiSource/Benchmarks/MallocBench/gs/gs: 1.91% (3.8646 => 3.9383, std. dev.: 0.0035) MultiSource/Applications/lambda-0_1_3/lambda: 1.86% (0.7038 => 0.7169, std. dev.: 0.0019) MultiSource/Applications/Burg/burg: 1.83% (1.1061 => 1.1263, std. dev.: 0.0026) MultiSource/Applications/hbd/hbd: 1.81% (1.3693 => 1.3941, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.78% (1.3245 => 1.3481, std. dev.: 0.0085) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.77% (0.7460 => 0.7592, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.67% (1.3813 => 1.4043, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.65% (2.1007 => 2.1354, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.64% (1.3819 => 1.4046, std. dev.: 0.0075) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.55% (13.2842 => 13.4904, std. dev.: 0.0087) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.46% (3.6692 => 3.7226, std. dev.: 0.0041) MultiSource/Applications/SIBsim4/SIBsim4: 1.32% (1.2749 => 1.2917, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.28% (3.2742 => 3.3160, std. dev.: 0.0013) MultiSource/Applications/JM/lencod/lencod: 1.25% (14.8535 => 15.0390, std. dev.: 0.0088) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.24% (1.5188 => 1.5377, std. dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 1.20% (16.2614 => 16.4564, std. dev.: 0.0080) MultiSource/Applications/JM/ldecod/ldecod: 1.12% (6.5754 => 6.6493, std. dev.: 0.0039) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.55% (1.8175 => 2.2637, std. dev.: 0.0129) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.86% (1.5824 => 1.6752, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.70% (1.7688 => 1.8342, std. dev.: 0.0049) SingleSource/Benchmarks/Misc/salsa20: 3.57% (7.4271 => 7.6926, std. dev.: 0.0055) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 3.27% (0.9692 => 1.0009, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.98% (8.8259 => 9.0889, std. dev.: 0.0050) MultiSource/Applications/hexxagon/hexxagon: 2.98% (12.0921 => 12.4520, std. dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.37% (7.9275 => 8.1150, std. dev.: 0.0100) SingleSource/Benchmarks/Misc/ffbench: 2.24% (0.8273 => 0.8458, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: 1.30% (5.0168 => 5.0822, std. dev.: 0.0053) MultiSource/Applications/lemon/lemon: 1.29% (1.4298 => 1.4482, std. dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.26% (2.0200 => 2.0455, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.12% (0.2670 => 0.2480, std. dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.98% (22.5627 => 21.2134, std. dev.: 0.0070) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.58% (0.3511 => 0.3315, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -3.95% (0.3623 => 0.3480, std. dev.: 0.0032) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.84% (0.3650 => 0.3510, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-2: -3.83% (0.3601 => 0.3463, std. dev.: 0.0031) SingleSource/UnitTests/ObjC/trivial-interface: -3.80% (0.3578 => 0.3442, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -3.74% (0.3663 => 0.3526, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -3.70% (0.3646 => 0.3511, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -3.53% (0.3940 => 0.3801, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -3.40% (0.3789 => 0.3660, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions: -3.30% (0.3914 => 0.3785, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.15% (0.8818 => 0.8540, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/parameter-passing: -3.07% (0.4003 => 0.3880, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.93% (0.6576 => 0.6449, std. dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/bigfib: -1.65% (0.6250 => 0.6147, std. dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/richards_benchmark: -12.60% (1.1560 => 1.0103, std. dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.12% (1.0460 => 0.9401, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -9.78% (1.2308 => 1.1104, std. dev.: 0.0009) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.59% (0.3139 => 0.2932, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9472, std. dev.: 0.0006) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.39% (1.3780 => 1.3175, std. dev.: 0.0048) MultiSource/Benchmarks/FreeBench/neural/neural: -4.33% (0.2333 => 0.2232, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.73% (0.3458 => 0.3329, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.65% (1.9762 => 1.9040, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -2.03% (6.3560 => 6.2271, std. dev.: 0.0029) MultiSource/Applications/minisat/minisat: -1.94% (9.3358 => 9.1545, std. dev.: 0.0112) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.86% (6.6320 => 6.5088, std. dev.: 0.0026) MultiSource/Applications/spiff/spiff: -1.78% (3.0263 => 2.9724, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.66% (7.1097 => 6.9915, std. dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -1.44% (7.3305 => 7.2247, std. dev.: 0.0177) SingleSource/Benchmarks/Shootout/heapsort: -1.43% (3.9173 => 3.8611, std. dev.: 0.0008) MultiSource/Applications/lua/lua: -1.18% (26.5159 => 26.2035, std. dev.: 0.0227) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.56s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat May 5 05:52:00 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 5 May 2012 07:52:00 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120505125200.22A9D2A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/534?compare_to=533&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 534, Order: 156232, Start Time: 2012-05-05 11:55:24, End Time: 2012-05-05 12:52:36 To: 533, Order: 156231, Start Time: 2012-05-05 07:45:39, End Time: 2012-05-05 08:43:05 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (52 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (801 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.88% (2.0176 => 2.2774, std. dev.: 0.0051) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.15% (0.2721 => 0.2834, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.70% (3.9660 => 4.1126, std. dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.67% (0.3130 => 0.3245, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 3.02% (13.8202 => 14.2377, std. dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.94% (0.5265 => 0.5420, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.83% (0.6959 => 0.7156, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 2.78% (1.0594 => 1.0888, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/hash2: 2.59% (0.4328 => 0.4440, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 2.54% (0.8310 => 0.8521, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.48% (1.2193 => 1.2495, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.46% (1.1364 => 1.1643, std. dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 2.44% (16.6129 => 17.0189, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.38% (0.9199 => 0.9418, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.29% (0.5637 => 0.5766, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.11% (0.7710 => 0.7873, std. dev.: 0.0020) MultiSource/Applications/lambda-0_1_3/lambda: 2.03% (0.7038 => 0.7181, std. dev.: 0.0035) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.01% (1.4563 => 1.4855, std. dev.: 0.0032) MultiSource/Applications/siod/siod: 1.96% (2.1791 => 2.2219, std. dev.: 0.0056) MultiSource/Applications/Burg/burg: 1.92% (1.1061 => 1.1273, std. dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.86% (0.5577 => 0.5681, std. dev.: 0.0034) MultiSource/Benchmarks/MallocBench/gs/gs: 1.86% (3.8646 => 3.9366, std. dev.: 0.0058) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.77% (0.7460 => 0.7592, std. dev.: 0.0012) MultiSource/Applications/treecc/treecc: 1.68% (1.9270 => 1.9593, std. dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.68% (2.1007 => 2.1359, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.66% (1.3819 => 1.4049, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.63% (13.2842 => 13.5001, std. dev.: 0.0159) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.58% (1.3245 => 1.3454, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.45% (3.6692 => 3.7225, std. dev.: 0.0070) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.44% (1.3813 => 1.4012, std. dev.: 0.0021) MultiSource/Applications/hbd/hbd: 1.42% (1.3693 => 1.3888, std. dev.: 0.0068) MultiSource/Applications/SIBsim4/SIBsim4: 1.40% (1.2749 => 1.2928, std. dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.26% (3.2742 => 3.3156, std. dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: 1.16% (16.2614 => 16.4493, std. dev.: 0.0043) MultiSource/Applications/JM/ldecod/ldecod: 1.15% (6.5754 => 6.6510, std. dev.: 0.0049) MultiSource/Applications/JM/lencod/lencod: 1.07% (14.8535 => 15.0127, std. dev.: 0.0029) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.12% (1.8175 => 2.2559, std. dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.86% (1.5824 => 1.6752, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: 3.71% (7.4271 => 7.7029, std. dev.: 0.0052) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.66% (1.7688 => 1.8335, std. dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 3.24% (0.9692 => 1.0006, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4546, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.77% (8.8259 => 9.0707, std. dev.: 0.0143) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.38% (7.9275 => 8.1165, std. dev.: 0.0087) SingleSource/Benchmarks/Misc/ffbench: 2.24% (0.8273 => 0.8458, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.28% (2.0200 => 2.0458, std. dev.: 0.0004) MultiSource/Applications/lemon/lemon: 1.24% (1.4298 => 1.4475, std. dev.: 0.0051) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0034) MultiSource/Benchmarks/sim/sim: 1.02% (5.0168 => 5.0681, std. dev.: 0.0141) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.08% (0.2670 => 0.2481, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.12% (0.3511 => 0.3296, std. dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.97% (22.5627 => 21.2165, std. dev.: 0.0068) SingleSource/UnitTests/ObjC/exceptions-3: -3.95% (0.3623 => 0.3480, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.92% (0.3650 => 0.3507, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -3.83% (0.3601 => 0.3463, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -3.80% (0.3578 => 0.3442, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -3.69% (0.3663 => 0.3528, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -3.68% (0.3646 => 0.3512, std. dev.: 0.0025) SingleSource/UnitTests/ObjC/for-in: -3.46% (0.3789 => 0.3658, std. dev.: 0.0040) SingleSource/UnitTests/ObjC/property: -3.43% (0.3940 => 0.3805, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -3.30% (0.3914 => 0.3785, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.14% (0.8818 => 0.8541, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/parameter-passing: -3.12% (0.4003 => 0.3878, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.13% (0.6576 => 0.6436, std. dev.: 0.0009) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/richards_benchmark: -12.60% (1.1560 => 1.0103, std. dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.12% (1.0460 => 0.9401, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -9.84% (1.2308 => 1.1097, std. dev.: 0.0016) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.50% (0.3139 => 0.2935, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9472, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.33% (0.2333 => 0.2232, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.84% (1.3780 => 1.3251, std. dev.: 0.0046) MultiSource/Benchmarks/Olden/bh/bh: -3.70% (1.9762 => 1.9030, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.64% (0.3458 => 0.3332, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -2.13% (6.3560 => 6.2206, std. dev.: 0.0091) MultiSource/Applications/minisat/minisat: -2.01% (9.3358 => 9.1482, std. dev.: 0.0314) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.92% (6.6320 => 6.5046, std. dev.: 0.0017) MultiSource/Applications/spiff/spiff: -1.86% (3.0263 => 2.9701, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3446, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.67% (7.1097 => 6.9912, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.53% (20.3410 => 20.0290, std. dev.: 0.0521) MultiSource/Benchmarks/Bullet/bullet: -1.49% (7.3305 => 7.2211, std. dev.: 0.0096) SingleSource/Benchmarks/Shootout/heapsort: -1.47% (3.9173 => 3.8598, std. dev.: 0.0038) MultiSource/Applications/lua/lua: -1.34% (26.5159 => 26.1605, std. dev.: 0.0161) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.10s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat May 5 07:36:45 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 5 May 2012 09:36:45 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120505143645.353112A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/535?compare_to=534&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 535, Order: 156234, Start Time: 2012-05-05 13:40:09, End Time: 2012-05-05 14:37:21 To: 534, Order: 156232, Start Time: 2012-05-05 11:55:24, End Time: 2012-05-05 12:52:36 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (56 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (797 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.41% (2.0176 => 2.2881, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.19% (0.2721 => 0.2835, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.83% (0.3130 => 0.3250, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.72% (3.9660 => 4.1135, std. dev.: 0.0020) MultiSource/Applications/SPASS/SPASS: 3.37% (13.8202 => 14.2866, std. dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.23% (0.5265 => 0.5435, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.10% (0.6959 => 0.7175, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 2.91% (0.4328 => 0.4454, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 2.77% (1.0594 => 1.0887, std. dev.: 0.0018) MultiSource/Applications/kimwitu++/kc: 2.64% (16.6129 => 17.0516, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.61% (0.5637 => 0.5784, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.55% (0.9199 => 0.9434, std. dev.: 0.0020) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.54% (1.1364 => 1.1653, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/football/football: 2.54% (0.8310 => 0.8521, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.49% (1.2193 => 1.2496, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 2.39% (2.1791 => 2.2311, std. dev.: 0.0169) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.33% (0.7710 => 0.7890, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.19% (1.4563 => 1.4882, std. dev.: 0.0024) MultiSource/Applications/lambda-0_1_3/lambda: 2.19% (0.7038 => 0.7192, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.17% (0.4791 => 0.4895, std. dev.: 0.0005) MultiSource/Applications/Burg/burg: 2.14% (1.1061 => 1.1298, std. dev.: 0.0078) MultiSource/Benchmarks/MallocBench/gs/gs: 2.14% (3.8646 => 3.9474, std. dev.: 0.0028) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.12% (0.7460 => 0.7618, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.08% (0.5577 => 0.5693, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.04% (13.2842 => 13.5549, std. dev.: 0.0055) MultiSource/Applications/treecc/treecc: 1.95% (1.9270 => 1.9646, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.91% (1.3245 => 1.3498, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.88% (2.1007 => 2.1401, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.70% (3.6692 => 3.7314, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.61% (1.3819 => 1.4042, std. dev.: 0.0017) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.59% (1.3813 => 1.4033, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.59% (0.6283 => 0.6383, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 1.56% (1.3693 => 1.3907, std. dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.47% (3.2742 => 3.3223, std. dev.: 0.0053) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.35% (1.5188 => 1.5393, std. dev.: 0.0007) MultiSource/Applications/JM/ldecod/ldecod: 1.35% (6.5754 => 6.6639, std. dev.: 0.0131) MultiSource/Applications/hexxagon/hexxagon: 1.21% (1.2292 => 1.2441, std. dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 1.17% (16.2614 => 16.4523, std. dev.: 0.0140) MultiSource/Applications/SIBsim4/SIBsim4: 1.14% (1.2749 => 1.2894, std. dev.: 0.0015) MultiSource/Applications/JM/lencod/lencod: 1.10% (14.8535 => 15.0175, std. dev.: 0.0166) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.21% (1.8175 => 2.2576, std. dev.: 0.0539) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.86% (1.5824 => 1.6752, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 3.72% (7.4271 => 7.7036, std. dev.: 0.0047) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.60% (1.7688 => 1.8325, std. dev.: 0.0017) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 3.25% (0.9692 => 1.0007, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4547, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.74% (8.8259 => 9.0680, std. dev.: 0.0109) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.36% (7.9275 => 8.1142, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/ffbench: 2.25% (0.8273 => 0.8459, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: 1.33% (5.0168 => 5.0837, std. dev.: 0.0092) MultiSource/Applications/lemon/lemon: 1.31% (1.4298 => 1.4485, std. dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.28% (2.0200 => 2.0458, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.34% (0.2670 => 0.2474, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.44% (0.3511 => 0.3285, std. dev.: 0.0013) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.78% (22.5627 => 21.2591, std. dev.: 0.0110) SingleSource/UnitTests/ObjC/exceptions-3: -3.37% (0.3623 => 0.3501, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.34% (0.3650 => 0.3528, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.23% (0.8818 => 0.8533, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/trivial-interface: -3.21% (0.3578 => 0.3463, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -3.19% (0.3601 => 0.3486, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -3.17% (0.3663 => 0.3547, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -3.13% (0.3646 => 0.3532, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -2.99% (0.3940 => 0.3822, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -2.85% (0.3789 => 0.3681, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -2.78% (0.3914 => 0.3805, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -2.50% (0.4003 => 0.3903, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.10% (0.6576 => 0.6438, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/richards_benchmark: -12.54% (1.1560 => 1.0110, std. dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.12% (1.0460 => 0.9401, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -9.74% (1.2308 => 1.1109, std. dev.: 0.0027) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.56% (0.3139 => 0.2933, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9473, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.56% (1.3780 => 1.3151, std. dev.: 0.0075) MultiSource/Benchmarks/FreeBench/neural/neural: -4.33% (0.2333 => 0.2232, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.73% (0.3458 => 0.3329, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.66% (1.9762 => 1.9038, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -2.41% (6.3560 => 6.2030, std. dev.: 0.0182) MultiSource/Applications/minisat/minisat: -2.13% (9.3358 => 9.1371, std. dev.: 0.0509) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.98% (6.6320 => 6.5008, std. dev.: 0.0032) MultiSource/Applications/spiff/spiff: -1.83% (3.0263 => 2.9709, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/ReedSolomon: -1.66% (7.1097 => 6.9916, std. dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -1.52% (7.3305 => 7.2189, std. dev.: 0.0110) SingleSource/Benchmarks/Shootout/heapsort: -1.34% (3.9173 => 3.8647, std. dev.: 0.0062) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.16% (20.3410 => 20.1045, std. dev.: 0.0352) MultiSource/Applications/lua/lua: -1.14% (26.5159 => 26.2148, std. dev.: 0.0101) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.22s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat May 5 09:31:52 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 5 May 2012 11:31:52 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120505163152.20E852A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/536?compare_to=535&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 536, Order: 156235, Start Time: 2012-05-05 15:35:13, End Time: 2012-05-05 16:32:28 To: 535, Order: 156234, Start Time: 2012-05-05 13:40:09, End Time: 2012-05-05 14:37:21 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (55 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (799 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.43% (2.0176 => 2.2886, std. dev.: 0.0137) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.04% (0.2721 => 0.2831, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.87% (0.3130 => 0.3251, std. dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.72% (3.9660 => 4.1134, std. dev.: 0.0018) MultiSource/Applications/SPASS/SPASS: 3.39% (13.8202 => 14.2883, std. dev.: 0.0091) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.34% (0.5265 => 0.5441, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.20% (0.6959 => 0.7182, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/hash2: 2.84% (0.4328 => 0.4451, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 2.80% (1.0594 => 1.0891, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.58% (1.2193 => 1.2507, std. dev.: 0.0015) MultiSource/Applications/kimwitu++/kc: 2.56% (16.6129 => 17.0387, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.53% (0.9199 => 0.9432, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: 2.53% (0.8310 => 0.8520, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.51% (1.1364 => 1.1649, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.47% (0.5637 => 0.5776, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.40% (0.4791 => 0.4906, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.40% (0.7710 => 0.7895, std. dev.: 0.0015) MultiSource/Applications/siod/siod: 2.32% (2.1791 => 2.2297, std. dev.: 0.0028) MultiSource/Benchmarks/MallocBench/gs/gs: 2.27% (3.8646 => 3.9522, std. dev.: 0.0102) MultiSource/Applications/lambda-0_1_3/lambda: 2.17% (0.7038 => 0.7191, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.17% (1.4563 => 1.4879, std. dev.: 0.0029) MultiSource/Applications/Burg/burg: 2.15% (1.1061 => 1.1299, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.13% (0.5577 => 0.5696, std. dev.: 0.0011) MultiSource/Applications/treecc/treecc: 1.95% (1.9270 => 1.9645, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.93% (0.7460 => 0.7604, std. dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.91% (2.1007 => 2.1409, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.89% (1.3245 => 1.3495, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.80% (13.2842 => 13.5237, std. dev.: 0.0093) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.75% (3.6692 => 3.7333, std. dev.: 0.0073) MultiSource/Applications/hbd/hbd: 1.61% (1.3693 => 1.3914, std. dev.: 0.0018) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.55% (1.3813 => 1.4027, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.52% (1.3819 => 1.4029, std. dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.48% (3.2742 => 3.3226, std. dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.40% (1.5188 => 1.5400, std. dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 1.23% (1.2292 => 1.2443, std. dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: 1.15% (1.2749 => 1.2896, std. dev.: 0.0019) MultiSource/Applications/JM/ldecod/ldecod: 1.15% (6.5754 => 6.6511, std. dev.: 0.0070) MultiSource/Applications/JM/lencod/lencod: 1.12% (14.8535 => 15.0196, std. dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: 1.06% (16.2614 => 16.4338, std. dev.: 0.0189) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.39% (1.8175 => 2.2607, std. dev.: 0.0223) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.52% (2.5629 => 2.7299, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.87% (1.5824 => 1.6753, std. dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8147, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.71% (1.7688 => 1.8344, std. dev.: 0.0051) SingleSource/Benchmarks/Misc/salsa20: 3.54% (7.4271 => 7.6897, std. dev.: 0.0078) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 3.28% (0.9692 => 1.0010, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4537, std. dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.84% (8.8259 => 9.0768, std. dev.: 0.0098) SingleSource/Benchmarks/Misc/ffbench: 2.22% (0.8273 => 0.8457, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.20% (7.9275 => 8.1023, std. dev.: 0.0109) MultiSource/Applications/lemon/lemon: 1.30% (1.4298 => 1.4484, std. dev.: 0.0029) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.25% (2.0200 => 2.0453, std. dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 1.21% (5.0168 => 5.0777, std. dev.: 0.0087) SingleSource/Benchmarks/Shootout/sieve: 1.19% (5.1531 => 5.2143, std. dev.: 0.0041) SingleSource/Benchmarks/Dhrystone/fldry: 1.18% (1.9290 => 1.9518, std. dev.: 0.0045) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -13.51% (0.4657 => 0.4028, std. dev.: 0.0236) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.34% (0.2670 => 0.2474, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.41% (0.3511 => 0.3286, std. dev.: 0.0011) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.71% (22.5627 => 21.2745, std. dev.: 0.0045) SingleSource/UnitTests/ObjC/exceptions-3: -3.42% (0.3623 => 0.3499, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: -3.21% (0.3578 => 0.3463, std. dev.: 0.0030) SingleSource/UnitTests/ObjC/synchronized: -3.17% (0.3663 => 0.3547, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.12% (0.8818 => 0.8543, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-2: -3.11% (0.3601 => 0.3489, std. dev.: 0.0025) SingleSource/UnitTests/ObjC/exceptions-4: -3.07% (0.3646 => 0.3534, std. dev.: 0.0037) SingleSource/UnitTests/ObjC/property: -3.02% (0.3940 => 0.3821, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -2.85% (0.3789 => 0.3681, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions: -2.78% (0.3914 => 0.3805, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.08% (0.6576 => 0.6439, std. dev.: 0.0011) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/richards_benchmark: -12.24% (1.1560 => 1.0145, std. dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.13% (1.0460 => 0.9400, std. dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: -9.85% (1.2308 => 1.1096, std. dev.: 0.0011) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.59% (0.3139 => 0.2932, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9473, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.33% (0.2333 => 0.2232, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.21% (1.3780 => 1.3200, std. dev.: 0.0066) MultiSource/Benchmarks/Olden/bh/bh: -3.76% (1.9762 => 1.9019, std. dev.: 0.0098) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -2.36% (6.3560 => 6.2060, std. dev.: 0.0210) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.89% (6.6320 => 6.5066, std. dev.: 0.0021) MultiSource/Applications/minisat/minisat: -1.80% (9.3358 => 9.1676, std. dev.: 0.0342) MultiSource/Applications/spiff/spiff: -1.76% (3.0263 => 2.9729, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.66% (7.1097 => 6.9915, std. dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -1.54% (7.3305 => 7.2179, std. dev.: 0.0109) SingleSource/Benchmarks/Shootout/heapsort: -1.47% (3.9173 => 3.8596, std. dev.: 0.0031) MultiSource/Applications/lua/lua: -1.33% (26.5159 => 26.1643, std. dev.: 0.0162) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.09% (3.8887 => 3.8464, std. dev.: 0.0045) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.34s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat May 5 11:05:13 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 5 May 2012 13:05:13 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120505180513.DD3AA2A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/537?compare_to=536&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 537, Order: 156238, Start Time: 2012-05-05 17:09:13, End Time: 2012-05-05 18:05:50 To: 536, Order: 156235, Start Time: 2012-05-05 15:35:13, End Time: 2012-05-05 16:32:28 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (53 on baseline) Performance Improvements: 1 (31 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 890 (804 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 1.29% (7.9646 => 8.0676, std. dev.: 0.0074) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/lambda-0_1_3/lambda: -2.23% (5.4818 => 5.3595, std. dev.: 0.0198) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.47% (2.0176 => 2.2893, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.04% (0.2721 => 0.2831, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.93% (0.3130 => 0.3253, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.82% (3.9660 => 4.1174, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 3.32% (13.8202 => 14.2787, std. dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.23% (0.5265 => 0.5435, std. dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.22% (0.6959 => 0.7183, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/hash2: 2.98% (0.4328 => 0.4457, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 2.78% (1.0594 => 1.0888, std. dev.: 0.0072) MultiSource/Applications/kimwitu++/kc: 2.65% (16.6129 => 17.0530, std. dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.57% (0.9199 => 0.9435, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.53% (1.2193 => 1.2502, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.52% (0.7710 => 0.7904, std. dev.: 0.0020) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.51% (1.1364 => 1.1649, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.50% (0.5637 => 0.5778, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 2.42% (0.8310 => 0.8511, std. dev.: 0.0012) MultiSource/Applications/siod/siod: 2.36% (2.1791 => 2.2305, std. dev.: 0.0180) MultiSource/Applications/lambda-0_1_3/lambda: 2.34% (0.7038 => 0.7203, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.25% (1.4563 => 1.4891, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/gs/gs: 2.23% (3.8646 => 3.9508, std. dev.: 0.0058) MultiSource/Applications/Burg/burg: 2.15% (1.1061 => 1.1299, std. dev.: 0.0031) MultiSource/Applications/treecc/treecc: 2.14% (1.9270 => 1.9683, std. dev.: 0.0026) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.01% (0.7460 => 0.7610, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.93% (1.3245 => 1.3500, std. dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.87% (2.1007 => 2.1400, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.75% (13.2842 => 13.5164, std. dev.: 0.0112) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.69% (1.3813 => 1.4047, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.59% (0.6283 => 0.6383, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.58% (1.3819 => 1.4038, std. dev.: 0.0025) MultiSource/Applications/hbd/hbd: 1.57% (1.3693 => 1.3908, std. dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.52% (3.6692 => 3.7249, std. dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.49% (1.5188 => 1.5414, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 1.35% (1.2292 => 1.2458, std. dev.: 0.0012) MultiSource/Applications/JM/lencod/lencod: 1.27% (14.8535 => 15.0424, std. dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.25% (3.2742 => 3.3152, std. dev.: 0.0063) MultiSource/Applications/JM/ldecod/ldecod: 1.08% (6.5754 => 6.6465, std. dev.: 0.0057) MultiSource/Applications/SIBsim4/SIBsim4: 1.04% (1.2749 => 1.2882, std. dev.: 0.0020) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.21% (1.8175 => 2.2576, std. dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.85% (1.5824 => 1.6749, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8146, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.75% (1.7688 => 1.8352, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: 3.70% (7.4271 => 7.7021, std. dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 3.26% (0.9692 => 1.0008, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4538, std. dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.67% (8.8259 => 9.0617, std. dev.: 0.0308) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.54% (7.9275 => 8.1288, std. dev.: 0.0080) SingleSource/Benchmarks/Misc/ffbench: 2.24% (0.8273 => 0.8458, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.28% (2.0200 => 2.0458, std. dev.: 0.0004) MultiSource/Applications/lemon/lemon: 1.22% (1.4298 => 1.4473, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 1.10% (3.2729 => 3.3089, std. dev.: 0.0050) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.38% (0.2670 => 0.2473, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.49% (0.3511 => 0.3283, std. dev.: 0.0008) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.82% (22.5627 => 21.2486, std. dev.: 0.0100) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.41% (0.8818 => 0.8517, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: -2.96% (0.3650 => 0.3542, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-3: -2.95% (0.3623 => 0.3516, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -2.86% (0.3601 => 0.3498, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: -2.85% (0.3646 => 0.3542, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -2.73% (0.3663 => 0.3563, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.99% (0.6576 => 0.6445, std. dev.: 0.0013) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/richards_benchmark: -12.58% (1.1560 => 1.0106, std. dev.: 0.0080) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.12% (1.0460 => 0.9401, std. dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: -9.70% (1.2308 => 1.1114, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.59% (0.3139 => 0.2932, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.86% (1.3780 => 1.3110, std. dev.: 0.0059) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9474, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.33% (0.2333 => 0.2232, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.70% (1.9762 => 1.9031, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.67% (0.3458 => 0.3331, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -2.03% (6.3560 => 6.2271, std. dev.: 0.0055) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.89% (6.6320 => 6.5067, std. dev.: 0.0028) MultiSource/Applications/minisat/minisat: -1.87% (9.3358 => 9.1609, std. dev.: 0.0089) MultiSource/Applications/spiff/spiff: -1.80% (3.0263 => 2.9718, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.67% (7.1097 => 6.9911, std. dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -1.55% (7.3305 => 7.2171, std. dev.: 0.0207) SingleSource/Benchmarks/Shootout/heapsort: -1.52% (3.9173 => 3.8577, std. dev.: 0.0029) MultiSource/Applications/lua/lua: -1.30% (26.5159 => 26.1714, std. dev.: 0.0210) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.27% (20.3410 => 20.0828, std. dev.: 0.0087) MultiSource/Benchmarks/nbench/nbench: -1.01% (11.2619 => 11.1485, std. dev.: 0.0028) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.33s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat May 5 12:28:14 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 5 May 2012 14:28:14 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120505192814.4769E2A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/538?compare_to=537&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 538, Order: 156241, Start Time: 2012-05-05 18:32:14, End Time: 2012-05-05 19:28:50 To: 537, Order: 156238, Start Time: 2012-05-05 17:09:13, End Time: 2012-05-05 18:05:50 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (57 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (795 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.38% (2.0176 => 2.2875, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.26% (0.2721 => 0.2837, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.15% (0.3130 => 0.3260, std. dev.: 0.0036) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.81% (3.9660 => 4.1173, std. dev.: 0.0036) MultiSource/Applications/SPASS/SPASS: 3.29% (13.8202 => 14.2748, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.05% (0.6959 => 0.7171, std. dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.00% (0.5265 => 0.5423, std. dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 2.91% (1.0594 => 1.0902, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 2.82% (0.4328 => 0.4450, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.63% (1.2193 => 1.2514, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/football/football: 2.59% (0.8310 => 0.8525, std. dev.: 0.0023) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.58% (1.1364 => 1.1657, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.57% (0.9199 => 0.9435, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.55% (0.5637 => 0.5781, std. dev.: 0.0015) MultiSource/Applications/kimwitu++/kc: 2.44% (16.6129 => 17.0177, std. dev.: 0.0021) MultiSource/Applications/siod/siod: 2.28% (2.1791 => 2.2288, std. dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.21% (0.4791 => 0.4897, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 2.16% (3.8646 => 3.9482, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.14% (1.4563 => 1.4875, std. dev.: 0.0028) MultiSource/Applications/Burg/burg: 2.12% (1.1061 => 1.1296, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.10% (0.5577 => 0.5694, std. dev.: 0.0030) MultiSource/Applications/lambda-0_1_3/lambda: 2.05% (0.7038 => 0.7182, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.98% (0.7460 => 0.7608, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.96% (1.3245 => 1.3504, std. dev.: 0.0010) MultiSource/Applications/treecc/treecc: 1.91% (1.9270 => 1.9638, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.85% (1.3819 => 1.4074, std. dev.: 0.0065) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.82% (1.3813 => 1.4065, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.82% (2.1007 => 2.1390, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.81% (13.2842 => 13.5240, std. dev.: 0.0158) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.79% (0.7710 => 0.7848, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.73% (3.6692 => 3.7325, std. dev.: 0.0044) MultiSource/Applications/hbd/hbd: 1.65% (1.3693 => 1.3919, std. dev.: 0.0069) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.64% (0.6283 => 0.6386, std. dev.: 0.0007) MultiSource/Applications/minisat/minisat: 1.54% (0.6744 => 0.6848, std. dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.43% (3.2742 => 3.3211, std. dev.: 0.0016) MultiSource/Applications/JM/lencod/lencod: 1.43% (14.8535 => 15.0659, std. dev.: 0.0060) MultiSource/Applications/SIBsim4/SIBsim4: 1.40% (1.2749 => 1.2928, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.32% (1.5188 => 1.5389, std. dev.: 0.0010) MultiSource/Applications/JM/ldecod/ldecod: 1.26% (6.5754 => 6.6583, std. dev.: 0.0053) MultiSource/Applications/sqlite3/sqlite3: 1.08% (16.2614 => 16.4372, std. dev.: 0.0256) MultiSource/Applications/hexxagon/hexxagon: 1.05% (1.2292 => 1.2421, std. dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.19% (1.8175 => 2.2572, std. dev.: 0.0157) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.89% (1.5824 => 1.6756, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.67% (1.7688 => 1.8338, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/salsa20: 3.63% (7.4271 => 7.6967, std. dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 3.26% (0.9692 => 1.0008, std. dev.: 0.0024) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4547, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.88% (8.8259 => 9.0803, std. dev.: 0.0121) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.26% (7.9275 => 8.1066, std. dev.: 0.0211) SingleSource/Benchmarks/Misc/ffbench: 2.25% (0.8273 => 0.8459, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: 1.36% (5.0168 => 5.0852, std. dev.: 0.0054) MultiSource/Applications/lemon/lemon: 1.28% (1.4298 => 1.4481, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.28% (2.0200 => 2.0458, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -21.24% (0.4657 => 0.3668, std. dev.: 0.0165) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.29% (0.2670 => 0.2502, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.01% (0.3511 => 0.3300, std. dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.81% (22.5627 => 21.2528, std. dev.: 0.0153) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.56% (0.3650 => 0.3520, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -3.53% (0.3623 => 0.3495, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -3.47% (0.3601 => 0.3476, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -3.35% (0.3646 => 0.3524, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -3.33% (0.3663 => 0.3541, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -3.30% (0.3578 => 0.3460, std. dev.: 0.0036) SingleSource/UnitTests/ObjC/property: -3.12% (0.3940 => 0.3817, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -3.04% (0.3789 => 0.3674, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -2.81% (0.3914 => 0.3804, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.80% (0.8818 => 0.8571, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: -2.75% (0.4003 => 0.3893, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.01% (0.6576 => 0.6444, std. dev.: 0.0014) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/richards_benchmark: -12.31% (1.1560 => 1.0137, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.11% (1.0460 => 0.9402, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -9.74% (1.2308 => 1.1109, std. dev.: 0.0137) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.47% (0.3139 => 0.2936, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.00% (1.3780 => 1.3091, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9473, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.33% (0.2333 => 0.2232, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.73% (0.3458 => 0.3329, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: -3.68% (1.9762 => 1.9035, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/lists: -2.27% (6.3560 => 6.2118, std. dev.: 0.0113) MultiSource/Applications/minisat/minisat: -2.10% (9.3358 => 9.1399, std. dev.: 0.0052) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -2.00% (6.6320 => 6.4996, std. dev.: 0.0060) MultiSource/Applications/spiff/spiff: -1.80% (3.0263 => 2.9717, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3444, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.66% (7.1097 => 6.9914, std. dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -1.50% (7.3305 => 7.2209, std. dev.: 0.0118) SingleSource/Benchmarks/Shootout/heapsort: -1.31% (3.9173 => 3.8659, std. dev.: 0.0029) MultiSource/Applications/lua/lua: -1.23% (26.5159 => 26.1898, std. dev.: 0.0193) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.13% (20.3410 => 20.1111, std. dev.: 0.0415) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.27s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat May 5 16:31:27 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 5 May 2012 18:31:27 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120505233127.987A72A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/539?compare_to=538&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 539, Order: 156244, Start Time: 2012-05-05 22:35:14, End Time: 2012-05-05 23:32:03 To: 538, Order: 156241, Start Time: 2012-05-05 18:32:14, End Time: 2012-05-05 19:28:50 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (58 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (795 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.33% (2.0176 => 2.2866, std. dev.: 0.0118) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.45% (0.2721 => 0.2842, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.15% (0.3130 => 0.3260, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.83% (3.9660 => 4.1178, std. dev.: 0.0021) MultiSource/Applications/SPASS/SPASS: 3.23% (13.8202 => 14.2671, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.98% (0.5265 => 0.5422, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.93% (0.6959 => 0.7163, std. dev.: 0.0015) MultiSource/Benchmarks/nbench/nbench: 2.91% (1.0594 => 1.0902, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/hash2: 2.75% (0.4328 => 0.4447, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.61% (1.1364 => 1.1661, std. dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/football/football: 2.59% (0.8310 => 0.8525, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.56% (1.2193 => 1.2505, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.51% (0.9199 => 0.9430, std. dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 2.45% (16.6129 => 17.0198, std. dev.: 0.0144) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.44% (0.7710 => 0.7898, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.43% (0.5637 => 0.5774, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.24% (1.4563 => 1.4889, std. dev.: 0.0065) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.19% (0.4791 => 0.4896, std. dev.: 0.0013) MultiSource/Applications/lambda-0_1_3/lambda: 2.16% (0.7038 => 0.7190, std. dev.: 0.0012) MultiSource/Applications/siod/siod: 2.16% (2.1791 => 2.2261, std. dev.: 0.0173) MultiSource/Benchmarks/MallocBench/gs/gs: 2.10% (3.8646 => 3.9459, std. dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.03% (0.5577 => 0.5690, std. dev.: 0.0013) MultiSource/Applications/Burg/burg: 1.94% (1.1061 => 1.1276, std. dev.: 0.0037) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.94% (0.7460 => 0.7605, std. dev.: 0.0013) MultiSource/Applications/treecc/treecc: 1.87% (1.9270 => 1.9631, std. dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.86% (1.3245 => 1.3492, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.85% (1.3819 => 1.4075, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.81% (13.2842 => 13.5252, std. dev.: 0.0140) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.79% (1.3813 => 1.4060, std. dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.78% (0.6283 => 0.6395, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.68% (3.6692 => 3.7308, std. dev.: 0.0095) MultiSource/Applications/hbd/hbd: 1.57% (1.3693 => 1.3908, std. dev.: 0.0030) MultiSource/Applications/minisat/minisat: 1.56% (0.6744 => 0.6849, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.53% (2.1007 => 2.1329, std. dev.: 0.0081) MultiSource/Applications/SIBsim4/SIBsim4: 1.48% (1.2749 => 1.2938, std. dev.: 0.0015) MultiSource/Applications/JM/lencod/lencod: 1.31% (14.8535 => 15.0482, std. dev.: 0.0112) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.30% (3.2742 => 3.3167, std. dev.: 0.0008) MultiSource/Applications/JM/ldecod/ldecod: 1.27% (6.5754 => 6.6586, std. dev.: 0.0064) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.26% (1.5188 => 1.5380, std. dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 1.07% (1.2292 => 1.2424, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 1.07% (16.2614 => 16.4350, std. dev.: 0.0202) MultiSource/Applications/d/make_dparser: 1.00% (3.1889 => 3.2208, std. dev.: 0.0016) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.97% (1.8175 => 2.2714, std. dev.: 0.0392) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.86% (1.5824 => 1.6751, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8146, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.71% (1.7688 => 1.8344, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: 3.68% (7.4271 => 7.7007, std. dev.: 0.0073) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 3.25% (0.9692 => 1.0007, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4544, std. dev.: 0.0033) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.86% (8.8259 => 9.0782, std. dev.: 0.0116) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.26% (7.9275 => 8.1064, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/ffbench: 2.24% (0.8273 => 0.8458, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.29% (1.4298 => 1.4482, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.25% (2.0200 => 2.0452, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0062) MultiSource/Benchmarks/sim/sim: 1.03% (5.0168 => 5.0683, std. dev.: 0.0143) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -16.36% (0.4657 => 0.3895, std. dev.: 0.0124) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.37% (0.2670 => 0.2500, std. dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.07% (0.3511 => 0.3298, std. dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.84% (22.5627 => 21.2445, std. dev.: 0.0086) SingleSource/UnitTests/ObjC/exceptions-3: -3.62% (0.3623 => 0.3492, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-2: -3.55% (0.3601 => 0.3473, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -3.52% (0.3578 => 0.3452, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-4: -3.51% (0.3646 => 0.3518, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.42% (0.3650 => 0.3525, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/synchronized: -3.41% (0.3663 => 0.3538, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: -3.25% (0.3940 => 0.3812, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: -2.96% (0.3914 => 0.3798, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.84% (0.8818 => 0.8568, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -2.80% (0.4003 => 0.3891, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.10% (0.6576 => 0.6438, std. dev.: 0.0029) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/richards_benchmark: -12.71% (1.1560 => 1.0091, std. dev.: 0.0077) SingleSource/Benchmarks/McGill/chomp: -10.68% (1.2308 => 1.0993, std. dev.: 0.0077) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.12% (1.0460 => 0.9401, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.56% (0.3139 => 0.2933, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.33% (1.3780 => 1.3046, std. dev.: 0.0067) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9474, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/neural/neural: -4.33% (0.2333 => 0.2232, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.66% (1.9762 => 1.9038, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.61% (0.3458 => 0.3333, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -2.16% (6.3560 => 6.2187, std. dev.: 0.0056) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.93% (6.6320 => 6.5040, std. dev.: 0.0039) MultiSource/Applications/minisat/minisat: -1.91% (9.3358 => 9.1579, std. dev.: 0.0354) MultiSource/Applications/spiff/spiff: -1.77% (3.0263 => 2.9726, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/ReedSolomon: -1.66% (7.1097 => 6.9914, std. dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -1.48% (7.3305 => 7.2217, std. dev.: 0.0086) SingleSource/Benchmarks/Shootout/heapsort: -1.41% (3.9173 => 3.8620, std. dev.: 0.0019) MultiSource/Applications/lua/lua: -1.30% (26.5159 => 26.1710, std. dev.: 0.0367) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.09% (20.3410 => 20.1200, std. dev.: 0.0396) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.51s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat May 5 17:54:09 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 5 May 2012 19:54:09 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120506005409.A88DA2A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/540?compare_to=539&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 540, Order: 156246, Start Time: 2012-05-05 23:58:15, End Time: 2012-05-06 00:54:45 To: 539, Order: 156244, Start Time: 2012-05-05 22:35:14, End Time: 2012-05-05 23:32:03 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (54 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 891 (799 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/McGill/chomp: 1.10% (1.0993 => 1.1114, std. dev.: 0.0031) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.27% (2.0176 => 2.2854, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.48% (0.2721 => 0.2843, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.28% (0.3130 => 0.3264, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.71% (3.9660 => 4.1133, std. dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 3.20% (13.8202 => 14.2626, std. dev.: 0.0210) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.16% (0.6959 => 0.7179, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.02% (0.5265 => 0.5424, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 2.86% (1.0594 => 1.0897, std. dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.59% (1.2193 => 1.2509, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.55% (1.1364 => 1.1654, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/football/football: 2.55% (0.8310 => 0.8522, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.53% (0.9199 => 0.9432, std. dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 2.44% (16.6129 => 17.0189, std. dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.38% (0.5637 => 0.5771, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.22% (1.4563 => 1.4886, std. dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.17% (0.4791 => 0.4895, std. dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: 2.16% (0.7038 => 0.7190, std. dev.: 0.0030) MultiSource/Applications/siod/siod: 2.12% (2.1791 => 2.2253, std. dev.: 0.0056) MultiSource/Benchmarks/MallocBench/gs/gs: 2.04% (3.8646 => 3.9435, std. dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.01% (0.5577 => 0.5689, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.98% (0.7460 => 0.7608, std. dev.: 0.0006) MultiSource/Applications/Burg/burg: 1.94% (1.1061 => 1.1276, std. dev.: 0.0044) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.91% (1.3819 => 1.4083, std. dev.: 0.0019) MultiSource/Applications/treecc/treecc: 1.89% (1.9270 => 1.9634, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.84% (1.3245 => 1.3489, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.80% (13.2842 => 13.5230, std. dev.: 0.0119) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.78% (1.3813 => 1.4059, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.75% (0.6283 => 0.6393, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.68% (3.6692 => 3.7310, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.67% (2.1007 => 2.1357, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.66% (0.7710 => 0.7838, std. dev.: 0.0040) MultiSource/Applications/hbd/hbd: 1.50% (1.3693 => 1.3898, std. dev.: 0.0019) MultiSource/Applications/SIBsim4/SIBsim4: 1.44% (1.2749 => 1.2932, std. dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.42% (1.5188 => 1.5403, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.40% (3.2742 => 3.3199, std. dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 1.31% (14.8535 => 15.0486, std. dev.: 0.0106) MultiSource/Applications/JM/ldecod/ldecod: 1.27% (6.5754 => 6.6591, std. dev.: 0.0147) MultiSource/Applications/sqlite3/sqlite3: 1.21% (16.2614 => 16.4584, std. dev.: 0.0208) MultiSource/Applications/hexxagon/hexxagon: 1.03% (1.2292 => 1.2418, std. dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.30% (1.8175 => 2.2591, std. dev.: 0.0460) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.52% (2.5629 => 2.7299, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.86% (1.5824 => 1.6751, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 3.69% (7.4271 => 7.7008, std. dev.: 0.0073) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.62% (1.7688 => 1.8329, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 3.27% (0.9692 => 1.0009, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4550, std. dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.84% (8.8259 => 9.0763, std. dev.: 0.0132) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.46% (7.9275 => 8.1229, std. dev.: 0.0039) SingleSource/Benchmarks/Misc/ffbench: 2.24% (0.8273 => 0.8458, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: 1.42% (1.9290 => 1.9564, std. dev.: 0.0023) MultiSource/Applications/lemon/lemon: 1.31% (1.4298 => 1.4485, std. dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.26% (2.0200 => 2.0455, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2135, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.37% (0.2670 => 0.2500, std. dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.87% (0.3511 => 0.3305, std. dev.: 0.0041) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.83% (22.5627 => 21.2464, std. dev.: 0.0153) SingleSource/UnitTests/ObjC/exceptions-3: -3.64% (0.3623 => 0.3491, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -3.58% (0.3601 => 0.3472, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.56% (0.3650 => 0.3520, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: -3.47% (0.3578 => 0.3454, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -3.43% (0.3646 => 0.3521, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -3.41% (0.3663 => 0.3538, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -3.11% (0.3789 => 0.3671, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -3.05% (0.3940 => 0.3820, std. dev.: 0.0015) SingleSource/UnitTests/ObjC/exceptions: -2.96% (0.3914 => 0.3798, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.84% (0.8818 => 0.8568, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -2.80% (0.4003 => 0.3891, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.04% (0.6576 => 0.6442, std. dev.: 0.0010) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/richards_benchmark: -12.46% (1.1560 => 1.0120, std. dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.12% (1.0460 => 0.9401, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -9.70% (1.2308 => 1.1114, std. dev.: 0.0031) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.53% (0.3139 => 0.2934, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.17% (1.3780 => 1.3067, std. dev.: 0.0075) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9474, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.33% (0.2333 => 0.2232, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.73% (0.3458 => 0.3329, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.67% (1.9762 => 1.9036, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: -2.08% (9.3358 => 9.1416, std. dev.: 0.0083) SingleSource/Benchmarks/Shootout/lists: -2.06% (6.3560 => 6.2253, std. dev.: 0.0061) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.96% (6.6320 => 6.5018, std. dev.: 0.0047) MultiSource/Applications/spiff/spiff: -1.77% (3.0263 => 2.9728, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.67% (7.1097 => 6.9913, std. dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -1.50% (7.3305 => 7.2206, std. dev.: 0.0239) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.39% (20.3410 => 20.0588, std. dev.: 0.0646) SingleSource/Benchmarks/Shootout/heapsort: -1.38% (3.9173 => 3.8634, std. dev.: 0.0061) MultiSource/Applications/lua/lua: -1.24% (26.5159 => 26.1864, std. dev.: 0.0259) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.24s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat May 5 19:35:14 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 5 May 2012 21:35:14 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120506023514.5824A2A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/541?compare_to=540&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 541, Order: 156247, Start Time: 2012-05-06 01:39:15, End Time: 2012-05-06 02:35:50 To: 540, Order: 156246, Start Time: 2012-05-05 23:58:15, End Time: 2012-05-06 00:54:45 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (55 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (797 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.33% (2.0176 => 2.2865, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.37% (0.2721 => 0.2840, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.06% (0.3130 => 0.3257, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.77% (3.9660 => 4.1157, std. dev.: 0.0023) MultiSource/Applications/SPASS/SPASS: 3.22% (13.8202 => 14.2655, std. dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.20% (0.6959 => 0.7182, std. dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.13% (0.5265 => 0.5430, std. dev.: 0.0048) MultiSource/Benchmarks/nbench/nbench: 2.92% (1.0594 => 1.0903, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/hash2: 2.70% (0.4328 => 0.4445, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 2.62% (0.8310 => 0.8528, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.61% (0.9199 => 0.9439, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.60% (1.2193 => 1.2510, std. dev.: 0.0017) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.54% (1.1364 => 1.1653, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.52% (0.5637 => 0.5779, std. dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 2.36% (16.6129 => 17.0045, std. dev.: 0.0111) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.34% (1.4563 => 1.4904, std. dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.34% (0.4791 => 0.4903, std. dev.: 0.0013) MultiSource/Applications/lambda-0_1_3/lambda: 2.30% (0.7038 => 0.7200, std. dev.: 0.0010) MultiSource/Applications/siod/siod: 2.29% (2.1791 => 2.2291, std. dev.: 0.0024) MultiSource/Benchmarks/MallocBench/gs/gs: 2.23% (3.8646 => 3.9507, std. dev.: 0.0021) MultiSource/Applications/treecc/treecc: 2.10% (1.9270 => 1.9674, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 2.03% (1.1061 => 1.1286, std. dev.: 0.0075) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.00% (0.7460 => 0.7609, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.97% (1.3245 => 1.3506, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.96% (1.3819 => 1.4090, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.86% (1.3813 => 1.4070, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.84% (0.7710 => 0.7852, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.78% (13.2842 => 13.5201, std. dev.: 0.0160) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.67% (0.6283 => 0.6388, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.67% (3.6692 => 3.7304, std. dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.67% (2.1007 => 2.1357, std. dev.: 0.0018) MultiSource/Applications/minisat/minisat: 1.54% (0.6744 => 0.6848, std. dev.: 0.0009) MultiSource/Applications/hbd/hbd: 1.50% (1.3693 => 1.3898, std. dev.: 0.0018) MultiSource/Applications/SIBsim4/SIBsim4: 1.44% (1.2749 => 1.2933, std. dev.: 0.0025) MultiSource/Applications/JM/lencod/lencod: 1.42% (14.8535 => 15.0644, std. dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.38% (1.5188 => 1.5398, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.37% (3.2742 => 3.3190, std. dev.: 0.0012) MultiSource/Applications/JM/ldecod/ldecod: 1.34% (6.5754 => 6.6637, std. dev.: 0.0153) MultiSource/Applications/sqlite3/sqlite3: 1.11% (16.2614 => 16.4421, std. dev.: 0.0381) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 23.82% (1.8175 => 2.2504, std. dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6754, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 3.69% (7.4271 => 7.7014, std. dev.: 0.0074) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.58% (1.7688 => 1.8322, std. dev.: 0.0063) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 3.26% (0.9692 => 1.0008, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 3.01% (8.8259 => 9.0915, std. dev.: 0.0023) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4537, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.34% (7.9275 => 8.1127, std. dev.: 0.0124) SingleSource/Benchmarks/Misc/ffbench: 2.25% (0.8273 => 0.8459, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.51% (1.9290 => 1.9581, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.27% (2.0200 => 2.0457, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.23% (1.4298 => 1.4474, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) MultiSource/Benchmarks/sim/sim: 1.01% (5.0168 => 5.0677, std. dev.: 0.0125) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -16.43% (0.4657 => 0.3892, std. dev.: 0.0279) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.44% (0.2670 => 0.2498, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.04% (0.3511 => 0.3299, std. dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.74% (22.5627 => 21.2671, std. dev.: 0.0142) SingleSource/UnitTests/ObjC/exceptions-3: -3.86% (0.3623 => 0.3483, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.86% (0.3650 => 0.3509, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-2: -3.83% (0.3601 => 0.3463, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -3.76% (0.3646 => 0.3509, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -3.71% (0.3663 => 0.3527, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: -3.63% (0.3578 => 0.3448, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: -3.46% (0.3789 => 0.3658, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/property: -3.38% (0.3940 => 0.3807, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -3.14% (0.3914 => 0.3791, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: -3.07% (0.4003 => 0.3880, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.78% (0.8818 => 0.8573, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.48% (0.6576 => 0.6413, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/richards_benchmark: -12.69% (1.1560 => 1.0093, std. dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.13% (1.0460 => 0.9400, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -9.83% (1.2308 => 1.1098, std. dev.: 0.0007) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.50% (0.3139 => 0.2935, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9474, std. dev.: 0.0004) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.61% (1.3780 => 1.3145, std. dev.: 0.0083) MultiSource/Benchmarks/FreeBench/neural/neural: -4.33% (0.2333 => 0.2232, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.68% (1.9762 => 1.9035, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.67% (0.3458 => 0.3331, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -2.44% (6.3560 => 6.2011, std. dev.: 0.0151) MultiSource/Applications/minisat/minisat: -1.98% (9.3358 => 9.1505, std. dev.: 0.0038) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.98% (20.3410 => 19.9381, std. dev.: 0.0685) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.88% (6.6320 => 6.5071, std. dev.: 0.0027) MultiSource/Applications/spiff/spiff: -1.84% (3.0263 => 2.9706, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3444, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.67% (7.1097 => 6.9913, std. dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: -1.51% (7.3305 => 7.2201, std. dev.: 0.0241) SingleSource/Benchmarks/Shootout/heapsort: -1.38% (3.9173 => 3.8631, std. dev.: 0.0043) MultiSource/Applications/lua/lua: -1.15% (26.5159 => 26.2098, std. dev.: 0.0357) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.22s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun May 6 02:51:53 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 6 May 2012 04:51:53 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120506095153.15FBA2A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/542?compare_to=541&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 542, Order: 156251, Start Time: 2012-05-06 08:55:42, End Time: 2012-05-06 09:52:29 To: 541, Order: 156247, Start Time: 2012-05-06 01:39:15, End Time: 2012-05-06 02:35:50 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (58 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 891 (795 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/CoyoteBench/huffbench: 1.10% (19.9381 => 20.1574, std. dev.: 0.0424) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.32% (2.0176 => 2.2864, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.41% (0.3130 => 0.3268, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.37% (0.2721 => 0.2840, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.77% (3.9660 => 4.1154, std. dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: 3.25% (13.8202 => 14.2699, std. dev.: 0.0154) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.04% (0.5265 => 0.5425, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.92% (0.6959 => 0.7162, std. dev.: 0.0067) MultiSource/Benchmarks/nbench/nbench: 2.88% (1.0594 => 1.0899, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/hash2: 2.77% (0.4328 => 0.4448, std. dev.: 0.0044) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.65% (1.1364 => 1.1665, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.61% (1.2193 => 1.2511, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/football/football: 2.53% (0.8310 => 0.8520, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.50% (0.5637 => 0.5778, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.50% (0.9199 => 0.9429, std. dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 2.46% (16.6129 => 17.0214, std. dev.: 0.0116) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.28% (0.7710 => 0.7886, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.25% (0.4791 => 0.4899, std. dev.: 0.0010) MultiSource/Applications/siod/siod: 2.20% (2.1791 => 2.2270, std. dev.: 0.0052) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.20% (1.4563 => 1.4883, std. dev.: 0.0027) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.09% (0.7460 => 0.7616, std. dev.: 0.0023) MultiSource/Applications/lambda-0_1_3/lambda: 2.09% (0.7038 => 0.7185, std. dev.: 0.0011) MultiSource/Applications/Burg/burg: 2.04% (1.1061 => 1.1287, std. dev.: 0.0040) MultiSource/Benchmarks/MallocBench/gs/gs: 2.04% (3.8646 => 3.9435, std. dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.03% (0.5577 => 0.5690, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.96% (1.3819 => 1.4090, std. dev.: 0.0015) MultiSource/Applications/treecc/treecc: 1.91% (1.9270 => 1.9638, std. dev.: 0.0028) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.90% (1.3813 => 1.4075, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.85% (1.3245 => 1.3490, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.81% (13.2842 => 13.5247, std. dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.73% (2.1007 => 2.1371, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.67% (3.6692 => 3.7305, std. dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.64% (0.6283 => 0.6386, std. dev.: 0.0007) MultiSource/Applications/minisat/minisat: 1.54% (0.6744 => 0.6848, std. dev.: 0.0017) MultiSource/Applications/SIBsim4/SIBsim4: 1.48% (1.2749 => 1.2938, std. dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.47% (3.2742 => 3.3223, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.30% (1.5188 => 1.5386, std. dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 1.30% (6.5754 => 6.6610, std. dev.: 0.0048) MultiSource/Applications/JM/lencod/lencod: 1.28% (14.8535 => 15.0435, std. dev.: 0.0113) MultiSource/Applications/sqlite3/sqlite3: 1.08% (16.2614 => 16.4368, std. dev.: 0.0115) MultiSource/Applications/d/make_dparser: 1.01% (3.1889 => 3.2211, std. dev.: 0.0014) MultiSource/Applications/hexxagon/hexxagon: 1.01% (1.2292 => 1.2416, std. dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.18% (1.8175 => 2.2569, std. dev.: 0.0543) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6754, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.60% (1.7688 => 1.8325, std. dev.: 0.0063) SingleSource/Benchmarks/Misc/salsa20: 3.48% (7.4271 => 7.6854, std. dev.: 0.0054) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 3.28% (0.9692 => 1.0010, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4539, std. dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.79% (8.8259 => 9.0720, std. dev.: 0.0192) SingleSource/Benchmarks/Misc/ffbench: 2.21% (0.8273 => 0.8456, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.09% (7.9275 => 8.0931, std. dev.: 0.0241) MultiSource/Benchmarks/sim/sim: 1.65% (5.0168 => 5.0997, std. dev.: 0.0043) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0009) MultiSource/Applications/lemon/lemon: 1.29% (1.4298 => 1.4483, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.27% (2.0200 => 2.0457, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bisort/bisort: 1.26% (0.8239 => 0.8343, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.48% (0.2670 => 0.2497, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.95% (0.3511 => 0.3302, std. dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.73% (22.5627 => 21.2695, std. dev.: 0.0150) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.84% (0.3650 => 0.3510, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-3: -3.78% (0.3623 => 0.3486, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -3.76% (0.3646 => 0.3509, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -3.72% (0.3601 => 0.3467, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -3.72% (0.3578 => 0.3445, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -3.58% (0.3663 => 0.3532, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -3.43% (0.3940 => 0.3805, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -3.35% (0.3789 => 0.3662, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -3.17% (0.3914 => 0.3790, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -3.05% (0.4003 => 0.3881, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.82% (0.8818 => 0.8569, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.27% (0.6576 => 0.6427, std. dev.: 0.0007) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/richards_benchmark: -12.72% (1.1560 => 1.0090, std. dev.: 0.0041) SingleSource/Benchmarks/McGill/chomp: -10.52% (1.2308 => 1.1013, std. dev.: 0.0060) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.11% (1.0460 => 0.9402, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.56% (0.3139 => 0.2933, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.88% (1.3780 => 1.3108, std. dev.: 0.0061) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9474, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.33% (0.2333 => 0.2232, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -3.71% (1.9762 => 1.9029, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.61% (0.3458 => 0.3333, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -2.05% (6.6320 => 6.4963, std. dev.: 0.0076) MultiSource/Applications/minisat/minisat: -1.96% (9.3358 => 9.1524, std. dev.: 0.0102) SingleSource/Benchmarks/Shootout/lists: -1.87% (6.3560 => 6.2373, std. dev.: 0.0049) MultiSource/Applications/spiff/spiff: -1.82% (3.0263 => 2.9713, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3446, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.66% (7.1097 => 6.9915, std. dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -1.50% (7.3305 => 7.2206, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout/heapsort: -1.40% (3.9173 => 3.8625, std. dev.: 0.0177) MultiSource/Applications/lua/lua: -1.40% (26.5159 => 26.1451, std. dev.: 0.0254) MultiSource/Benchmarks/nbench/nbench: -1.01% (11.2619 => 11.1484, std. dev.: 0.0034) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.27s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun May 6 04:14:56 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 6 May 2012 06:14:56 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120506111456.557F32A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/543?compare_to=542&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 543, Order: 156253, Start Time: 2012-05-06 10:18:51, End Time: 2012-05-06 11:15:33 To: 542, Order: 156251, Start Time: 2012-05-06 08:55:42, End Time: 2012-05-06 09:52:29 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (54 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (798 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.29% (2.0176 => 2.2858, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.30% (0.2721 => 0.2838, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.03% (0.3130 => 0.3256, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.72% (3.9660 => 4.1136, std. dev.: 0.0055) MultiSource/Applications/SPASS/SPASS: 3.41% (13.8202 => 14.2908, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.21% (0.5265 => 0.5434, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.00% (0.6959 => 0.7168, std. dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 2.95% (1.0594 => 1.0906, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.66% (1.1364 => 1.1666, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/hash2: 2.63% (0.4328 => 0.4442, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.63% (0.9199 => 0.9441, std. dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/football/football: 2.61% (0.8310 => 0.8527, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.59% (0.5637 => 0.5783, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.54% (1.2193 => 1.2503, std. dev.: 0.0020) MultiSource/Applications/kimwitu++/kc: 2.36% (16.6129 => 17.0053, std. dev.: 0.0161) MultiSource/Applications/lambda-0_1_3/lambda: 2.26% (0.7038 => 0.7197, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.25% (1.4563 => 1.4891, std. dev.: 0.0019) MultiSource/Applications/siod/siod: 2.23% (2.1791 => 2.2277, std. dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.21% (0.4791 => 0.4897, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 2.10% (3.8646 => 3.9456, std. dev.: 0.0079) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.06% (0.5577 => 0.5692, std. dev.: 0.0019) MultiSource/Applications/Burg/burg: 2.00% (1.1061 => 1.1282, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.97% (1.3245 => 1.3506, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.84% (1.3819 => 1.4073, std. dev.: 0.0014) MultiSource/Applications/treecc/treecc: 1.83% (1.9270 => 1.9623, std. dev.: 0.0057) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.76% (13.2842 => 13.5181, std. dev.: 0.0126) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.75% (0.7710 => 0.7845, std. dev.: 0.0035) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.72% (1.3813 => 1.4051, std. dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.66% (2.1007 => 2.1356, std. dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.62% (0.6283 => 0.6385, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.61% (3.6692 => 3.7282, std. dev.: 0.0053) MultiSource/Applications/minisat/minisat: 1.60% (0.6744 => 0.6852, std. dev.: 0.0010) MultiSource/Applications/SIBsim4/SIBsim4: 1.44% (1.2749 => 1.2932, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.40% (3.2742 => 3.3199, std. dev.: 0.0151) MultiSource/Applications/hbd/hbd: 1.39% (1.3693 => 1.3884, std. dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.32% (1.5188 => 1.5389, std. dev.: 0.0011) MultiSource/Applications/JM/lencod/lencod: 1.32% (14.8535 => 15.0493, std. dev.: 0.0034) MultiSource/Applications/JM/ldecod/ldecod: 1.29% (6.5754 => 6.6599, std. dev.: 0.0027) MultiSource/Applications/sqlite3/sqlite3: 1.11% (16.2614 => 16.4420, std. dev.: 0.0081) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 23.83% (1.8175 => 2.2507, std. dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7298, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.92% (1.5824 => 1.6761, std. dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 3.69% (7.4271 => 7.7013, std. dev.: 0.0050) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.51% (1.7688 => 1.8308, std. dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 3.29% (0.9692 => 1.0011, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4542, std. dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.73% (8.8259 => 9.0671, std. dev.: 0.0136) SingleSource/Benchmarks/Misc/ffbench: 2.26% (0.8273 => 0.8460, std. dev.: 0.0017) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.22% (7.9275 => 8.1031, std. dev.: 0.0153) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0071) MultiSource/Benchmarks/sim/sim: 1.28% (5.0168 => 5.0811, std. dev.: 0.0037) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.26% (2.0200 => 2.0454, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -17.78% (0.4657 => 0.3829, std. dev.: 0.0233) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.44% (0.2670 => 0.2498, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.87% (0.3511 => 0.3305, std. dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.73% (22.5627 => 21.2690, std. dev.: 0.0164) SingleSource/UnitTests/ObjC/exceptions-3: -3.92% (0.3623 => 0.3481, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -3.83% (0.3601 => 0.3463, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: -3.77% (0.3578 => 0.3443, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -3.76% (0.3646 => 0.3509, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.75% (0.3650 => 0.3513, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/synchronized: -3.63% (0.3663 => 0.3530, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -3.45% (0.3940 => 0.3804, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -3.43% (0.3789 => 0.3659, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: -3.04% (0.3914 => 0.3795, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -3.02% (0.4003 => 0.3882, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.77% (0.8818 => 0.8574, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.36% (0.6576 => 0.6421, std. dev.: 0.0011) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/richards_benchmark: -12.53% (1.1560 => 1.0111, std. dev.: 0.0062) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.12% (1.0460 => 0.9401, std. dev.: 0.0006) SingleSource/Benchmarks/McGill/chomp: -10.06% (1.2308 => 1.1070, std. dev.: 0.0032) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.56% (0.3139 => 0.2933, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9474, std. dev.: 0.0003) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.47% (1.3780 => 1.3164, std. dev.: 0.0044) MultiSource/Benchmarks/FreeBench/neural/neural: -4.33% (0.2333 => 0.2232, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -3.63% (1.9762 => 1.9045, std. dev.: 0.0029) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.59% (0.3458 => 0.3334, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -2.15% (6.3560 => 6.2195, std. dev.: 0.0128) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.99% (6.6320 => 6.5002, std. dev.: 0.0051) MultiSource/Applications/minisat/minisat: -1.94% (9.3358 => 9.1548, std. dev.: 0.0135) MultiSource/Applications/spiff/spiff: -1.79% (3.0263 => 2.9720, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.66% (7.1097 => 6.9914, std. dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -1.54% (7.3305 => 7.2175, std. dev.: 0.0164) SingleSource/Benchmarks/Shootout/heapsort: -1.44% (3.9173 => 3.8608, std. dev.: 0.0120) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.33% (20.3410 => 20.0705, std. dev.: 0.0435) MultiSource/Applications/lua/lua: -1.30% (26.5159 => 26.1716, std. dev.: 0.0338) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.21s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun May 6 08:21:14 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 6 May 2012 10:21:14 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120506152114.0E00A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/544?compare_to=543&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 544, Order: 156257, Start Time: 2012-05-06 14:25:17, End Time: 2012-05-06 15:21:51 To: 543, Order: 156253, Start Time: 2012-05-06 10:18:51, End Time: 2012-05-06 11:15:33 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (55 on baseline) Performance Improvements: 0 (38 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (795 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.32% (2.0176 => 2.2863, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.37% (0.2721 => 0.2840, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.06% (0.3130 => 0.3257, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.80% (3.9660 => 4.1169, std. dev.: 0.0038) MultiSource/Applications/SPASS/SPASS: 3.22% (13.8202 => 14.2653, std. dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.06% (0.6959 => 0.7172, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.06% (0.5265 => 0.5426, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 2.93% (1.0594 => 1.0904, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.66% (0.5637 => 0.5787, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.60% (1.1364 => 1.1660, std. dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/football/football: 2.60% (0.8310 => 0.8526, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.58% (1.2193 => 1.2508, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 2.54% (0.4328 => 0.4438, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.47% (0.9199 => 0.9426, std. dev.: 0.0007) MultiSource/Applications/kimwitu++/kc: 2.44% (16.6129 => 17.0189, std. dev.: 0.0054) MultiSource/Applications/siod/siod: 2.32% (2.1791 => 2.2297, std. dev.: 0.0116) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.25% (0.4791 => 0.4899, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.23% (1.4563 => 1.4888, std. dev.: 0.0108) MultiSource/Benchmarks/MallocBench/gs/gs: 2.16% (3.8646 => 3.9480, std. dev.: 0.0015) MultiSource/Applications/lambda-0_1_3/lambda: 2.12% (0.7038 => 0.7187, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.12% (0.5577 => 0.5695, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.08% (0.7710 => 0.7870, std. dev.: 0.0021) MultiSource/Applications/Burg/burg: 2.01% (1.1061 => 1.1283, std. dev.: 0.0077) MultiSource/Applications/treecc/treecc: 1.96% (1.9270 => 1.9647, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.90% (1.3245 => 1.3497, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.89% (0.7460 => 0.7601, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.85% (1.3813 => 1.4069, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.77% (13.2842 => 13.5195, std. dev.: 0.0183) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.76% (1.3819 => 1.4062, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.67% (3.6692 => 3.7305, std. dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.66% (0.6283 => 0.6387, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.64% (2.1007 => 2.1351, std. dev.: 0.0018) MultiSource/Applications/minisat/minisat: 1.51% (0.6744 => 0.6846, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 1.44% (1.3693 => 1.3890, std. dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.41% (3.2742 => 3.3203, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.34% (1.5188 => 1.5391, std. dev.: 0.0013) MultiSource/Applications/JM/lencod/lencod: 1.33% (14.8535 => 15.0511, std. dev.: 0.0125) MultiSource/Applications/sqlite3/sqlite3: 1.23% (16.2614 => 16.4622, std. dev.: 0.0111) MultiSource/Applications/JM/ldecod/ldecod: 1.23% (6.5754 => 6.6561, std. dev.: 0.0134) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.30% (1.8175 => 2.2592, std. dev.: 0.0265) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6754, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 3.60% (7.4271 => 7.6947, std. dev.: 0.0080) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.60% (1.7688 => 1.8325, std. dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 3.27% (0.9692 => 1.0009, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4542, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.97% (8.8259 => 9.0883, std. dev.: 0.0187) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.29% (7.9275 => 8.1090, std. dev.: 0.0051) SingleSource/Benchmarks/Misc/ffbench: 2.18% (0.8273 => 0.8453, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: 1.45% (1.9290 => 1.9570, std. dev.: 0.0015) MultiSource/Benchmarks/sim/sim: 1.32% (5.0168 => 5.0830, std. dev.: 0.0035) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.27% (2.0200 => 2.0456, std. dev.: 0.0005) MultiSource/Applications/lemon/lemon: 1.22% (1.4298 => 1.4472, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -19.43% (0.4657 => 0.3752, std. dev.: 0.0062) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.37% (0.2670 => 0.2500, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.10% (0.3511 => 0.3297, std. dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.73% (22.5627 => 21.2706, std. dev.: 0.0060) SingleSource/UnitTests/ObjC/exceptions-3: -3.92% (0.3623 => 0.3481, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.92% (0.3650 => 0.3507, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -3.77% (0.3578 => 0.3443, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -3.73% (0.3646 => 0.3510, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-2: -3.72% (0.3601 => 0.3467, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/synchronized: -3.63% (0.3663 => 0.3530, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -3.48% (0.3940 => 0.3803, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -3.38% (0.3789 => 0.3661, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -3.19% (0.3914 => 0.3789, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: -3.10% (0.4003 => 0.3879, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.76% (0.8818 => 0.8575, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.37% (0.6576 => 0.6420, std. dev.: 0.0008) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/richards_benchmark: -12.68% (1.1560 => 1.0094, std. dev.: 0.0090) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.12% (1.0460 => 0.9401, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.07% (1.2308 => 1.1069, std. dev.: 0.0031) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.63% (0.3139 => 0.2931, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.07% (1.3780 => 1.3081, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9472, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.33% (0.2333 => 0.2232, std. dev.: 0.0011) MultiSource/Benchmarks/Olden/bh/bh: -3.74% (1.9762 => 1.9023, std. dev.: 0.0091) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: -2.10% (9.3358 => 9.1396, std. dev.: 0.0025) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.96% (6.6320 => 6.5017, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout/lists: -1.91% (6.3560 => 6.2347, std. dev.: 0.0018) MultiSource/Applications/spiff/spiff: -1.84% (3.0263 => 2.9705, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.66% (7.1097 => 6.9914, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/heapsort: -1.52% (3.9173 => 3.8578, std. dev.: 0.0087) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.49% (20.3410 => 20.0385, std. dev.: 0.0563) MultiSource/Benchmarks/Bullet/bullet: -1.44% (7.3305 => 7.2246, std. dev.: 0.0212) MultiSource/Applications/lua/lua: -1.23% (26.5159 => 26.1895, std. dev.: 0.0348) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.12% (3.8887 => 3.8452, std. dev.: 0.0041) MultiSource/Benchmarks/nbench/nbench: -1.00% (11.2619 => 11.1488, std. dev.: 0.0013) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.36s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun May 6 12:01:58 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 6 May 2012 14:01:58 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120506190158.4A6D22A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/545?compare_to=544&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 545, Order: 156263, Start Time: 2012-05-06 18:05:48, End Time: 2012-05-06 19:02:35 To: 544, Order: 156257, Start Time: 2012-05-06 14:25:17, End Time: 2012-05-06 15:21:51 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 3 (55 on baseline) Performance Improvements: 2 (38 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 887 (795 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/richards_benchmark: 12.08% (1.0094 => 1.1313, std. dev.: 0.0016) MultiSource/Benchmarks/nbench/nbench: 4.21% (11.1488 => 11.6179, std. dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.07% (0.9401 => 0.9502, std. dev.: 0.0000) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/dry: -3.99% (2.5084 => 2.4082, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.47% (3.2033 => 3.1561, std. dev.: 0.0004) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.19% (2.0176 => 2.2838, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.90% (0.3130 => 0.3346, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.26% (0.2721 => 0.2837, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.59% (3.9660 => 4.1083, std. dev.: 0.0039) MultiSource/Applications/SPASS/SPASS: 3.37% (13.8202 => 14.2855, std. dev.: 0.0023) MultiSource/Benchmarks/nbench/nbench: 2.94% (1.0594 => 1.0905, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.93% (0.6959 => 0.7163, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.89% (0.5265 => 0.5417, std. dev.: 0.0024) MultiSource/Applications/lambda-0_1_3/lambda: 2.69% (0.7038 => 0.7227, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.68% (1.1364 => 1.1669, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.67% (0.9199 => 0.9445, std. dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/football/football: 2.62% (0.8310 => 0.8528, std. dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/hash2: 2.56% (0.4328 => 0.4439, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.42% (1.2193 => 1.2488, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.39% (0.5637 => 0.5772, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 2.35% (2.1791 => 2.2304, std. dev.: 0.0054) MultiSource/Applications/kimwitu++/kc: 2.35% (16.6129 => 17.0036, std. dev.: 0.0160) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.22% (1.4563 => 1.4887, std. dev.: 0.0028) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.01% (0.7460 => 0.7610, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/gs/gs: 2.01% (3.8646 => 3.9423, std. dev.: 0.0115) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.94% (0.5577 => 0.5685, std. dev.: 0.0009) MultiSource/Applications/Burg/burg: 1.92% (1.1061 => 1.1273, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.90% (1.3245 => 1.3497, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 1.86% (1.9270 => 1.9628, std. dev.: 0.0015) MultiSource/Applications/SIBsim4/SIBsim4: 1.82% (1.2749 => 1.2981, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.74% (13.2842 => 13.5155, std. dev.: 0.0069) MultiSource/Applications/hbd/hbd: 1.74% (1.3693 => 1.3931, std. dev.: 0.0060) MultiSource/Applications/sqlite3/sqlite3: 1.68% (16.2614 => 16.5348, std. dev.: 0.0063) MultiSource/Applications/minisat/minisat: 1.60% (0.6744 => 0.6852, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.59% (2.1007 => 2.1342, std. dev.: 0.0064) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.59% (3.6692 => 3.7276, std. dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.59% (0.6283 => 0.6383, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.50% (1.3813 => 1.4020, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.45% (1.3819 => 1.4019, std. dev.: 0.0023) MultiSource/Applications/JM/lencod/lencod: 1.32% (14.8535 => 15.0497, std. dev.: 0.0096) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.32% (3.2742 => 3.3173, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.26% (1.5188 => 1.5379, std. dev.: 0.0008) MultiSource/Applications/JM/ldecod/ldecod: 1.21% (6.5754 => 6.6550, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.08% (4.9865 => 5.0406, std. dev.: 0.0035) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.24% (1.8175 => 2.2580, std. dev.: 0.0372) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.87% (1.5824 => 1.6753, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 3.62% (7.4271 => 7.6962, std. dev.: 0.0047) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.61% (1.7688 => 1.8327, std. dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 3.28% (0.9692 => 1.0010, std. dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 3.16% (11.2619 => 11.6179, std. dev.: 0.0034) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4533, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.78% (8.8259 => 9.0712, std. dev.: 0.0129) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.34% (7.9275 => 8.1133, std. dev.: 0.0115) SingleSource/Benchmarks/Misc/ffbench: 2.20% (0.8273 => 0.8455, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0052) MultiSource/Applications/lemon/lemon: 1.44% (1.4298 => 1.4504, std. dev.: 0.0052) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.27% (2.0200 => 2.0457, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.55% (0.2670 => 0.2495, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.87% (0.3511 => 0.3305, std. dev.: 0.0041) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.60% (22.5627 => 21.2993, std. dev.: 0.0092) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.68% (0.3650 => 0.3479, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: -4.66% (0.3623 => 0.3454, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -4.53% (0.3601 => 0.3438, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -4.42% (0.3578 => 0.3420, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -4.34% (0.3663 => 0.3504, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -4.33% (0.3646 => 0.3488, std. dev.: 0.0034) SingleSource/UnitTests/ObjC/property: -4.14% (0.3940 => 0.3777, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -4.01% (0.3789 => 0.3637, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -3.91% (0.3914 => 0.3761, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: -3.70% (0.4003 => 0.3855, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.89% (0.6576 => 0.6386, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.84% (0.8818 => 0.8568, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/Hello: -2.49% (0.5748 => 0.5605, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: -1.96% (0.5818 => 0.5704, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: -1.53% (0.7061 => 0.6953, std. dev.: 0.0023) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -9.92% (1.2308 => 1.1087, std. dev.: 0.0081) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.16% (1.0460 => 0.9502, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.59% (0.3139 => 0.2932, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9474, std. dev.: 0.0003) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.56% (1.3780 => 1.3152, std. dev.: 0.0019) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -4.01% (2.5089 => 2.4082, std. dev.: 0.0028) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.60% (1.9762 => 1.9050, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/lists: -2.15% (6.3560 => 6.2192, std. dev.: 0.0082) SingleSource/Benchmarks/Misc/richards_benchmark: -2.14% (1.1560 => 1.1313, std. dev.: 0.0016) MultiSource/Applications/minisat/minisat: -2.00% (9.3358 => 9.1491, std. dev.: 0.0035) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.98% (6.6320 => 6.5006, std. dev.: 0.0038) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.86% (20.3410 => 19.9617, std. dev.: 0.0659) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9954, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/heapsort: -1.45% (3.9173 => 3.8604, std. dev.: 0.0060) MultiSource/Benchmarks/Bullet/bullet: -1.28% (7.3305 => 7.2368, std. dev.: 0.0300) MultiSource/Applications/lua/lua: -1.21% (26.5159 => 26.1947, std. dev.: 0.0092) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.21s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun May 6 13:25:09 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 6 May 2012 15:25:09 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120506202509.555802A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/546?compare_to=545&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 546, Order: 156266, Start Time: 2012-05-06 19:29:10, End Time: 2012-05-06 20:25:46 To: 545, Order: 156263, Start Time: 2012-05-06 18:05:48, End Time: 2012-05-06 19:02:35 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (50 on baseline) Performance Improvements: 0 (41 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (797 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.29% (2.0176 => 2.2857, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.49% (0.3130 => 0.3333, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.01% (0.2721 => 0.2830, std. dev.: 0.0025) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.31% (3.9660 => 4.0973, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.95% (0.6959 => 0.7164, std. dev.: 0.0034) MultiSource/Benchmarks/nbench/nbench: 2.86% (1.0594 => 1.0897, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.83% (0.5265 => 0.5414, std. dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 2.83% (13.8202 => 14.2107, std. dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/football/football: 2.50% (0.8310 => 0.8518, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.41% (0.9199 => 0.9421, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.38% (1.1364 => 1.1635, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.25% (0.5637 => 0.5764, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.25% (1.2193 => 1.2467, std. dev.: 0.0023) MultiSource/Applications/lambda-0_1_3/lambda: 2.22% (0.7038 => 0.7194, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.14% (1.4563 => 1.4875, std. dev.: 0.0028) MultiSource/Applications/kimwitu++/kc: 2.02% (16.6129 => 16.9481, std. dev.: 0.0153) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.88% (0.5577 => 0.5682, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.72% (1.3245 => 1.3473, std. dev.: 0.0061) MultiSource/Benchmarks/MallocBench/gs/gs: 1.72% (3.8646 => 3.9311, std. dev.: 0.0035) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.72% (0.7460 => 0.7588, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 1.62% (16.2614 => 16.5242, std. dev.: 0.0120) MultiSource/Applications/Burg/burg: 1.58% (1.1061 => 1.1236, std. dev.: 0.0020) MultiSource/Applications/SIBsim4/SIBsim4: 1.58% (1.2749 => 1.2950, std. dev.: 0.0046) MultiSource/Applications/treecc/treecc: 1.57% (1.9270 => 1.9572, std. dev.: 0.0028) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.49% (0.7710 => 0.7825, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.47% (13.2842 => 13.4792, std. dev.: 0.0086) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.39% (2.1007 => 2.1298, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.29% (3.6692 => 3.7165, std. dev.: 0.0006) MultiSource/Applications/hbd/hbd: 1.29% (1.3693 => 1.3869, std. dev.: 0.0040) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.28% (1.3819 => 1.3996, std. dev.: 0.0024) MultiSource/Applications/JM/lencod/lencod: 1.24% (14.8535 => 15.0382, std. dev.: 0.0029) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.23% (1.3813 => 1.3983, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.07% (3.2742 => 3.3093, std. dev.: 0.0065) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.49% (1.8175 => 2.2626, std. dev.: 0.0391) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.86% (1.5824 => 1.6751, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.65% (1.7688 => 1.8334, std. dev.: 0.0061) SingleSource/Benchmarks/Misc/salsa20: 3.60% (7.4271 => 7.6945, std. dev.: 0.0093) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 3.29% (0.9692 => 1.0011, std. dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 3.15% (11.2619 => 11.6169, std. dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 3.10% (8.8259 => 9.0995, std. dev.: 0.0983) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4546, std. dev.: 0.0017) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.48% (7.9275 => 8.1241, std. dev.: 0.0091) SingleSource/Benchmarks/Misc/ffbench: 2.24% (0.8273 => 0.8458, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.60% (1.9290 => 1.9599, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 1.50% (5.0168 => 5.0923, std. dev.: 0.0009) MultiSource/Applications/lemon/lemon: 1.45% (1.4298 => 1.4505, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.26% (2.0200 => 2.0455, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -21.28% (0.4657 => 0.3666, std. dev.: 0.0145) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.93% (0.2670 => 0.2485, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.29% (0.3511 => 0.3290, std. dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.08% (22.5627 => 21.1904, std. dev.: 0.0084) SingleSource/UnitTests/ObjC/exceptions-3: -4.72% (0.3623 => 0.3452, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -4.64% (0.3601 => 0.3434, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -4.61% (0.3578 => 0.3413, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -4.58% (0.3646 => 0.3479, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.58% (0.3650 => 0.3483, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/synchronized: -4.45% (0.3663 => 0.3500, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -4.29% (0.3940 => 0.3771, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -4.20% (0.3789 => 0.3630, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: -3.88% (0.3914 => 0.3762, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -3.80% (0.4003 => 0.3851, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.16% (0.8818 => 0.8539, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.69% (0.6576 => 0.6399, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/Hello: -2.57% (0.5748 => 0.5600, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: -2.30% (0.5818 => 0.5684, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: -1.92% (0.6250 => 0.6130, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: -1.64% (0.7061 => 0.6945, std. dev.: 0.0017) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -10.72% (1.2308 => 1.0988, std. dev.: 0.0057) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.59% (0.3139 => 0.2932, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9473, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.83% (1.3780 => 1.3115, std. dev.: 0.0051) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -4.03% (2.5089 => 2.4077, std. dev.: 0.0014) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.73% (0.3458 => 0.3329, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.60% (1.9762 => 1.9051, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.38% (20.3410 => 19.8579, std. dev.: 0.1055) SingleSource/Benchmarks/Shootout/lists: -2.27% (6.3560 => 6.2118, std. dev.: 0.0093) SingleSource/Benchmarks/Misc/richards_benchmark: -2.15% (1.1560 => 1.1311, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: -1.97% (9.3358 => 9.1519, std. dev.: 0.0103) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.87% (6.6320 => 6.5080, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9953, std. dev.: 0.0005) MultiSource/Applications/lua/lua: -1.27% (26.5159 => 26.1804, std. dev.: 0.0536) MultiSource/Benchmarks/Bullet/bullet: -1.25% (7.3305 => 7.2388, std. dev.: 0.0054) SingleSource/Benchmarks/Shootout/heapsort: -1.22% (3.9173 => 3.8697, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.06% (3.8887 => 3.8475, std. dev.: 0.0046) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.50s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun May 6 14:48:02 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 6 May 2012 16:48:02 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120506214802.E64322A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/547?compare_to=546&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 547, Order: 156269, Start Time: 2012-05-06 20:52:06, End Time: 2012-05-06 21:48:40 To: 546, Order: 156266, Start Time: 2012-05-06 19:29:10, End Time: 2012-05-06 20:25:46 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (53 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 891 (796 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/ary3: 1.17% (3.7054 => 3.7486, std. dev.: 0.0095) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.18% (2.0176 => 2.2836, std. dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.52% (0.3130 => 0.3334, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.26% (0.2721 => 0.2837, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.53% (3.9660 => 4.1060, std. dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.35% (0.6959 => 0.7192, std. dev.: 0.0089) MultiSource/Applications/SPASS/SPASS: 3.12% (13.8202 => 14.2518, std. dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.06% (0.5265 => 0.5426, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.76% (0.9199 => 0.9453, std. dev.: 0.0029) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.52% (1.1364 => 1.1650, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.48% (0.5637 => 0.5777, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 2.47% (0.4328 => 0.4435, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/football/football: 2.45% (0.8310 => 0.8514, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.42% (1.2193 => 1.2488, std. dev.: 0.0103) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.31% (1.4563 => 1.4899, std. dev.: 0.0078) MultiSource/Applications/lambda-0_1_3/lambda: 2.24% (0.7038 => 0.7196, std. dev.: 0.0010) MultiSource/Applications/kimwitu++/kc: 2.11% (16.6129 => 16.9637, std. dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.10% (0.5577 => 0.5694, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 2.06% (2.1791 => 2.2240, std. dev.: 0.0032) MultiSource/Benchmarks/MallocBench/gs/gs: 1.99% (3.8646 => 3.9415, std. dev.: 0.0039) MultiSource/Applications/Burg/burg: 1.88% (1.1061 => 1.1269, std. dev.: 0.0038) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.86% (0.7460 => 0.7599, std. dev.: 0.0008) MultiSource/Applications/treecc/treecc: 1.83% (1.9270 => 1.9622, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.79% (1.3245 => 1.3482, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.78% (13.2842 => 13.5202, std. dev.: 0.0054) MultiSource/Applications/SIBsim4/SIBsim4: 1.63% (1.2749 => 1.2957, std. dev.: 0.0016) MultiSource/Applications/hbd/hbd: 1.58% (1.3693 => 1.3909, std. dev.: 0.0052) MultiSource/Applications/sqlite3/sqlite3: 1.57% (16.2614 => 16.5161, std. dev.: 0.0102) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.56% (0.7710 => 0.7830, std. dev.: 0.0019) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.44% (1.3813 => 1.4012, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.44% (1.3819 => 1.4018, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.44% (3.6692 => 3.7220, std. dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.38% (2.1007 => 2.1297, std. dev.: 0.0011) MultiSource/Applications/JM/lencod/lencod: 1.36% (14.8535 => 15.0550, std. dev.: 0.0115) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.12% (3.2742 => 3.3108, std. dev.: 0.0008) MultiSource/Applications/JM/ldecod/ldecod: 1.12% (6.5754 => 6.6488, std. dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.11% (1.5188 => 1.5356, std. dev.: 0.0007) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.08% (1.8175 => 2.2552, std. dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.90% (1.5824 => 1.6758, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8146, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.74% (1.7688 => 1.8350, std. dev.: 0.0055) SingleSource/Benchmarks/Misc/salsa20: 3.72% (7.4271 => 7.7033, std. dev.: 0.0022) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 3.29% (0.9692 => 1.0011, std. dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 3.18% (11.2619 => 11.6205, std. dev.: 0.0030) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4547, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.98% (8.8259 => 9.0887, std. dev.: 0.0074) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.41% (7.9275 => 8.1182, std. dev.: 0.0217) SingleSource/Benchmarks/Misc/ffbench: 2.26% (0.8273 => 0.8460, std. dev.: 0.0064) SingleSource/Benchmarks/Dhrystone/fldry: 1.60% (1.9290 => 1.9599, std. dev.: 0.0084) MultiSource/Applications/lemon/lemon: 1.44% (1.4298 => 1.4504, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/ary3: 1.38% (3.6975 => 3.7486, std. dev.: 0.0095) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.26% (2.0200 => 2.0454, std. dev.: 0.0063) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -19.71% (0.4657 => 0.3739, std. dev.: 0.0057) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.59% (0.2670 => 0.2494, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.98% (0.3511 => 0.3301, std. dev.: 0.0008) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.98% (22.5627 => 21.2136, std. dev.: 0.0152) SingleSource/UnitTests/ObjC/exceptions-3: -3.51% (0.3623 => 0.3496, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -3.47% (0.3601 => 0.3476, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.45% (0.3650 => 0.3524, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -3.35% (0.3578 => 0.3458, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -3.32% (0.3646 => 0.3525, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -3.30% (0.3663 => 0.3542, std. dev.: 0.0016) SingleSource/UnitTests/ObjC/property: -3.15% (0.3940 => 0.3816, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: -3.01% (0.3789 => 0.3675, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.99% (0.8818 => 0.8554, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions: -2.89% (0.3914 => 0.3801, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -2.77% (0.4003 => 0.3892, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: -2.09% (0.5748 => 0.5628, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: -1.80% (0.5818 => 0.5713, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.79% (0.6576 => 0.6458, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/bigfib: -1.71% (0.6250 => 0.6143, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -10.67% (1.2308 => 1.0995, std. dev.: 0.0049) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.16% (1.0460 => 0.9502, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.53% (0.3139 => 0.2934, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.96% (1.3780 => 1.3096, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9472, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -4.01% (2.5089 => 2.4084, std. dev.: 0.0013) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.73% (0.3458 => 0.3329, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.66% (1.9762 => 1.9039, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/lists: -2.18% (6.3560 => 6.2172, std. dev.: 0.0043) SingleSource/Benchmarks/Misc/richards_benchmark: -2.13% (1.1560 => 1.1314, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.10% (20.3410 => 19.9141, std. dev.: 0.0538) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.90% (6.6320 => 6.5058, std. dev.: 0.0027) MultiSource/Applications/minisat/minisat: -1.86% (9.3358 => 9.1625, std. dev.: 0.0086) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9955, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/heapsort: -1.39% (3.9173 => 3.8629, std. dev.: 0.0023) MultiSource/Applications/lua/lua: -1.33% (26.5159 => 26.1633, std. dev.: 0.0165) MultiSource/Benchmarks/Bullet/bullet: -1.27% (7.3305 => 7.2376, std. dev.: 0.0243) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.30s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun May 6 18:40:48 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 6 May 2012 20:40:48 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120507014048.4CC842A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/548?compare_to=547&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 548, Order: 156271, Start Time: 2012-05-07 00:44:50, End Time: 2012-05-07 01:41:25 To: 547, Order: 156269, Start Time: 2012-05-06 20:52:06, End Time: 2012-05-06 21:48:40 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (50 on baseline) Performance Improvements: 1 (38 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 890 (800 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 1.21% (7.9464 => 8.0428, std. dev.: 0.0287) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/ary3: -1.33% (3.7486 => 3.6987, std. dev.: 0.0136) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.15% (2.0176 => 2.2829, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.20% (0.3130 => 0.3324, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.15% (0.2721 => 0.2834, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.32% (3.9660 => 4.0978, std. dev.: 0.0036) MultiSource/Applications/SPASS/SPASS: 2.89% (13.8202 => 14.2190, std. dev.: 0.0140) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.70% (0.6959 => 0.7147, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.70% (0.5265 => 0.5407, std. dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 2.61% (1.0594 => 1.0871, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/football/football: 2.50% (0.8310 => 0.8518, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.44% (0.9199 => 0.9423, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.37% (1.1364 => 1.1633, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.24% (1.2193 => 1.2466, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.13% (0.5637 => 0.5757, std. dev.: 0.0031) MultiSource/Applications/lambda-0_1_3/lambda: 2.02% (0.7038 => 0.7180, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.99% (1.4563 => 1.4853, std. dev.: 0.0022) MultiSource/Applications/kimwitu++/kc: 1.92% (16.6129 => 16.9313, std. dev.: 0.0187) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.88% (0.5577 => 0.5682, std. dev.: 0.0012) MultiSource/Applications/siod/siod: 1.87% (2.1791 => 2.2198, std. dev.: 0.0034) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.85% (0.7710 => 0.7853, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/gs/gs: 1.67% (3.8646 => 3.9293, std. dev.: 0.0037) MultiSource/Applications/Burg/burg: 1.62% (1.1061 => 1.1240, std. dev.: 0.0007) MultiSource/Applications/SIBsim4/SIBsim4: 1.61% (1.2749 => 1.2954, std. dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.60% (1.3245 => 1.3457, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.54% (0.7460 => 0.7575, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.48% (13.2842 => 13.4814, std. dev.: 0.0036) MultiSource/Applications/treecc/treecc: 1.47% (1.9270 => 1.9554, std. dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 1.44% (16.2614 => 16.4952, std. dev.: 0.0048) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.40% (1.3819 => 1.4012, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.36% (3.6692 => 3.7191, std. dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.35% (2.1007 => 2.1291, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.24% (1.3813 => 1.3984, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.15% (3.2742 => 3.3118, std. dev.: 0.0023) MultiSource/Applications/hbd/hbd: 1.15% (1.3693 => 1.3850, std. dev.: 0.0048) MultiSource/Applications/JM/lencod/lencod: 1.14% (14.8535 => 15.0235, std. dev.: 0.0017) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.62% (1.8175 => 2.2649, std. dev.: 0.0207) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.52% (2.5629 => 2.7299, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.89% (1.5824 => 1.6756, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.65% (1.7688 => 1.8333, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/salsa20: 3.53% (7.4271 => 7.6893, std. dev.: 0.0055) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 3.29% (0.9692 => 1.0011, std. dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 3.17% (11.2619 => 11.6193, std. dev.: 0.0045) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4542, std. dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.92% (8.8259 => 9.0832, std. dev.: 0.0089) SingleSource/Benchmarks/Misc/ffbench: 2.25% (0.8273 => 0.8459, std. dev.: 0.0037) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.19% (7.9275 => 8.1012, std. dev.: 0.0109) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9603, std. dev.: 0.0071) MultiSource/Applications/lemon/lemon: 1.49% (1.4298 => 1.4511, std. dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.30% (2.0200 => 2.0462, std. dev.: 0.0044) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.85% (0.2670 => 0.2487, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.21% (0.3511 => 0.3293, std. dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.06% (22.5627 => 21.1947, std. dev.: 0.0141) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.90% (0.3650 => 0.3471, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-3: -4.89% (0.3623 => 0.3446, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -4.80% (0.3601 => 0.3428, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -4.70% (0.3578 => 0.3410, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: -4.69% (0.3646 => 0.3475, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -4.61% (0.3663 => 0.3494, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -4.37% (0.3940 => 0.3768, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -4.33% (0.3789 => 0.3625, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -4.14% (0.3914 => 0.3752, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -4.00% (0.4003 => 0.3843, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.93% (0.8818 => 0.8560, std. dev.: 0.0038) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.60% (0.6576 => 0.6405, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/Hello: -2.23% (0.5748 => 0.5620, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: -2.18% (0.6250 => 0.6114, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: -2.10% (0.5818 => 0.5696, std. dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -9.82% (1.2308 => 1.1099, std. dev.: 0.0064) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.16% (1.0460 => 0.9502, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.53% (0.3139 => 0.2934, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.11% (1.3780 => 1.3076, std. dev.: 0.0068) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9474, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0011) SingleSource/Benchmarks/Dhrystone/dry: -4.01% (2.5089 => 2.4084, std. dev.: 0.0012) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.76% (0.3458 => 0.3328, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -3.63% (1.9762 => 1.9044, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/richards_benchmark: -2.13% (1.1560 => 1.1314, std. dev.: 0.0014) MultiSource/Applications/minisat/minisat: -2.12% (9.3358 => 9.1380, std. dev.: 0.0084) SingleSource/Benchmarks/Shootout/lists: -1.96% (6.3560 => 6.2317, std. dev.: 0.0055) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.84% (6.6320 => 6.5099, std. dev.: 0.0030) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.78% (20.3410 => 19.9799, std. dev.: 0.0226) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9955, std. dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -1.49% (7.3305 => 7.2213, std. dev.: 0.0147) SingleSource/Benchmarks/Shootout/heapsort: -1.45% (3.9173 => 3.8605, std. dev.: 0.0055) MultiSource/Applications/lua/lua: -1.20% (26.5159 => 26.1971, std. dev.: 0.0190) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.67s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun May 6 20:03:27 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 6 May 2012 22:03:27 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120507030327.0124A2A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/549?compare_to=548&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 549, Order: 156275, Start Time: 2012-05-07 02:07:36, End Time: 2012-05-07 03:04:04 To: 548, Order: 156271, Start Time: 2012-05-07 00:44:50, End Time: 2012-05-07 01:41:25 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (50 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (798 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.08% (2.0176 => 2.2816, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.23% (0.3130 => 0.3325, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.19% (0.2721 => 0.2835, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.39% (3.9660 => 4.1003, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.83% (0.5265 => 0.5414, std. dev.: 0.0019) MultiSource/Benchmarks/nbench/nbench: 2.78% (1.0594 => 1.0888, std. dev.: 0.0034) MultiSource/Applications/SPASS/SPASS: 2.75% (13.8202 => 14.2005, std. dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.57% (0.6959 => 0.7138, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.55% (0.9199 => 0.9434, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 2.52% (0.8310 => 0.8519, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.31% (1.1364 => 1.1627, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.29% (0.5637 => 0.5766, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.20% (1.2193 => 1.2461, std. dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: 2.09% (0.7038 => 0.7185, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 1.97% (2.1791 => 2.2220, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.96% (1.4563 => 1.4849, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.92% (0.5577 => 0.5684, std. dev.: 0.0011) MultiSource/Applications/kimwitu++/kc: 1.89% (16.6129 => 16.9268, std. dev.: 0.0076) MultiSource/Benchmarks/MallocBench/gs/gs: 1.86% (3.8646 => 3.9365, std. dev.: 0.0074) MultiSource/Applications/Burg/burg: 1.78% (1.1061 => 1.1258, std. dev.: 0.0060) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.66% (0.7710 => 0.7838, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.65% (13.2842 => 13.5034, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.64% (1.3245 => 1.3462, std. dev.: 0.0012) MultiSource/Applications/treecc/treecc: 1.60% (1.9270 => 1.9579, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.54% (0.7460 => 0.7575, std. dev.: 0.0018) MultiSource/Applications/SIBsim4/SIBsim4: 1.54% (1.2749 => 1.2945, std. dev.: 0.0054) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.39% (1.3819 => 1.4011, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.37% (3.6692 => 3.7195, std. dev.: 0.0022) MultiSource/Applications/sqlite3/sqlite3: 1.35% (16.2614 => 16.4804, std. dev.: 0.0253) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.25% (1.3813 => 1.3986, std. dev.: 0.0010) MultiSource/Applications/hbd/hbd: 1.23% (1.3693 => 1.3861, std. dev.: 0.0006) MultiSource/Applications/JM/lencod/lencod: 1.19% (14.8535 => 15.0302, std. dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.12% (3.2742 => 3.3110, std. dev.: 0.0022) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.31% (1.8175 => 2.2594, std. dev.: 0.0479) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.52% (2.5629 => 2.7299, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.90% (1.5824 => 1.6758, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.69% (1.7688 => 1.8341, std. dev.: 0.0052) SingleSource/Benchmarks/Misc/salsa20: 3.54% (7.4271 => 7.6902, std. dev.: 0.0029) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 3.25% (0.9692 => 1.0007, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 3.17% (11.2619 => 11.6188, std. dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4531, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.66% (8.8259 => 9.0609, std. dev.: 0.0188) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.42% (7.9275 => 8.1196, std. dev.: 0.0071) SingleSource/Benchmarks/Misc/ffbench: 2.19% (0.8273 => 0.8454, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9601, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.43% (1.4298 => 1.4503, std. dev.: 0.0007) MultiSource/Benchmarks/sim/sim: 1.31% (5.0168 => 5.0823, std. dev.: 0.0085) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.28% (2.0200 => 2.0459, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -18.62% (0.4657 => 0.3790, std. dev.: 0.0237) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.82% (0.2670 => 0.2488, std. dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.17% (22.5627 => 21.1704, std. dev.: 0.0041) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.15% (0.3511 => 0.3295, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-3: -4.03% (0.3623 => 0.3477, std. dev.: 0.0026) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.03% (0.3650 => 0.3503, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -3.94% (0.3601 => 0.3459, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -3.89% (0.3646 => 0.3504, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: -3.88% (0.3578 => 0.3439, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -3.79% (0.3663 => 0.3524, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -3.55% (0.3940 => 0.3800, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -3.40% (0.3914 => 0.3781, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -3.38% (0.3789 => 0.3661, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: -3.22% (0.4003 => 0.3874, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.90% (0.8818 => 0.8562, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.39% (0.6576 => 0.6419, std. dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/bigfib: -2.18% (0.6250 => 0.6114, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: -1.90% (0.5748 => 0.5639, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: -1.74% (0.5818 => 0.5717, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -10.15% (1.2308 => 1.1059, std. dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.56% (0.3139 => 0.2933, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.99% (1.3780 => 1.3092, std. dev.: 0.0078) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9474, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -4.01% (2.5089 => 2.4082, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -3.63% (1.9762 => 1.9045, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/lists: -2.28% (6.3560 => 6.2111, std. dev.: 0.0103) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.17% (20.3410 => 19.9005, std. dev.: 0.0456) SingleSource/Benchmarks/Misc/richards_benchmark: -2.13% (1.1560 => 1.1314, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: -1.91% (9.3358 => 9.1577, std. dev.: 0.0271) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.88% (6.6320 => 6.5071, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9953, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/heapsort: -1.57% (3.9173 => 3.8558, std. dev.: 0.0071) MultiSource/Applications/lua/lua: -1.27% (26.5159 => 26.1801, std. dev.: 0.0185) MultiSource/Benchmarks/Bullet/bullet: -1.23% (7.3305 => 7.2406, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.03% (3.8887 => 3.8487, std. dev.: 0.0047) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.63s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun May 6 21:26:24 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 6 May 2012 23:26:24 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120507042624.A4FFC2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/550?compare_to=549&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 550, Order: 156276, Start Time: 2012-05-07 03:30:16, End Time: 2012-05-07 04:27:02 To: 549, Order: 156275, Start Time: 2012-05-07 02:07:36, End Time: 2012-05-07 03:04:04 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (51 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (798 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.10% (2.0176 => 2.2819, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.23% (0.3130 => 0.3325, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.19% (0.2721 => 0.2835, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.50% (3.9660 => 4.1050, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.86% (0.6959 => 0.7158, std. dev.: 0.0018) MultiSource/Applications/SPASS/SPASS: 2.82% (13.8202 => 14.2099, std. dev.: 0.0083) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.81% (0.5265 => 0.5413, std. dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 2.76% (1.0594 => 1.0886, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.57% (0.9199 => 0.9435, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/football/football: 2.44% (0.8310 => 0.8513, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.41% (1.2193 => 1.2487, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.38% (1.1364 => 1.1634, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.29% (0.5637 => 0.5766, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 2.09% (0.7038 => 0.7185, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.01% (1.4563 => 1.4855, std. dev.: 0.0010) MultiSource/Applications/siod/siod: 1.97% (2.1791 => 2.2220, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/gs/gs: 1.91% (3.8646 => 3.9383, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.88% (0.5577 => 0.5682, std. dev.: 0.0010) MultiSource/Applications/kimwitu++/kc: 1.85% (16.6129 => 16.9206, std. dev.: 0.0074) MultiSource/Applications/Burg/burg: 1.78% (1.1061 => 1.1258, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.70% (1.3245 => 1.3470, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.67% (13.2842 => 13.5063, std. dev.: 0.0194) MultiSource/Applications/sqlite3/sqlite3: 1.61% (16.2614 => 16.5239, std. dev.: 0.0025) MultiSource/Applications/treecc/treecc: 1.61% (1.9270 => 1.9580, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.60% (0.7710 => 0.7833, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.57% (0.7460 => 0.7577, std. dev.: 0.0011) MultiSource/Applications/SIBsim4/SIBsim4: 1.52% (1.2749 => 1.2943, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.43% (3.6692 => 3.7216, std. dev.: 0.0025) MultiSource/Applications/hbd/hbd: 1.26% (1.3693 => 1.3866, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.26% (1.3813 => 1.3987, std. dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.24% (2.1007 => 2.1268, std. dev.: 0.0063) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.24% (1.3819 => 1.3990, std. dev.: 0.0029) MultiSource/Applications/JM/lencod/lencod: 1.20% (14.8535 => 15.0324, std. dev.: 0.0156) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.14% (3.2742 => 3.3115, std. dev.: 0.0011) MultiSource/Applications/JM/ldecod/ldecod: 1.01% (6.5754 => 6.6416, std. dev.: 0.0143) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.30% (1.8175 => 2.2591, std. dev.: 0.0255) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7298, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.90% (1.5824 => 1.6758, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8146, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 3.66% (7.4271 => 7.6992, std. dev.: 0.0019) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.63% (1.7688 => 1.8330, std. dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 3.29% (0.9692 => 1.0011, std. dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 3.17% (11.2619 => 11.6187, std. dev.: 0.0035) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4554, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.81% (8.8259 => 9.0740, std. dev.: 0.0140) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.32% (7.9275 => 8.1115, std. dev.: 0.0200) SingleSource/Benchmarks/Misc/ffbench: 2.20% (0.8273 => 0.8455, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: 1.60% (1.9290 => 1.9599, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.46% (1.4298 => 1.4507, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.26% (2.0200 => 2.0455, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -14.28% (0.4657 => 0.3992, std. dev.: 0.0091) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.82% (0.2670 => 0.2488, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.15% (0.3511 => 0.3295, std. dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.14% (22.5627 => 21.1782, std. dev.: 0.0066) SingleSource/UnitTests/ObjC/exceptions-3: -4.06% (0.3623 => 0.3476, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -3.94% (0.3601 => 0.3459, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.92% (0.3650 => 0.3507, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-4: -3.81% (0.3646 => 0.3507, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -3.79% (0.3663 => 0.3524, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -3.75% (0.3578 => 0.3444, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -3.68% (0.3940 => 0.3795, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -3.56% (0.3789 => 0.3654, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: -3.27% (0.3914 => 0.3786, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: -3.17% (0.4003 => 0.3876, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.87% (0.8818 => 0.8565, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.40% (0.6576 => 0.6418, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: -2.27% (0.6250 => 0.6108, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: -1.97% (0.5748 => 0.5635, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: -1.74% (0.5818 => 0.5717, std. dev.: 0.0024) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -10.74% (1.2308 => 1.0986, std. dev.: 0.0062) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.16% (1.0460 => 0.9502, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.56% (0.3139 => 0.2933, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9473, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.60% (1.3780 => 1.3146, std. dev.: 0.0089) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.94% (2.5089 => 2.4101, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.67% (0.3458 => 0.3331, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.54% (1.9762 => 1.9063, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/richards_benchmark: -2.14% (1.1560 => 1.1313, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -2.12% (6.3560 => 6.2215, std. dev.: 0.0100) MultiSource/Applications/minisat/minisat: -1.92% (9.3358 => 9.1564, std. dev.: 0.0056) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.86% (6.6320 => 6.5086, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3446, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9953, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.39% (20.3410 => 20.0583, std. dev.: 0.0417) MultiSource/Benchmarks/Bullet/bullet: -1.35% (7.3305 => 7.2317, std. dev.: 0.0062) MultiSource/Applications/lua/lua: -1.32% (26.5159 => 26.1660, std. dev.: 0.0063) SingleSource/Benchmarks/Shootout/heapsort: -1.30% (3.9173 => 3.8663, std. dev.: 0.0005) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.70s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun May 6 22:49:03 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 7 May 2012 00:49:03 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120507054903.B1E002A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/551?compare_to=550&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 551, Order: 156280, Start Time: 2012-05-07 04:53:14, End Time: 2012-05-07 05:49:40 To: 550, Order: 156276, Start Time: 2012-05-07 03:30:16, End Time: 2012-05-07 04:27:02 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (46 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (806 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.74% (2.0176 => 2.2746, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.07% (0.3130 => 0.3320, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.04% (0.2721 => 0.2831, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.18% (3.9660 => 4.0920, std. dev.: 0.0035) MultiSource/Applications/SPASS/SPASS: 2.74% (13.8202 => 14.1989, std. dev.: 0.0089) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.53% (0.5265 => 0.5398, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.47% (0.6959 => 0.7131, std. dev.: 0.0026) MultiSource/Benchmarks/nbench/nbench: 2.46% (1.0594 => 1.0855, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.38% (0.9199 => 0.9418, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 2.35% (0.8310 => 0.8505, std. dev.: 0.0041) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.20% (1.1364 => 1.1614, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.09% (0.5637 => 0.5755, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.07% (1.2193 => 1.2446, std. dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: 1.91% (16.6129 => 16.9304, std. dev.: 0.0030) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.89% (1.4563 => 1.4838, std. dev.: 0.0008) MultiSource/Applications/siod/siod: 1.87% (2.1791 => 2.2198, std. dev.: 0.0047) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.79% (0.7710 => 0.7848, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/gs/gs: 1.66% (3.8646 => 3.9287, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.51% (1.3245 => 1.3445, std. dev.: 0.0016) MultiSource/Applications/Burg/burg: 1.49% (1.1061 => 1.1226, std. dev.: 0.0005) MultiSource/Applications/hbd/hbd: 1.45% (1.3693 => 1.3891, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.44% (13.2842 => 13.4753, std. dev.: 0.0110) MultiSource/Applications/treecc/treecc: 1.44% (1.9270 => 1.9547, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.38% (0.7460 => 0.7563, std. dev.: 0.0020) MultiSource/Applications/sqlite3/sqlite3: 1.35% (16.2614 => 16.4804, std. dev.: 0.0161) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.26% (2.1007 => 2.1272, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.15% (1.3813 => 1.3972, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.11% (3.6692 => 3.7100, std. dev.: 0.0039) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.04% (1.3819 => 1.3963, std. dev.: 0.0017) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 23.95% (1.8175 => 2.2528, std. dev.: 0.0079) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7298, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.90% (1.5824 => 1.6757, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8147, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.71% (1.7688 => 1.8344, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: 3.53% (7.4271 => 7.6895, std. dev.: 0.0024) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 3.27% (0.9692 => 1.0009, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 3.17% (11.2619 => 11.6187, std. dev.: 0.0030) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4543, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.80% (8.8259 => 9.0733, std. dev.: 0.0210) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.49% (7.9275 => 8.1249, std. dev.: 0.0078) SingleSource/Benchmarks/Misc/ffbench: 2.20% (0.8273 => 0.8455, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.49% (1.4298 => 1.4511, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.27% (2.0200 => 2.0457, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: 1.11% (5.0168 => 5.0726, std. dev.: 0.0142) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.82% (0.2670 => 0.2488, std. dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.27% (22.5627 => 21.1482, std. dev.: 0.0205) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.15% (0.3511 => 0.3295, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.16% (0.3650 => 0.3498, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: -4.14% (0.3623 => 0.3473, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -4.14% (0.3601 => 0.3452, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -4.05% (0.3578 => 0.3433, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -4.01% (0.3663 => 0.3516, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -4.00% (0.3646 => 0.3500, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -3.76% (0.3940 => 0.3792, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -3.69% (0.3789 => 0.3649, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -3.47% (0.3914 => 0.3778, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: -3.37% (0.4003 => 0.3868, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.23% (0.8818 => 0.8533, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.62% (0.6576 => 0.6404, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: -2.13% (0.6250 => 0.6117, std. dev.: 0.0003) MultiSource/Applications/lua/lua: -1.12% (3.7467 => 3.7047, std. dev.: 0.0020) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -10.12% (1.2308 => 1.1063, std. dev.: 0.0066) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.59% (0.3139 => 0.2932, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9474, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -4.01% (2.5089 => 2.4083, std. dev.: 0.0039) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.67% (0.3458 => 0.3331, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -3.56% (1.9762 => 1.9058, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: -2.15% (1.1560 => 1.1312, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -2.13% (6.3560 => 6.2205, std. dev.: 0.0071) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.88% (6.6320 => 6.5075, std. dev.: 0.0048) MultiSource/Applications/minisat/minisat: -1.87% (9.3358 => 9.1608, std. dev.: 0.0123) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.68% (20.3410 => 19.9986, std. dev.: 0.0087) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9955, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/heapsort: -1.52% (3.9173 => 3.8576, std. dev.: 0.0049) MultiSource/Applications/lua/lua: -1.39% (26.5159 => 26.1468, std. dev.: 0.0367) MultiSource/Benchmarks/Bullet/bullet: -1.16% (7.3305 => 7.2456, std. dev.: 0.0152) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.11s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon May 7 01:36:16 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 7 May 2012 03:36:16 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120507083616.BECAA2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/552?compare_to=551&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 552, Order: 156296, Start Time: 2012-05-07 07:40:04, End Time: 2012-05-07 08:36:54 To: 551, Order: 156280, Start Time: 2012-05-07 04:53:14, End Time: 2012-05-07 05:49:40 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (47 on baseline) Performance Improvements: 0 (38 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 891 (803 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 25.59% (0.3646 => 0.4579, std. dev.: 0.0326) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.90% (2.0176 => 2.2779, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.20% (0.3130 => 0.3324, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.26% (0.2721 => 0.2837, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.26% (3.9660 => 4.0952, std. dev.: 0.0017) MultiSource/Benchmarks/nbench/nbench: 2.73% (1.0594 => 1.0883, std. dev.: 0.0051) MultiSource/Applications/SPASS/SPASS: 2.68% (13.8202 => 14.1911, std. dev.: 0.0099) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.64% (0.6959 => 0.7143, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.64% (0.5265 => 0.5404, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/football/football: 2.47% (0.8310 => 0.8515, std. dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.30% (0.9199 => 0.9411, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.26% (1.1364 => 1.1621, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.19% (1.2193 => 1.2460, std. dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.16% (0.5637 => 0.5759, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.97% (1.4563 => 1.4850, std. dev.: 0.0068) MultiSource/Applications/hbd/hbd: 1.77% (1.3693 => 1.3936, std. dev.: 0.0078) MultiSource/Applications/lambda-0_1_3/lambda: 1.68% (0.7038 => 0.7156, std. dev.: 0.0016) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.67% (0.7710 => 0.7839, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.56% (1.3819 => 1.4035, std. dev.: 0.0028) MultiSource/Applications/kimwitu++/kc: 1.55% (16.6129 => 16.8705, std. dev.: 0.0126) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.50% (1.3245 => 1.3444, std. dev.: 0.0020) MultiSource/Applications/Burg/burg: 1.47% (1.1061 => 1.1224, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.47% (13.2842 => 13.4795, std. dev.: 0.0187) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.43% (0.7460 => 0.7567, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/gs/gs: 1.42% (3.8646 => 3.9196, std. dev.: 0.0040) MultiSource/Applications/treecc/treecc: 1.39% (1.9270 => 1.9538, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.39% (1.3813 => 1.4005, std. dev.: 0.0013) MultiSource/Applications/SIBsim4/SIBsim4: 1.39% (1.2749 => 1.2926, std. dev.: 0.0067) MultiSource/Applications/sqlite3/sqlite3: 1.33% (16.2614 => 16.4774, std. dev.: 0.0161) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.25% (3.6692 => 3.7152, std. dev.: 0.0063) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.12% (2.1007 => 2.1243, std. dev.: 0.0017) MultiSource/Applications/JM/lencod/lencod: 1.09% (14.8535 => 15.0150, std. dev.: 0.0088) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.09% (1.8175 => 2.2553, std. dev.: 0.0055) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.85% (1.5824 => 1.6750, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8147, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.69% (1.7688 => 1.8341, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/salsa20: 3.48% (7.4271 => 7.6854, std. dev.: 0.0044) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 3.25% (0.9692 => 1.0007, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 3.16% (11.2619 => 11.6175, std. dev.: 0.0022) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4539, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.93% (8.8259 => 9.0843, std. dev.: 0.0213) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.43% (7.9275 => 8.1205, std. dev.: 0.0075) SingleSource/Benchmarks/Misc/ffbench: 2.25% (0.8273 => 0.8459, std. dev.: 0.0036) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9603, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.51% (1.4298 => 1.4514, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.29% (2.0200 => 2.0460, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.67% (0.2670 => 0.2492, std. dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.24% (22.5627 => 21.1538, std. dev.: 0.0076) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.44% (0.3511 => 0.3320, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -3.84% (0.3623 => 0.3484, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -3.75% (0.3601 => 0.3466, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -3.71% (0.3663 => 0.3527, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-4: -3.65% (0.3646 => 0.3513, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.64% (0.3650 => 0.3517, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/trivial-interface: -3.58% (0.3578 => 0.3450, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -3.50% (0.3940 => 0.3802, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: -3.33% (0.3789 => 0.3663, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.32% (0.8818 => 0.8525, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -3.27% (0.3914 => 0.3786, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/parameter-passing: -3.17% (0.4003 => 0.3876, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.98% (0.6576 => 0.6446, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: -1.87% (0.6250 => 0.6133, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: -1.79% (0.5748 => 0.5645, std. dev.: 0.0000) MultiSource/Applications/lua/lua: -1.20% (3.7467 => 3.7017, std. dev.: 0.0044) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -9.81% (1.2308 => 1.1101, std. dev.: 0.0157) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.16% (1.0460 => 0.9502, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.56% (0.3139 => 0.2933, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.99% (1.3780 => 1.3093, std. dev.: 0.0045) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9474, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -4.02% (2.5089 => 2.4080, std. dev.: 0.0013) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.66% (1.9762 => 1.9038, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout/lists: -2.28% (6.3560 => 6.2108, std. dev.: 0.0145) SingleSource/Benchmarks/Misc/richards_benchmark: -2.11% (1.1560 => 1.1316, std. dev.: 0.0000) MultiSource/Applications/minisat/minisat: -2.01% (9.3358 => 9.1481, std. dev.: 0.0036) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.96% (20.3410 => 19.9431, std. dev.: 0.0468) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.87% (6.6320 => 6.5083, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3446, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9958, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout/heapsort: -1.48% (3.9173 => 3.8592, std. dev.: 0.0081) MultiSource/Applications/lua/lua: -1.33% (26.5159 => 26.1643, std. dev.: 0.0075) MultiSource/Benchmarks/Bullet/bullet: -1.28% (7.3305 => 7.2367, std. dev.: 0.0066) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.89s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon May 7 03:30:34 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 7 May 2012 05:30:34 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120507103034.430C42A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/553?compare_to=552&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 553, Order: 156297, Start Time: 2012-05-07 09:34:39, End Time: 2012-05-07 10:31:11 To: 552, Order: 156296, Start Time: 2012-05-07 07:40:04, End Time: 2012-05-07 08:36:54 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (49 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (802 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.91% (2.0176 => 2.2781, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.17% (0.3130 => 0.3323, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.34% (0.2721 => 0.2839, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.31% (3.9660 => 4.0973, std. dev.: 0.0060) MultiSource/Benchmarks/nbench/nbench: 2.78% (1.0594 => 1.0888, std. dev.: 0.0030) MultiSource/Applications/SPASS/SPASS: 2.76% (13.8202 => 14.2022, std. dev.: 0.0147) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.68% (0.5265 => 0.5406, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.44% (0.6959 => 0.7129, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.34% (1.1364 => 1.1630, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 2.30% (0.8310 => 0.8501, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.25% (0.9199 => 0.9406, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.20% (1.2193 => 1.2461, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.18% (0.5637 => 0.5760, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.94% (1.4563 => 1.4846, std. dev.: 0.0075) MultiSource/Applications/hbd/hbd: 1.67% (1.3693 => 1.3921, std. dev.: 0.0036) MultiSource/Applications/siod/siod: 1.66% (2.1791 => 2.2153, std. dev.: 0.0088) MultiSource/Applications/lambda-0_1_3/lambda: 1.65% (0.7038 => 0.7154, std. dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 1.63% (16.6129 => 16.8843, std. dev.: 0.0155) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.62% (13.2842 => 13.4993, std. dev.: 0.0105) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.61% (0.7710 => 0.7834, std. dev.: 0.0022) MultiSource/Applications/Burg/burg: 1.56% (1.1061 => 1.1234, std. dev.: 0.0045) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.54% (0.7460 => 0.7575, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.51% (1.3819 => 1.4028, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.49% (3.6692 => 3.7239, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.47% (1.3245 => 1.3440, std. dev.: 0.0008) MultiSource/Applications/SIBsim4/SIBsim4: 1.44% (1.2749 => 1.2932, std. dev.: 0.0054) MultiSource/Benchmarks/MallocBench/gs/gs: 1.42% (3.8646 => 3.9196, std. dev.: 0.0047) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.41% (1.3813 => 1.4008, std. dev.: 0.0015) MultiSource/Applications/treecc/treecc: 1.35% (1.9270 => 1.9531, std. dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: 1.33% (16.2614 => 16.4777, std. dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.21% (3.2742 => 3.3137, std. dev.: 0.0123) MultiSource/Applications/JM/lencod/lencod: 1.11% (14.8535 => 15.0183, std. dev.: 0.0077) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.30% (1.8175 => 2.2592, std. dev.: 0.0083) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.92% (1.5824 => 1.6761, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8146, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.84% (1.7688 => 1.8368, std. dev.: 0.0049) SingleSource/Benchmarks/Misc/salsa20: 3.62% (7.4271 => 7.6960, std. dev.: 0.0099) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 3.26% (0.9692 => 1.0008, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 3.15% (11.2619 => 11.6167, std. dev.: 0.0044) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4542, std. dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.62% (8.8259 => 9.0570, std. dev.: 0.0151) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.30% (7.9275 => 8.1101, std. dev.: 0.0113) SingleSource/Benchmarks/Misc/ffbench: 2.21% (0.8273 => 0.8456, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.52% (1.4298 => 1.4515, std. dev.: 0.0009) MultiSource/Benchmarks/sim/sim: 1.31% (5.0168 => 5.0824, std. dev.: 0.0088) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.30% (2.0200 => 2.0463, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0054) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.37% (0.2670 => 0.2500, std. dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.13% (22.5627 => 21.1796, std. dev.: 0.0035) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.81% (0.3511 => 0.3307, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-2: -3.47% (0.3601 => 0.3476, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: -3.42% (0.3623 => 0.3499, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: -3.40% (0.3646 => 0.3522, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.40% (0.3650 => 0.3526, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/synchronized: -3.36% (0.3663 => 0.3540, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/property: -3.30% (0.3940 => 0.3810, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.20% (0.8818 => 0.8536, std. dev.: 0.0019) SingleSource/UnitTests/ObjC/trivial-interface: -3.16% (0.3578 => 0.3465, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -3.04% (0.3789 => 0.3674, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: -2.77% (0.4003 => 0.3892, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.37% (0.6576 => 0.6420, std. dev.: 0.0013) SingleSource/UnitTests/ObjC++/Hello: -1.76% (0.5748 => 0.5647, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: -1.65% (0.6250 => 0.6147, std. dev.: 0.0003) MultiSource/Applications/lua/lua: -1.05% (3.7467 => 3.7075, std. dev.: 0.0008) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -10.77% (1.2308 => 1.0982, std. dev.: 0.0048) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.16% (1.0460 => 0.9502, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.53% (0.3139 => 0.2934, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.96% (1.3780 => 1.3097, std. dev.: 0.0073) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9473, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0011) SingleSource/Benchmarks/Dhrystone/dry: -4.01% (2.5089 => 2.4082, std. dev.: 0.0012) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.76% (0.3458 => 0.3328, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -3.59% (1.9762 => 1.9053, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -2.39% (6.3560 => 6.2044, std. dev.: 0.0161) SingleSource/Benchmarks/Misc/richards_benchmark: -2.15% (1.1560 => 1.1312, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.01% (20.3410 => 19.9328, std. dev.: 0.0378) MultiSource/Applications/minisat/minisat: -1.98% (9.3358 => 9.1507, std. dev.: 0.0461) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.85% (6.6320 => 6.5091, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9954, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/heapsort: -1.53% (3.9173 => 3.8573, std. dev.: 0.0018) MultiSource/Applications/lua/lua: -1.31% (26.5159 => 26.1676, std. dev.: 0.0329) MultiSource/Benchmarks/Bullet/bullet: -1.24% (7.3305 => 7.2399, std. dev.: 0.0009) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.93s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon May 7 04:53:18 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 7 May 2012 06:53:18 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120507115318.3D6912A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/554?compare_to=553&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 554, Order: 156302, Start Time: 2012-05-07 10:57:27, End Time: 2012-05-07 11:53:56 To: 553, Order: 156297, Start Time: 2012-05-07 09:34:39, End Time: 2012-05-07 10:31:11 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (47 on baseline) Performance Improvements: 0 (38 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (803 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.83% (2.0176 => 2.2765, std. dev.: 0.0161) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.97% (0.3130 => 0.3317, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.03% (0.2721 => 0.2858, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.24% (3.9660 => 4.0945, std. dev.: 0.0056) MultiSource/Applications/SPASS/SPASS: 2.79% (13.8202 => 14.2055, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/hash2: 2.54% (0.4328 => 0.4438, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.46% (0.6959 => 0.7130, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 2.44% (1.0594 => 1.0852, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.20% (0.5637 => 0.5761, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.18% (1.1364 => 1.1612, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.14% (0.9199 => 0.9396, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/football/football: 2.13% (0.8310 => 0.8487, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.07% (1.2193 => 1.2446, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.83% (1.4563 => 1.4830, std. dev.: 0.0011) MultiSource/Applications/hbd/hbd: 1.66% (1.3693 => 1.3920, std. dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 1.64% (16.6129 => 16.8861, std. dev.: 0.0195) MultiSource/Applications/lambda-0_1_3/lambda: 1.63% (0.7038 => 0.7153, std. dev.: 0.0006) MultiSource/Applications/siod/siod: 1.62% (2.1791 => 2.2143, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.58% (0.7710 => 0.7832, std. dev.: 0.0018) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.53% (0.7460 => 0.7574, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.51% (13.2842 => 13.4844, std. dev.: 0.0069) MultiSource/Applications/Burg/burg: 1.46% (1.1061 => 1.1223, std. dev.: 0.0021) MultiSource/Benchmarks/MallocBench/gs/gs: 1.46% (3.8646 => 3.9210, std. dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.45% (1.3245 => 1.3437, std. dev.: 0.0027) MultiSource/Applications/treecc/treecc: 1.37% (1.9270 => 1.9534, std. dev.: 0.0049) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.37% (3.6692 => 3.7194, std. dev.: 0.0102) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.36% (1.3813 => 1.4001, std. dev.: 0.0059) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.28% (1.3819 => 1.3996, std. dev.: 0.0026) MultiSource/Applications/SIBsim4/SIBsim4: 1.24% (1.2749 => 1.2907, std. dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: 1.16% (16.2614 => 16.4506, std. dev.: 0.0163) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.11% (2.1007 => 2.1240, std. dev.: 0.0011) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.35% (1.8175 => 2.2601, std. dev.: 0.0197) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7298, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.86% (1.5824 => 1.6752, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8147, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 3.70% (7.4271 => 7.7022, std. dev.: 0.0021) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.64% (1.7688 => 1.8332, std. dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 3.27% (0.9692 => 1.0009, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 3.15% (11.2619 => 11.6166, std. dev.: 0.0029) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4552, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.78% (8.8259 => 9.0709, std. dev.: 0.0200) SingleSource/Benchmarks/Misc/ffbench: 2.26% (0.8273 => 0.8460, std. dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.22% (7.9275 => 8.1036, std. dev.: 0.0213) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0004) MultiSource/Applications/lemon/lemon: 1.46% (1.4298 => 1.4507, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.26% (2.0200 => 2.0455, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.19% (5.1531 => 5.2144, std. dev.: 0.0187) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -20.03% (0.4657 => 0.3724, std. dev.: 0.0218) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.48% (0.2670 => 0.2497, std. dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.20% (22.5627 => 21.1641, std. dev.: 0.0030) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.72% (0.3511 => 0.3310, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-3: -3.31% (0.3623 => 0.3503, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -3.30% (0.3601 => 0.3482, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.22% (0.8818 => 0.8534, std. dev.: 0.0018) SingleSource/UnitTests/ObjC/exceptions-4: -3.21% (0.3646 => 0.3529, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -3.13% (0.3578 => 0.3466, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/property: -3.07% (0.3940 => 0.3819, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -3.06% (0.3663 => 0.3551, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -2.80% (0.3789 => 0.3683, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -2.78% (0.3914 => 0.3805, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: -2.75% (0.4003 => 0.3893, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.01% (0.6576 => 0.6444, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/bigfib: -1.78% (0.6250 => 0.6139, std. dev.: 0.0006) MultiSource/Applications/lua/lua: -1.08% (3.7467 => 3.7064, std. dev.: 0.0041) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -10.32% (1.2308 => 1.1038, std. dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.14% (1.0460 => 0.9504, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.53% (0.3139 => 0.2934, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.36% (1.3780 => 1.3041, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9474, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -4.13% (2.5089 => 2.4052, std. dev.: 0.0015) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.65% (1.9762 => 1.9040, std. dev.: 0.0045) SingleSource/Benchmarks/Shootout/lists: -2.20% (6.3560 => 6.2164, std. dev.: 0.0175) SingleSource/Benchmarks/Misc/richards_benchmark: -2.12% (1.1560 => 1.1315, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.83% (6.6320 => 6.5109, std. dev.: 0.0007) MultiSource/Applications/minisat/minisat: -1.74% (9.3358 => 9.1734, std. dev.: 0.0045) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3446, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.67% (20.3410 => 20.0005, std. dev.: 0.0172) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9953, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/heapsort: -1.54% (3.9173 => 3.8570, std. dev.: 0.0017) MultiSource/Applications/lua/lua: -1.32% (26.5159 => 26.1655, std. dev.: 0.0114) MultiSource/Benchmarks/Bullet/bullet: -1.23% (7.3305 => 7.2404, std. dev.: 0.0086) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.12% (3.8887 => 3.8450, std. dev.: 0.0052) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.17s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon May 7 08:44:44 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 7 May 2012 10:44:44 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120507154444.9DDF12A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/555?compare_to=554&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 555, Order: 156304, Start Time: 2012-05-07 14:48:40, End Time: 2012-05-07 15:45:23 To: 554, Order: 156302, Start Time: 2012-05-07 10:57:27, End Time: 2012-05-07 11:53:56 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (52 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 891 (802 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 3.14% (0.3724 => 0.3841, std. dev.: 0.0027) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.86% (2.0176 => 2.2770, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.26% (0.3130 => 0.3326, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.41% (0.2721 => 0.2841, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.43% (3.9660 => 4.1022, std. dev.: 0.0090) MultiSource/Applications/SPASS/SPASS: 2.96% (13.8202 => 14.2289, std. dev.: 0.0149) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.72% (0.5265 => 0.5408, std. dev.: 0.0020) MultiSource/Benchmarks/nbench/nbench: 2.66% (1.0594 => 1.0876, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/hash2: 2.56% (0.4328 => 0.4439, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.54% (0.6959 => 0.7136, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.52% (0.9199 => 0.9431, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.33% (1.1364 => 1.1629, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.33% (1.2193 => 1.2477, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.31% (0.5637 => 0.5767, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 2.30% (0.8310 => 0.8501, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.18% (1.4563 => 1.4881, std. dev.: 0.0016) MultiSource/Applications/lambda-0_1_3/lambda: 2.06% (0.7038 => 0.7183, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.04% (0.5577 => 0.5691, std. dev.: 0.0020) MultiSource/Applications/siod/siod: 1.94% (2.1791 => 2.2214, std. dev.: 0.0063) MultiSource/Applications/kimwitu++/kc: 1.91% (16.6129 => 16.9302, std. dev.: 0.0059) MultiSource/Applications/Burg/burg: 1.90% (1.1061 => 1.1271, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.85% (0.7710 => 0.7853, std. dev.: 0.0024) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.84% (0.7460 => 0.7597, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.66% (1.3245 => 1.3465, std. dev.: 0.0017) MultiSource/Benchmarks/MallocBench/gs/gs: 1.66% (3.8646 => 3.9286, std. dev.: 0.0047) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.62% (13.2842 => 13.4998, std. dev.: 0.0154) MultiSource/Applications/treecc/treecc: 1.60% (1.9270 => 1.9579, std. dev.: 0.0037) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.51% (1.3819 => 1.4028, std. dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: 1.44% (1.2749 => 1.2933, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.43% (3.6692 => 3.7218, std. dev.: 0.0056) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.43% (1.3813 => 1.4010, std. dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 1.30% (16.2614 => 16.4736, std. dev.: 0.0070) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.29% (2.1007 => 2.1279, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.16% (3.2742 => 3.3121, std. dev.: 0.0041) MultiSource/Applications/JM/lencod/lencod: 1.16% (14.8535 => 15.0253, std. dev.: 0.0090) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.04% (1.5188 => 1.5346, std. dev.: 0.0000) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.15% (1.8175 => 2.2565, std. dev.: 0.0049) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6755, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8146, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.71% (1.7688 => 1.8345, std. dev.: 0.0057) SingleSource/Benchmarks/Misc/salsa20: 3.61% (7.4271 => 7.6954, std. dev.: 0.0072) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 3.27% (0.9692 => 1.0009, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 3.15% (11.2619 => 11.6168, std. dev.: 0.0039) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4541, std. dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.67% (7.9275 => 8.1391, std. dev.: 0.0063) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.57% (8.8259 => 9.0530, std. dev.: 0.0229) SingleSource/Benchmarks/Misc/ffbench: 2.25% (0.8273 => 0.8459, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.48% (1.4298 => 1.4509, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.26% (2.0200 => 2.0454, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: 1.14% (5.0168 => 5.0739, std. dev.: 0.0124) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -17.52% (0.4657 => 0.3841, std. dev.: 0.0027) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.44% (0.2670 => 0.2498, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.05% (22.5627 => 21.1981, std. dev.: 0.0188) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.75% (0.3511 => 0.3309, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.07% (0.8818 => 0.8547, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.07% (0.3650 => 0.3538, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions-2: -3.05% (0.3601 => 0.3491, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -3.04% (0.3623 => 0.3513, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -2.93% (0.3646 => 0.3539, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: -2.87% (0.3663 => 0.3558, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: -2.85% (0.3578 => 0.3476, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: -2.69% (0.3940 => 0.3834, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: -1.74% (0.6250 => 0.6141, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.69% (0.6576 => 0.6465, std. dev.: 0.0016) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -10.25% (1.2308 => 1.1046, std. dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.47% (0.3139 => 0.2936, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9474, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.56% (1.3780 => 1.3151, std. dev.: 0.0021) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -4.07% (2.5089 => 2.4069, std. dev.: 0.0017) MultiSource/Benchmarks/Olden/bh/bh: -3.62% (1.9762 => 1.9047, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.61% (0.3458 => 0.3333, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -2.14% (1.1560 => 1.1313, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/lists: -2.13% (6.3560 => 6.2209, std. dev.: 0.0057) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.99% (20.3410 => 19.9364, std. dev.: 0.0287) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.90% (6.6320 => 6.5058, std. dev.: 0.0057) MultiSource/Applications/minisat/minisat: -1.86% (9.3358 => 9.1618, std. dev.: 0.0121) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9958, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/heapsort: -1.40% (3.9173 => 3.8623, std. dev.: 0.0014) MultiSource/Applications/lua/lua: -1.31% (26.5159 => 26.1688, std. dev.: 0.0106) MultiSource/Benchmarks/Bullet/bullet: -1.28% (7.3305 => 7.2365, std. dev.: 0.0022) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.26s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon May 7 12:14:56 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 7 May 2012 14:14:56 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120507191456.45F922A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/556?compare_to=555&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 556, Order: 156310, Start Time: 2012-05-07 18:18:37, End Time: 2012-05-07 19:15:33 To: 555, Order: 156304, Start Time: 2012-05-07 14:48:40, End Time: 2012-05-07 15:45:23 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (51 on baseline) Performance Improvements: 0 (38 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (799 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.86% (2.0176 => 2.2771, std. dev.: 0.0111) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.17% (0.3130 => 0.3323, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.45% (0.2721 => 0.2842, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.42% (3.9660 => 4.1017, std. dev.: 0.0119) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.79% (0.5265 => 0.5412, std. dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 2.79% (13.8202 => 14.2054, std. dev.: 0.0175) MultiSource/Benchmarks/nbench/nbench: 2.77% (1.0594 => 1.0887, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hash2: 2.59% (0.4328 => 0.4440, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.49% (0.6959 => 0.7132, std. dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.38% (0.5637 => 0.5771, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.35% (0.9199 => 0.9415, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.29% (1.1364 => 1.1624, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 2.25% (0.8310 => 0.8497, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.24% (1.2193 => 1.2466, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.08% (0.7710 => 0.7870, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.00% (1.4563 => 1.4854, std. dev.: 0.0016) MultiSource/Applications/kimwitu++/kc: 1.91% (16.6129 => 16.9305, std. dev.: 0.0068) MultiSource/Applications/hbd/hbd: 1.90% (1.3693 => 1.3953, std. dev.: 0.0059) MultiSource/Applications/lambda-0_1_3/lambda: 1.76% (0.7038 => 0.7162, std. dev.: 0.0008) MultiSource/Applications/Burg/burg: 1.63% (1.1061 => 1.1241, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.62% (0.7460 => 0.7581, std. dev.: 0.0039) MultiSource/Applications/siod/siod: 1.61% (2.1791 => 2.2142, std. dev.: 0.0040) MultiSource/Benchmarks/MallocBench/gs/gs: 1.55% (3.8646 => 3.9244, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.53% (3.6692 => 3.7255, std. dev.: 0.0088) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.51% (1.3813 => 1.4022, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.49% (1.3245 => 1.3443, std. dev.: 0.0018) MultiSource/Applications/treecc/treecc: 1.46% (1.9270 => 1.9551, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.45% (1.3819 => 1.4019, std. dev.: 0.0018) MultiSource/Applications/SIBsim4/SIBsim4: 1.44% (1.2749 => 1.2933, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.41% (13.2842 => 13.4715, std. dev.: 0.0073) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.29% (2.1007 => 2.1278, std. dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.25% (3.2742 => 3.3151, std. dev.: 0.0097) MultiSource/Applications/sqlite3/sqlite3: 1.18% (16.2614 => 16.4525, std. dev.: 0.0112) MultiSource/Applications/JM/lencod/lencod: 1.07% (14.8535 => 15.0123, std. dev.: 0.0025) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.01% (1.8175 => 2.2539, std. dev.: 0.0056) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6754, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.71% (1.7688 => 1.8344, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 3.64% (7.4271 => 7.6974, std. dev.: 0.0076) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 3.26% (0.9692 => 1.0008, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 3.14% (11.2619 => 11.6155, std. dev.: 0.0055) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4535, std. dev.: 0.0025) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.59% (8.8259 => 9.0548, std. dev.: 0.0204) SingleSource/Benchmarks/Misc/ffbench: 2.20% (0.8273 => 0.8455, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.20% (7.9275 => 8.1017, std. dev.: 0.0157) SingleSource/Benchmarks/Dhrystone/fldry: 1.60% (1.9290 => 1.9599, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.36% (1.4298 => 1.4493, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.29% (2.0200 => 2.0461, std. dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 1.18% (5.0168 => 5.0758, std. dev.: 0.0083) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -17.91% (0.4657 => 0.3823, std. dev.: 0.0244) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.25% (0.2670 => 0.2503, std. dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.16% (22.5627 => 21.1738, std. dev.: 0.0173) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.87% (0.3511 => 0.3305, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.08% (0.8818 => 0.8546, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-3: -3.06% (0.3623 => 0.3512, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -3.05% (0.3601 => 0.3491, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.04% (0.3650 => 0.3539, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -3.02% (0.3646 => 0.3536, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -3.00% (0.3663 => 0.3553, std. dev.: 0.0026) SingleSource/UnitTests/ObjC/trivial-interface: -2.93% (0.3578 => 0.3473, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -2.92% (0.3940 => 0.3825, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -2.67% (0.3789 => 0.3688, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: -2.58% (0.3914 => 0.3813, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -2.52% (0.4003 => 0.3902, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.86% (0.6576 => 0.6454, std. dev.: 0.0009) MultiSource/Applications/lua/lua: -1.12% (3.7467 => 3.7046, std. dev.: 0.0063) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -10.72% (1.2308 => 1.0988, std. dev.: 0.0074) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.53% (0.3139 => 0.2934, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9472, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.70% (1.3780 => 1.3132, std. dev.: 0.0057) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -4.11% (2.5089 => 2.4057, std. dev.: 0.0013) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.61% (1.9762 => 1.9048, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout/lists: -2.14% (6.3560 => 6.2199, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/richards_benchmark: -2.14% (1.1560 => 1.1313, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.04% (20.3410 => 19.9251, std. dev.: 0.0646) MultiSource/Applications/minisat/minisat: -1.96% (9.3358 => 9.1532, std. dev.: 0.0076) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.95% (6.6320 => 6.5024, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9952, std. dev.: 0.0003) MultiSource/Applications/lua/lua: -1.36% (26.5159 => 26.1563, std. dev.: 0.0185) MultiSource/Benchmarks/Bullet/bullet: -1.27% (7.3305 => 7.2373, std. dev.: 0.0093) SingleSource/Benchmarks/Shootout/heapsort: -1.18% (3.9173 => 3.8710, std. dev.: 0.0113) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.11% (3.8887 => 3.8457, std. dev.: 0.0064) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.40s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon May 7 13:37:42 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 7 May 2012 15:37:42 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120507203742.2BE9C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/557?compare_to=556&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 557, Order: 156316, Start Time: 2012-05-07 19:41:49, End Time: 2012-05-07 20:38:20 To: 556, Order: 156310, Start Time: 2012-05-07 18:18:37, End Time: 2012-05-07 19:15:33 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (50 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (799 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.32% (2.0176 => 2.2864, std. dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.26% (0.3130 => 0.3326, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.45% (0.2721 => 0.2842, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.36% (3.9660 => 4.0992, std. dev.: 0.0072) MultiSource/Benchmarks/nbench/nbench: 2.90% (1.0594 => 1.0901, std. dev.: 0.0027) MultiSource/Applications/SPASS/SPASS: 2.88% (13.8202 => 14.2179, std. dev.: 0.0155) SingleSource/Benchmarks/Shootout-C++/hash2: 2.54% (0.4328 => 0.4438, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.50% (0.6959 => 0.7133, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: 2.41% (0.8310 => 0.8510, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.39% (0.5265 => 0.5391, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.36% (0.9199 => 0.9416, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.32% (1.1364 => 1.1628, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.26% (1.2193 => 1.2468, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.11% (0.5637 => 0.5756, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.90% (1.4563 => 1.4839, std. dev.: 0.0041) MultiSource/Applications/kimwitu++/kc: 1.83% (16.6129 => 16.9168, std. dev.: 0.0108) MultiSource/Applications/hbd/hbd: 1.75% (1.3693 => 1.3933, std. dev.: 0.0059) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.72% (0.7460 => 0.7588, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 1.68% (2.1791 => 2.2158, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.57% (13.2842 => 13.4930, std. dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.53% (3.6692 => 3.7252, std. dev.: 0.0096) MultiSource/Applications/Burg/burg: 1.50% (1.1061 => 1.1227, std. dev.: 0.0028) MultiSource/Applications/SIBsim4/SIBsim4: 1.50% (1.2749 => 1.2940, std. dev.: 0.0027) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.49% (1.3813 => 1.4019, std. dev.: 0.0059) MultiSource/Applications/treecc/treecc: 1.48% (1.9270 => 1.9555, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.47% (1.3819 => 1.4022, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.44% (1.3245 => 1.3436, std. dev.: 0.0037) MultiSource/Benchmarks/MallocBench/gs/gs: 1.40% (3.8646 => 3.9187, std. dev.: 0.0053) MultiSource/Applications/sqlite3/sqlite3: 1.31% (16.2614 => 16.4748, std. dev.: 0.0107) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.30% (0.7710 => 0.7810, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.27% (3.2742 => 3.3157, std. dev.: 0.0016) MultiSource/Applications/JM/lencod/lencod: 1.24% (14.8535 => 15.0378, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.21% (2.1007 => 2.1262, std. dev.: 0.0069) MultiSource/Applications/JM/ldecod/ldecod: 1.02% (6.5754 => 6.6423, std. dev.: 0.0083) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.06% (1.8175 => 2.2547, std. dev.: 0.0424) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.87% (1.5824 => 1.6753, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8146, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.68% (1.7688 => 1.8339, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: 3.63% (7.4271 => 7.6965, std. dev.: 0.0057) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 3.27% (0.9692 => 1.0009, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 3.16% (11.2619 => 11.6176, std. dev.: 0.0023) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4554, std. dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.73% (8.8259 => 9.0669, std. dev.: 0.0174) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.35% (7.9275 => 8.1134, std. dev.: 0.0107) SingleSource/Benchmarks/Misc/ffbench: 2.25% (0.8273 => 0.8459, std. dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9603, std. dev.: 0.0036) MultiSource/Applications/lemon/lemon: 1.44% (1.4298 => 1.4504, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.28% (2.0200 => 2.0458, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0146) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -19.26% (0.4657 => 0.3760, std. dev.: 0.0213) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.29% (0.2670 => 0.2502, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.16% (22.5627 => 21.1725, std. dev.: 0.0149) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.78% (0.3511 => 0.3308, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions-3: -3.70% (0.3623 => 0.3489, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -3.69% (0.3601 => 0.3468, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.56% (0.3650 => 0.3520, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-4: -3.54% (0.3646 => 0.3517, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -3.50% (0.3940 => 0.3802, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: -3.49% (0.3578 => 0.3453, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -3.47% (0.3663 => 0.3536, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -3.19% (0.3789 => 0.3668, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: -2.96% (0.3914 => 0.3798, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.95% (0.8818 => 0.8558, std. dev.: 0.0040) SingleSource/UnitTests/ObjC/parameter-passing: -2.95% (0.4003 => 0.3885, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.24% (0.6576 => 0.6429, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: -1.60% (0.6250 => 0.6150, std. dev.: 0.0002) MultiSource/Applications/lua/lua: -1.19% (3.7467 => 3.7021, std. dev.: 0.0113) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -10.30% (1.2308 => 1.1040, std. dev.: 0.0060) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.16% (1.0460 => 0.9502, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.59% (0.3139 => 0.2932, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9472, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.30% (1.3780 => 1.3187, std. dev.: 0.0164) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.96% (2.5089 => 2.4096, std. dev.: 0.0010) MultiSource/Benchmarks/Olden/bh/bh: -3.72% (1.9762 => 1.9027, std. dev.: 0.0018) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -2.18% (6.3560 => 6.2173, std. dev.: 0.0155) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.16% (20.3410 => 19.9014, std. dev.: 0.0647) SingleSource/Benchmarks/Misc/richards_benchmark: -2.12% (1.1560 => 1.1315, std. dev.: 0.0000) MultiSource/Applications/minisat/minisat: -2.03% (9.3358 => 9.1466, std. dev.: 0.0058) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.92% (6.6320 => 6.5047, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9955, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.34% (2.5254 => 2.4916, std. dev.: 0.0073) MultiSource/Benchmarks/Bullet/bullet: -1.28% (7.3305 => 7.2368, std. dev.: 0.0108) MultiSource/Applications/lua/lua: -1.26% (26.5159 => 26.1807, std. dev.: 0.0358) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.05% (3.8887 => 3.8480, std. dev.: 0.0025) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.23s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon May 7 15:00:44 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 7 May 2012 17:00:44 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120507220044.D31782A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/558?compare_to=557&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 558, Order: 156321, Start Time: 2012-05-07 21:04:40, End Time: 2012-05-07 22:01:23 To: 557, Order: 156316, Start Time: 2012-05-07 19:41:49, End Time: 2012-05-07 20:38:20 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (48 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (801 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.80% (2.0176 => 2.2759, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.13% (0.3130 => 0.3322, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.30% (0.2721 => 0.2838, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.30% (3.9660 => 4.0969, std. dev.: 0.0046) MultiSource/Applications/SPASS/SPASS: 2.83% (13.8202 => 14.2112, std. dev.: 0.0175) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.77% (0.5265 => 0.5411, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 2.58% (1.0594 => 1.0867, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.52% (0.9199 => 0.9431, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.51% (0.6959 => 0.7134, std. dev.: 0.0036) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.40% (1.1364 => 1.1637, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/football/football: 2.37% (0.8310 => 0.8507, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.29% (0.5637 => 0.5766, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.23% (1.2193 => 1.2465, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.85% (1.4563 => 1.4832, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.85% (0.5577 => 0.5680, std. dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 1.80% (16.6129 => 16.9121, std. dev.: 0.0276) MultiSource/Applications/siod/siod: 1.79% (2.1791 => 2.2180, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.73% (1.3819 => 1.4058, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/gs/gs: 1.72% (3.8646 => 3.9310, std. dev.: 0.0043) MultiSource/Applications/lambda-0_1_3/lambda: 1.69% (0.7038 => 0.7157, std. dev.: 0.0016) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.69% (0.7460 => 0.7586, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.69% (1.3813 => 1.4046, std. dev.: 0.0006) MultiSource/Applications/Burg/burg: 1.62% (1.1061 => 1.1240, std. dev.: 0.0040) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.61% (13.2842 => 13.4978, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.53% (1.3245 => 1.3447, std. dev.: 0.0037) MultiSource/Applications/treecc/treecc: 1.50% (1.9270 => 1.9560, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.40% (0.7710 => 0.7818, std. dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 1.40% (16.2614 => 16.4886, std. dev.: 0.0057) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.34% (3.6692 => 3.7184, std. dev.: 0.0033) MultiSource/Applications/hbd/hbd: 1.31% (1.3693 => 1.3873, std. dev.: 0.0013) MultiSource/Applications/JM/lencod/lencod: 1.13% (14.8535 => 15.0218, std. dev.: 0.0013) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.40% (1.8175 => 2.2610, std. dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7298, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.92% (1.5824 => 1.6760, std. dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.72% (1.7688 => 1.8346, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: 3.53% (7.4271 => 7.6893, std. dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 3.30% (0.9692 => 1.0012, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 3.16% (11.2619 => 11.6175, std. dev.: 0.0036) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4543, std. dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.97% (8.8259 => 9.0881, std. dev.: 0.0117) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.66% (7.9275 => 8.1385, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/ffbench: 2.19% (0.8273 => 0.8454, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.46% (1.4298 => 1.4507, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.27% (2.0200 => 2.0456, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: 1.11% (5.0168 => 5.0724, std. dev.: 0.0131) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -21.80% (0.4657 => 0.3642, std. dev.: 0.0200) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.29% (0.2670 => 0.2502, std. dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.23% (22.5627 => 21.1561, std. dev.: 0.0157) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.01% (0.3511 => 0.3300, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -4.25% (0.3623 => 0.3469, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -4.17% (0.3601 => 0.3451, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.16% (0.3650 => 0.3498, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -4.03% (0.3646 => 0.3499, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -3.97% (0.3578 => 0.3436, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: -3.90% (0.3663 => 0.3520, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -3.88% (0.3940 => 0.3787, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -3.62% (0.3789 => 0.3652, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -3.58% (0.3914 => 0.3774, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -3.45% (0.4003 => 0.3865, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: -2.38% (0.6250 => 0.6101, std. dev.: 0.0049) SingleSource/UnitTests/ObjC++/Hello: -2.31% (0.5748 => 0.5615, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: -1.94% (0.5818 => 0.5705, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.92% (0.6576 => 0.6450, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: -1.46% (0.7061 => 0.6958, std. dev.: 0.0023) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -10.60% (1.2308 => 1.1003, std. dev.: 0.0063) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.47% (0.3139 => 0.2936, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.02% (1.3780 => 1.3088, std. dev.: 0.0048) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9473, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -4.01% (2.5089 => 2.4084, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.64% (0.3458 => 0.3332, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.64% (1.9762 => 1.9042, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: -2.12% (1.1560 => 1.1315, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -2.08% (6.3560 => 6.2239, std. dev.: 0.0070) MultiSource/Applications/minisat/minisat: -1.93% (9.3358 => 9.1559, std. dev.: 0.0139) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.83% (6.6320 => 6.5109, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3444, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9950, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.58% (20.3410 => 20.0204, std. dev.: 0.0198) SingleSource/Benchmarks/Shootout/heapsort: -1.54% (3.9173 => 3.8568, std. dev.: 0.0088) MultiSource/Applications/lua/lua: -1.40% (26.5159 => 26.1448, std. dev.: 0.0409) MultiSource/Benchmarks/Bullet/bullet: -1.24% (7.3305 => 7.2397, std. dev.: 0.0058) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.29s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon May 7 16:23:25 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 7 May 2012 18:23:25 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120507232325.58DC52A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/559?compare_to=558&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 559, Order: 156324, Start Time: 2012-05-07 22:27:40, End Time: 2012-05-07 23:24:03 To: 558, Order: 156321, Start Time: 2012-05-07 21:04:40, End Time: 2012-05-07 22:01:23 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 11 (61 on baseline) Performance Improvements: 2 (42 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 879 (785 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 8.13% (1.2959 => 1.4013, std. dev.: 0.0115) SingleSource/Benchmarks/Misc/flops-4: 6.50% (1.0641 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 3.86% (1.9141 => 1.9879, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.47% (2.8407 => 2.9393, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-6: 2.93% (1.9191 => 1.9753, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9864 => 2.0310, std. dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3873 => 8.5094, std. dev.: 0.0089) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.35% (1.9399 => 1.9660, std. dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: 1.15% (7.2397 => 7.3233, std. dev.: 0.0058) SingleSource/Benchmarks/Misc/flops: 1.14% (9.0752 => 9.1787, std. dev.: 0.0011) SingleSource/Benchmarks/McGill/chomp: 1.14% (1.1003 => 1.1128, std. dev.: 0.0022) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/flops-3: -6.27% (2.4158 => 2.2643, std. dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: -1.82% (28.2051 => 27.6914, std. dev.: 0.0036) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.46% (2.0176 => 2.2689, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.33% (0.3130 => 0.3328, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.08% (0.2721 => 0.2832, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.23% (3.9660 => 4.0942, std. dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: 2.74% (13.8202 => 14.1992, std. dev.: 0.0173) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.68% (0.5265 => 0.5406, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 2.64% (0.8310 => 0.8529, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 2.59% (1.0594 => 1.0868, std. dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.57% (0.6959 => 0.7138, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.47% (0.9199 => 0.9426, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.43% (1.1364 => 1.1640, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.30% (1.2193 => 1.2474, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.20% (0.5637 => 0.5761, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.84% (1.4563 => 1.4831, std. dev.: 0.0012) MultiSource/Applications/lambda-0_1_3/lambda: 1.83% (0.7038 => 0.7167, std. dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 1.80% (16.6129 => 16.9125, std. dev.: 0.0159) MultiSource/Applications/siod/siod: 1.79% (2.1791 => 2.2180, std. dev.: 0.0025) MultiSource/Benchmarks/MallocBench/gs/gs: 1.76% (3.8646 => 3.9325, std. dev.: 0.0090) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.73% (0.7460 => 0.7589, std. dev.: 0.0007) MultiSource/Applications/SIBsim4/SIBsim4: 1.68% (1.2749 => 1.2963, std. dev.: 0.0061) MultiSource/Applications/Burg/burg: 1.60% (1.1061 => 1.1238, std. dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.58% (1.3245 => 1.3454, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.45% (3.2742 => 3.3218, std. dev.: 0.0043) MultiSource/Applications/treecc/treecc: 1.44% (1.9270 => 1.9547, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 1.37% (16.2614 => 16.4834, std. dev.: 0.0180) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.35% (0.7710 => 0.7814, std. dev.: 0.0025) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.35% (1.3813 => 1.3999, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.35% (1.3819 => 1.4005, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.34% (3.6692 => 3.7184, std. dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.27% (2.1007 => 2.1273, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.23% (13.2842 => 13.4480, std. dev.: 0.0104) MultiSource/Applications/hbd/hbd: 1.20% (1.3693 => 1.3858, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.09% (1.5188 => 1.5353, std. dev.: 0.0034) MultiSource/Applications/JM/lencod/lencod: 1.07% (14.8535 => 15.0125, std. dev.: 0.0069) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.37% (1.8175 => 2.2605, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/mandel-2: 7.81% (1.2998 => 1.4013, std. dev.: 0.0115) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.86% (1.5824 => 1.6752, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8147, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9879, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: 3.63% (7.4271 => 7.6970, std. dev.: 0.0074) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.61% (1.7688 => 1.8327, std. dev.: 0.0017) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 3.27% (0.9692 => 1.0009, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 3.13% (11.2619 => 11.6145, std. dev.: 0.0025) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4536, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-6: 2.89% (1.9199 => 1.9753, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9393, std. dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.72% (8.8259 => 9.0664, std. dev.: 0.0100) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.14% (7.9275 => 8.0975, std. dev.: 0.0217) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.58% (0.8273 => 0.8404, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.42% (1.4298 => 1.4501, std. dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5094, std. dev.: 0.0089) MultiSource/Benchmarks/Olden/bisort/bisort: 1.35% (0.8239 => 0.8350, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.28% (2.0200 => 2.0458, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.17% (1.9433 => 1.9660, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 1.13% (9.0760 => 9.1787, std. dev.: 0.0011) MultiSource/Benchmarks/sim/sim: 1.07% (5.0168 => 5.0705, std. dev.: 0.0049) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -22.76% (0.4657 => 0.3597, std. dev.: 0.0068) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.85% (0.2670 => 0.2487, std. dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.32% (22.5627 => 21.1370, std. dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.95% (0.3511 => 0.3302, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-3: -4.53% (0.3623 => 0.3459, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -4.47% (0.3601 => 0.3440, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.41% (0.3650 => 0.3489, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -4.30% (0.3578 => 0.3424, std. dev.: 0.0026) SingleSource/UnitTests/ObjC/synchronized: -4.29% (0.3663 => 0.3506, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -4.25% (0.3646 => 0.3491, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -4.01% (0.3940 => 0.3782, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -3.85% (0.3789 => 0.3643, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -3.81% (0.3914 => 0.3765, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -3.65% (0.4003 => 0.3857, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.69% (0.8818 => 0.8581, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: -2.56% (0.6250 => 0.6090, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: -2.49% (0.5748 => 0.5605, std. dev.: 0.0030) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.31% (0.6576 => 0.6424, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: -2.22% (0.5818 => 0.5689, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: -1.69% (0.7061 => 0.6942, std. dev.: 0.0024) MultiSource/Applications/lua/lua: -1.04% (3.7467 => 3.7076, std. dev.: 0.0065) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -9.59% (1.2308 => 1.1128, std. dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.16% (1.0460 => 0.9502, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.50% (0.3139 => 0.2935, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9474, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.58% (1.3780 => 1.3149, std. dev.: 0.0101) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.99% (2.5089 => 2.4089, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.67% (0.3458 => 0.3331, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.62% (1.9762 => 1.9046, std. dev.: 0.0088) SingleSource/Benchmarks/Misc/richards_benchmark: -2.13% (1.1560 => 1.1314, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -2.02% (6.3560 => 6.2275, std. dev.: 0.0128) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.97% (20.3410 => 19.9393, std. dev.: 0.0365) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.91% (6.6320 => 6.5053, std. dev.: 0.0025) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6914, std. dev.: 0.0036) MultiSource/Applications/minisat/minisat: -1.82% (9.3358 => 9.1656, std. dev.: 0.0189) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9953, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/heapsort: -1.47% (3.9173 => 3.8596, std. dev.: 0.0085) MultiSource/Applications/lua/lua: -1.28% (26.5159 => 26.1768, std. dev.: 0.0203) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.50s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon May 7 17:46:08 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 7 May 2012 19:46:08 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120508004608.2E3A02A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/560?compare_to=559&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 560, Order: 156334, Start Time: 2012-05-07 23:50:18, End Time: 2012-05-08 00:46:46 To: 559, Order: 156324, Start Time: 2012-05-07 22:27:40, End Time: 2012-05-07 23:24:03 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (59 on baseline) Performance Improvements: 1 (41 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 891 (788 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -4.69% (1.0009 => 0.9540, std. dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.57% (2.0176 => 2.2914, std. dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.36% (0.3130 => 0.3329, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.26% (0.2721 => 0.2837, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.57% (3.9660 => 4.1074, std. dev.: 0.0020) MultiSource/Applications/SPASS/SPASS: 2.96% (13.8202 => 14.2287, std. dev.: 0.0041) MultiSource/Benchmarks/nbench/nbench: 2.89% (1.0594 => 1.0900, std. dev.: 0.0098) MultiSource/Benchmarks/Prolangs-C/football/football: 2.78% (0.8310 => 0.8541, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.75% (0.5265 => 0.5410, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.69% (0.6959 => 0.7146, std. dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.64% (0.9199 => 0.9442, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.61% (1.1364 => 1.1661, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.49% (1.2193 => 1.2497, std. dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.48% (0.5637 => 0.5777, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.06% (1.4563 => 1.4863, std. dev.: 0.0061) MultiSource/Applications/lambda-0_1_3/lambda: 2.03% (0.7038 => 0.7181, std. dev.: 0.0054) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.02% (0.7460 => 0.7611, std. dev.: 0.0012) MultiSource/Applications/kimwitu++/kc: 2.01% (16.6129 => 16.9462, std. dev.: 0.0089) MultiSource/Applications/hbd/hbd: 1.90% (1.3693 => 1.3953, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.88% (0.5577 => 0.5682, std. dev.: 0.0008) MultiSource/Applications/SIBsim4/SIBsim4: 1.84% (1.2749 => 1.2984, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 1.82% (3.8646 => 3.9348, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.71% (1.3819 => 1.4055, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.69% (1.3245 => 1.3469, std. dev.: 0.0011) MultiSource/Applications/Burg/burg: 1.65% (1.1061 => 1.1243, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.64% (3.6692 => 3.7294, std. dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.63% (3.2742 => 3.3276, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.56% (13.2842 => 13.4916, std. dev.: 0.0080) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.56% (0.7710 => 0.7830, std. dev.: 0.0032) MultiSource/Applications/treecc/treecc: 1.55% (1.9270 => 1.9569, std. dev.: 0.0016) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.51% (1.3813 => 1.4022, std. dev.: 0.0059) MultiSource/Applications/sqlite3/sqlite3: 1.45% (16.2614 => 16.4967, std. dev.: 0.0191) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.34% (2.1007 => 2.1288, std. dev.: 0.0074) MultiSource/Applications/JM/lencod/lencod: 1.32% (14.8535 => 15.0503, std. dev.: 0.0106) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.15% (1.5188 => 1.5363, std. dev.: 0.0007) MultiSource/Applications/oggenc/oggenc: 1.03% (4.6629 => 4.7109, std. dev.: 0.0042) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.48% (1.8175 => 2.2624, std. dev.: 0.0144) SingleSource/Benchmarks/Misc/mandel-2: 7.82% (1.2998 => 1.4015, std. dev.: 0.0091) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7298, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.90% (1.5824 => 1.6757, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9876, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.66% (1.7688 => 1.8335, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: 3.49% (7.4271 => 7.6866, std. dev.: 0.0063) MultiSource/Benchmarks/nbench/nbench: 3.14% (11.2619 => 11.6152, std. dev.: 0.0039) MultiSource/Applications/hexxagon/hexxagon: 3.01% (12.0921 => 12.4556, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: 2.90% (1.9199 => 1.9755, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9393, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.66% (8.8259 => 9.0605, std. dev.: 0.0201) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.41% (7.9275 => 8.1188, std. dev.: 0.0061) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.55% (0.8273 => 0.8401, std. dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5092, std. dev.: 0.0014) MultiSource/Applications/lemon/lemon: 1.35% (1.4298 => 1.4491, std. dev.: 0.0033) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.25% (2.0200 => 2.0453, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.25% (1.9433 => 1.9676, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/flops: 1.14% (9.0760 => 9.1791, std. dev.: 0.0006) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -21.19% (0.4657 => 0.3670, std. dev.: 0.0211) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.59% (0.2670 => 0.2494, std. dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.13% (22.5627 => 21.1793, std. dev.: 0.0090) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.47% (0.3511 => 0.3319, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -3.75% (0.3623 => 0.3487, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -3.67% (0.3601 => 0.3469, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -3.54% (0.3646 => 0.3517, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.53% (0.3650 => 0.3521, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -3.52% (0.3663 => 0.3534, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: -3.41% (0.3578 => 0.3456, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -3.25% (0.3940 => 0.3812, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -3.09% (0.3789 => 0.3672, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -3.01% (0.3914 => 0.3796, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -2.87% (0.4003 => 0.3888, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.60% (0.8818 => 0.8589, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.05% (0.6576 => 0.6441, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: -1.84% (0.6250 => 0.6135, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: -1.83% (0.5748 => 0.5643, std. dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -10.31% (1.2308 => 1.1039, std. dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.16% (1.0460 => 0.9502, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.47% (0.3139 => 0.2936, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.22% (1.3780 => 1.3061, std. dev.: 0.0061) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9472, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -4.01% (2.5089 => 2.4082, std. dev.: 0.0009) MultiSource/Benchmarks/Olden/bh/bh: -3.69% (1.9762 => 1.9032, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.67% (0.3458 => 0.3331, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: -2.16% (1.1560 => 1.1310, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -2.14% (6.3560 => 6.2197, std. dev.: 0.0090) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.96% (6.6320 => 6.5018, std. dev.: 0.0066) MultiSource/Applications/minisat/minisat: -1.94% (9.3358 => 9.1547, std. dev.: 0.0383) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6911, std. dev.: 0.0022) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.80% (20.3410 => 19.9739, std. dev.: 0.0517) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9955, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.45% (3.9173 => 3.8606, std. dev.: 0.0054) MultiSource/Applications/lua/lua: -1.23% (26.5159 => 26.1885, std. dev.: 0.0215) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.01% (3.8887 => 3.8493, std. dev.: 0.0016) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.58s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon May 7 19:08:50 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 7 May 2012 21:08:50 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120508020850.2803F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/561?compare_to=560&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 561, Order: 156349, Start Time: 2012-05-08 01:12:59, End Time: 2012-05-08 02:09:28 To: 560, Order: 156334, Start Time: 2012-05-07 23:50:18, End Time: 2012-05-08 00:46:46 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (59 on baseline) Performance Improvements: 0 (38 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 891 (791 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 1.25% (7.9742 => 8.0739, std. dev.: 0.0193) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.89% (2.0176 => 2.2777, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.36% (0.3130 => 0.3329, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.19% (0.2721 => 0.2835, std. dev.: 0.0016) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.35% (3.9660 => 4.0988, std. dev.: 0.0019) MultiSource/Applications/SPASS/SPASS: 2.98% (13.8202 => 14.2314, std. dev.: 0.0148) MultiSource/Benchmarks/nbench/nbench: 2.91% (1.0594 => 1.0902, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 2.83% (0.8310 => 0.8545, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.70% (0.5265 => 0.5407, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.60% (1.1364 => 1.1660, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.57% (0.6959 => 0.7138, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.54% (0.9199 => 0.9433, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.42% (1.2193 => 1.2488, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.39% (0.5637 => 0.5772, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.04% (1.4563 => 1.4860, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.94% (0.5577 => 0.5685, std. dev.: 0.0030) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.88% (0.7710 => 0.7855, std. dev.: 0.0023) MultiSource/Applications/kimwitu++/kc: 1.87% (16.6129 => 16.9236, std. dev.: 0.0252) MultiSource/Applications/lambda-0_1_3/lambda: 1.79% (0.7038 => 0.7164, std. dev.: 0.0005) MultiSource/Applications/Burg/burg: 1.74% (1.1061 => 1.1254, std. dev.: 0.0021) MultiSource/Benchmarks/MallocBench/gs/gs: 1.69% (3.8646 => 3.9301, std. dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.69% (3.2742 => 3.3294, std. dev.: 0.0045) MultiSource/Applications/siod/siod: 1.67% (2.1791 => 2.2155, std. dev.: 0.0039) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.66% (0.7460 => 0.7584, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.62% (1.3245 => 1.3460, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.61% (3.6692 => 3.7283, std. dev.: 0.0029) MultiSource/Applications/treecc/treecc: 1.54% (1.9270 => 1.9567, std. dev.: 0.0012) MultiSource/Applications/hbd/hbd: 1.54% (1.3693 => 1.3904, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.51% (1.3819 => 1.4028, std. dev.: 0.0017) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.49% (1.3813 => 1.4019, std. dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: 1.49% (16.2614 => 16.5029, std. dev.: 0.0126) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.47% (13.2842 => 13.4791, std. dev.: 0.0103) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.37% (2.1007 => 2.1294, std. dev.: 0.0008) MultiSource/Applications/JM/lencod/lencod: 1.26% (14.8535 => 15.0402, std. dev.: 0.0120) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.03% (1.5188 => 1.5344, std. dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 23.74% (1.8175 => 2.2489, std. dev.: 0.0048) SingleSource/Benchmarks/Misc/mandel-2: 6.79% (1.2998 => 1.3880, std. dev.: 0.0111) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7294, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.91% (1.5824 => 1.6759, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9876, std. dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.72% (1.7688 => 1.8346, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: 3.56% (7.4271 => 7.6916, std. dev.: 0.0080) MultiSource/Benchmarks/nbench/nbench: 3.17% (11.2619 => 11.6186, std. dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4531, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/flops-6: 2.88% (1.9199 => 1.9751, std. dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.76% (8.8259 => 9.0697, std. dev.: 0.0112) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9394, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.38% (7.9275 => 8.1161, std. dev.: 0.0079) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.60% (0.8273 => 0.8405, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: 1.58% (1.9290 => 1.9594, std. dev.: 0.0004) MultiSource/Applications/lemon/lemon: 1.43% (1.4298 => 1.4503, std. dev.: 0.0016) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5095, std. dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.28% (2.0200 => 2.0458, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.26% (1.9433 => 1.9677, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) MultiSource/Benchmarks/sim/sim: 1.15% (5.0168 => 5.0743, std. dev.: 0.0110) SingleSource/Benchmarks/Misc/flops: 1.13% (9.0760 => 9.1787, std. dev.: 0.0016) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -20.68% (0.4657 => 0.3694, std. dev.: 0.0107) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.52% (0.2670 => 0.2496, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.29% (0.3511 => 0.3290, std. dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.04% (22.5627 => 21.1991, std. dev.: 0.0123) SingleSource/UnitTests/ObjC/exceptions-3: -3.51% (0.3623 => 0.3496, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.48% (0.3650 => 0.3523, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -3.47% (0.3601 => 0.3476, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -3.38% (0.3578 => 0.3457, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -3.37% (0.3646 => 0.3523, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -3.25% (0.3940 => 0.3812, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -3.25% (0.3663 => 0.3544, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -3.04% (0.3789 => 0.3674, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -2.91% (0.3914 => 0.3800, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -2.85% (0.4003 => 0.3889, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: -2.13% (0.6250 => 0.6117, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.87% (0.6576 => 0.6453, std. dev.: 0.0009) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -10.40% (1.2308 => 1.1028, std. dev.: 0.0052) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.16% (1.0460 => 0.9502, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.53% (0.3139 => 0.2934, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.29% (2.4152 => 2.2633, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9473, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.51% (1.3780 => 1.3158, std. dev.: 0.0210) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -3.98% (2.5089 => 2.4090, std. dev.: 0.0027) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -3.66% (1.9762 => 1.9038, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -2.27% (6.3560 => 6.2115, std. dev.: 0.0153) SingleSource/Benchmarks/Misc/richards_benchmark: -2.15% (1.1560 => 1.1312, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.98% (6.6320 => 6.5009, std. dev.: 0.0056) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6912, std. dev.: 0.0010) MultiSource/Applications/minisat/minisat: -1.82% (9.3358 => 9.1655, std. dev.: 0.0043) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.81% (20.3410 => 19.9734, std. dev.: 0.0438) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3446, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9959, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.36% (3.9173 => 3.8642, std. dev.: 0.0030) MultiSource/Applications/lua/lua: -1.35% (26.5159 => 26.1573, std. dev.: 0.0240) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.54s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon May 7 20:31:27 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 7 May 2012 22:31:27 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120508033127.C49F32A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/562?compare_to=561&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 562, Order: 156357, Start Time: 2012-05-08 02:35:41, End Time: 2012-05-08 03:32:06 To: 561, Order: 156349, Start Time: 2012-05-08 01:12:59, End Time: 2012-05-08 02:09:28 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (59 on baseline) Performance Improvements: 0 (38 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (791 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.94% (2.0176 => 2.2786, std. dev.: 0.0135) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.39% (0.3130 => 0.3330, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.30% (0.2721 => 0.2838, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.48% (3.9660 => 4.1039, std. dev.: 0.0064) MultiSource/Applications/SPASS/SPASS: 3.07% (13.8202 => 14.2446, std. dev.: 0.0073) MultiSource/Benchmarks/nbench/nbench: 2.94% (1.0594 => 1.0905, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.87% (0.6959 => 0.7159, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.87% (0.5265 => 0.5416, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 2.85% (0.8310 => 0.8547, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.69% (1.1364 => 1.1670, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.63% (0.9199 => 0.9441, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.45% (1.2193 => 1.2492, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.24% (0.5637 => 0.5763, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.16% (1.4563 => 1.4877, std. dev.: 0.0015) MultiSource/Applications/kimwitu++/kc: 1.97% (16.6129 => 16.9397, std. dev.: 0.0224) MultiSource/Applications/lambda-0_1_3/lambda: 1.90% (0.7038 => 0.7172, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.90% (0.5577 => 0.5683, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 1.89% (3.8646 => 3.9377, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 1.87% (2.1791 => 2.2198, std. dev.: 0.0011) MultiSource/Applications/SIBsim4/SIBsim4: 1.82% (1.2749 => 1.2981, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.79% (3.6692 => 3.7347, std. dev.: 0.0093) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.74% (0.7460 => 0.7590, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 1.72% (1.1061 => 1.1251, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.70% (1.3245 => 1.3470, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.69% (0.7710 => 0.7840, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.65% (3.2742 => 3.3283, std. dev.: 0.0010) MultiSource/Applications/treecc/treecc: 1.61% (1.9270 => 1.9581, std. dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: 1.54% (16.2614 => 16.5112, std. dev.: 0.0053) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.51% (1.3813 => 1.4021, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.51% (1.3819 => 1.4027, std. dev.: 0.0040) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.50% (13.2842 => 13.4835, std. dev.: 0.0216) MultiSource/Applications/hbd/hbd: 1.50% (1.3693 => 1.3898, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.45% (2.1007 => 2.1311, std. dev.: 0.0023) MultiSource/Applications/JM/lencod/lencod: 1.30% (14.8535 => 15.0462, std. dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.13% (1.5188 => 1.5360, std. dev.: 0.0020) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.00% (1.8175 => 2.2537, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/mandel-2: 7.56% (1.2998 => 1.3981, std. dev.: 0.0112) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.52% (2.5629 => 2.7299, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6754, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8143, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.81% (1.9144 => 1.9873, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.59% (1.7688 => 1.8323, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/salsa20: 3.49% (7.4271 => 7.6866, std. dev.: 0.0082) MultiSource/Benchmarks/nbench/nbench: 3.15% (11.2619 => 11.6172, std. dev.: 0.0019) MultiSource/Applications/hexxagon/hexxagon: 3.01% (12.0921 => 12.4558, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/flops-6: 2.94% (1.9199 => 1.9764, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.93% (8.8259 => 9.0845, std. dev.: 0.0063) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9394, std. dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.50% (7.9275 => 8.1258, std. dev.: 0.0059) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.58% (1.9290 => 1.9595, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/ffbench: 1.54% (0.8273 => 0.8400, std. dev.: 0.0004) MultiSource/Applications/lemon/lemon: 1.41% (1.4298 => 1.4500, std. dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5087, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.26% (2.0200 => 2.0455, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.20% (1.9433 => 1.9666, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2135, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1772, std. dev.: 0.0005) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -21.88% (0.4657 => 0.3638, std. dev.: 0.0231) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.44% (0.2670 => 0.2498, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.27% (0.3511 => 0.3291, std. dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.10% (22.5627 => 21.1857, std. dev.: 0.0077) SingleSource/UnitTests/ObjC/exceptions-3: -3.62% (0.3623 => 0.3492, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.53% (0.3650 => 0.3521, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -3.47% (0.3601 => 0.3476, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -3.39% (0.3663 => 0.3539, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -3.35% (0.3646 => 0.3524, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -3.27% (0.3578 => 0.3461, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -3.17% (0.3940 => 0.3815, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -3.01% (0.3789 => 0.3675, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -2.86% (0.3914 => 0.3802, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.47% (0.8818 => 0.8600, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: -2.05% (0.6250 => 0.6122, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.90% (0.6576 => 0.6451, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -9.94% (1.2308 => 1.1084, std. dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.53% (0.3139 => 0.2934, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.28% (1.3780 => 1.3052, std. dev.: 0.0095) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9474, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -4.05% (2.5089 => 2.4072, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: -3.64% (1.9762 => 1.9042, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.61% (0.3458 => 0.3333, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -2.22% (6.3560 => 6.2149, std. dev.: 0.0075) SingleSource/Benchmarks/Misc/richards_benchmark: -2.12% (1.1560 => 1.1315, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.98% (6.6320 => 6.5010, std. dev.: 0.0050) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.96% (20.3410 => 19.9418, std. dev.: 0.0461) MultiSource/Benchmarks/mafft/pairlocalalign: -1.89% (28.2225 => 27.6885, std. dev.: 0.0029) MultiSource/Applications/minisat/minisat: -1.88% (9.3358 => 9.1603, std. dev.: 0.0110) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9958, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.41% (3.9173 => 3.8620, std. dev.: 0.0079) MultiSource/Applications/lua/lua: -1.22% (26.5159 => 26.1928, std. dev.: 0.0274) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.34s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon May 7 21:54:26 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 7 May 2012 23:54:26 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120508045426.180952A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/563?compare_to=562&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 563, Order: 156363, Start Time: 2012-05-08 03:58:37, End Time: 2012-05-08 04:55:04 To: 562, Order: 156357, Start Time: 2012-05-08 02:35:41, End Time: 2012-05-08 03:32:06 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (54 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (794 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.22% (2.0176 => 2.2641, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.01% (0.3130 => 0.3318, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.01% (0.2721 => 0.2830, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.02% (3.9660 => 4.0857, std. dev.: 0.0032) MultiSource/Applications/SPASS/SPASS: 2.53% (13.8202 => 14.1693, std. dev.: 0.0212) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.47% (0.5265 => 0.5395, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/football/football: 2.43% (0.8310 => 0.8512, std. dev.: 0.0018) MultiSource/Benchmarks/nbench/nbench: 2.37% (1.0594 => 1.0845, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.30% (0.9199 => 0.9411, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.27% (0.6959 => 0.7117, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.13% (1.2193 => 1.2453, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.06% (1.1364 => 1.1598, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.06% (0.5637 => 0.5753, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.70% (1.4563 => 1.4810, std. dev.: 0.0022) MultiSource/Applications/kimwitu++/kc: 1.65% (16.6129 => 16.8873, std. dev.: 0.0165) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.61% (0.7710 => 0.7834, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/gs/gs: 1.51% (3.8646 => 3.9230, std. dev.: 0.0073) MultiSource/Applications/lambda-0_1_3/lambda: 1.51% (0.7038 => 0.7144, std. dev.: 0.0019) MultiSource/Applications/siod/siod: 1.51% (2.1791 => 2.2119, std. dev.: 0.0022) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.46% (0.7460 => 0.7569, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.29% (1.3245 => 1.3416, std. dev.: 0.0018) MultiSource/Applications/SIBsim4/SIBsim4: 1.25% (1.2749 => 1.2908, std. dev.: 0.0045) MultiSource/Applications/treecc/treecc: 1.25% (1.9270 => 1.9510, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.20% (1.3819 => 1.3985, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.17% (13.2842 => 13.4399, std. dev.: 0.0091) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.12% (3.2742 => 3.3108, std. dev.: 0.0133) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.10% (3.6692 => 3.7095, std. dev.: 0.0049) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.06% (2.1007 => 2.1229, std. dev.: 0.0049) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.04% (1.3813 => 1.3957, std. dev.: 0.0010) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.12% (1.8175 => 2.2559, std. dev.: 0.0488) SingleSource/Benchmarks/Misc/mandel-2: 8.62% (1.2998 => 1.4119, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7298, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6755, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8146, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9877, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.66% (1.7688 => 1.8336, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/salsa20: 3.66% (7.4271 => 7.6987, std. dev.: 0.0039) MultiSource/Benchmarks/nbench/nbench: 3.18% (11.2619 => 11.6205, std. dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4539, std. dev.: 0.0017) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.92% (8.8259 => 9.0838, std. dev.: 0.0144) SingleSource/Benchmarks/Misc/flops-6: 2.92% (1.9199 => 1.9759, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9393, std. dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.58% (7.9275 => 8.1318, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.60% (1.9290 => 1.9599, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/ffbench: 1.55% (0.8273 => 0.8401, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.48% (1.4298 => 1.4509, std. dev.: 0.0007) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5091, std. dev.: 0.0103) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.27% (2.0200 => 2.0456, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.18% (1.9433 => 1.9662, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 1.13% (9.0760 => 9.1786, std. dev.: 0.0005) MultiSource/Benchmarks/sim/sim: 1.02% (5.0168 => 5.0682, std. dev.: 0.0172) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -19.73% (0.4657 => 0.3738, std. dev.: 0.0255) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.97% (0.2670 => 0.2484, std. dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.65% (22.5627 => 21.0617, std. dev.: 0.0032) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.64% (0.3511 => 0.3278, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: -4.03% (0.3623 => 0.3477, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.03% (0.3650 => 0.3503, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -3.97% (0.3601 => 0.3458, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -3.89% (0.3646 => 0.3504, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -3.86% (0.3578 => 0.3440, std. dev.: 0.0039) SingleSource/UnitTests/ObjC/synchronized: -3.82% (0.3663 => 0.3523, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -3.68% (0.3940 => 0.3795, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -3.56% (0.3789 => 0.3654, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -3.45% (0.3914 => 0.3779, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.36% (0.8818 => 0.8522, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -3.30% (0.4003 => 0.3871, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.75% (0.6576 => 0.6395, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: -2.45% (0.6250 => 0.6097, std. dev.: 0.0007) MultiSource/Applications/lua/lua: -1.25% (3.7467 => 3.7000, std. dev.: 0.0060) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -10.51% (1.2308 => 1.1015, std. dev.: 0.0089) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.56% (0.3139 => 0.2933, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9472, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.48% (1.3780 => 1.3163, std. dev.: 0.0050) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0008) SingleSource/Benchmarks/Dhrystone/dry: -4.04% (2.5089 => 2.4075, std. dev.: 0.0011) MultiSource/Benchmarks/Olden/bh/bh: -3.67% (1.9762 => 1.9036, std. dev.: 0.0116) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.64% (0.3458 => 0.3332, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -2.22% (6.3560 => 6.2146, std. dev.: 0.0065) SingleSource/Benchmarks/Misc/richards_benchmark: -2.12% (1.1560 => 1.1315, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.94% (6.6320 => 6.5036, std. dev.: 0.0046) MultiSource/Applications/minisat/minisat: -1.91% (9.3358 => 9.1571, std. dev.: 0.0102) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6912, std. dev.: 0.0022) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.71% (20.3410 => 19.9927, std. dev.: 0.0237) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9956, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.37% (3.9173 => 3.8638, std. dev.: 0.0098) MultiSource/Applications/lua/lua: -1.26% (26.5159 => 26.1824, std. dev.: 0.0221) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.52s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon May 7 23:40:19 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 8 May 2012 01:40:19 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120508064019.2847F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/564?compare_to=563&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 564, Order: 156369, Start Time: 2012-05-08 05:44:30, End Time: 2012-05-08 06:40:57 To: 563, Order: 156363, Start Time: 2012-05-08 03:58:37, End Time: 2012-05-08 04:55:04 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (55 on baseline) Performance Improvements: 0 (42 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (791 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.56% (2.0176 => 2.2710, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.07% (0.3130 => 0.3320, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.97% (0.2721 => 0.2829, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.10% (3.9660 => 4.0890, std. dev.: 0.0067) MultiSource/Applications/SPASS/SPASS: 2.57% (13.8202 => 14.1752, std. dev.: 0.0058) MultiSource/Benchmarks/nbench/nbench: 2.50% (1.0594 => 1.0859, std. dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.43% (0.5265 => 0.5393, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 2.35% (0.8310 => 0.8505, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.32% (0.9199 => 0.9412, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.20% (0.6959 => 0.7112, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.14% (1.2193 => 1.2454, std. dev.: 0.0021) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.13% (1.1364 => 1.1606, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.13% (0.5637 => 0.5757, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.81% (1.4563 => 1.4827, std. dev.: 0.0084) MultiSource/Benchmarks/MallocBench/gs/gs: 1.58% (3.8646 => 3.9257, std. dev.: 0.0102) MultiSource/Applications/lambda-0_1_3/lambda: 1.53% (0.7038 => 0.7146, std. dev.: 0.0012) MultiSource/Applications/kimwitu++/kc: 1.51% (16.6129 => 16.8637, std. dev.: 0.0095) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.44% (0.7710 => 0.7821, std. dev.: 0.0011) MultiSource/Applications/SIBsim4/SIBsim4: 1.39% (1.2749 => 1.2926, std. dev.: 0.0039) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.35% (0.7460 => 0.7561, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.31% (1.3819 => 1.4000, std. dev.: 0.0007) MultiSource/Applications/Burg/burg: 1.29% (1.1061 => 1.1204, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.29% (1.3245 => 1.3416, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.25% (3.6692 => 3.7152, std. dev.: 0.0036) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.24% (13.2842 => 13.4491, std. dev.: 0.0116) MultiSource/Applications/treecc/treecc: 1.22% (1.9270 => 1.9506, std. dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.17% (3.2742 => 3.3124, std. dev.: 0.0032) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.13% (1.3813 => 1.3969, std. dev.: 0.0025) MultiSource/Applications/sqlite3/sqlite3: 1.09% (16.2614 => 16.4384, std. dev.: 0.0188) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.04% (2.1007 => 2.1226, std. dev.: 0.0043) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 23.98% (1.8175 => 2.2533, std. dev.: 0.0527) SingleSource/Benchmarks/Misc/mandel-2: 7.68% (1.2998 => 1.3996, std. dev.: 0.0086) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7298, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.92% (1.5824 => 1.6761, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.81% (1.9144 => 1.9874, std. dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.67% (1.7688 => 1.8337, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: 3.66% (7.4271 => 7.6991, std. dev.: 0.0056) MultiSource/Benchmarks/nbench/nbench: 3.17% (11.2619 => 11.6187, std. dev.: 0.0018) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4549, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: 2.91% (1.9199 => 1.9758, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9394, std. dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.58% (8.8259 => 9.0534, std. dev.: 0.0356) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.22% (7.9275 => 8.1037, std. dev.: 0.0189) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9603, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.57% (0.8273 => 0.8403, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.45% (1.4298 => 1.4506, std. dev.: 0.0009) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5091, std. dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.27% (2.0200 => 2.0457, std. dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 1.21% (5.0168 => 5.0773, std. dev.: 0.0074) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.15% (1.9433 => 1.9656, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1779, std. dev.: 0.0013) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -20.12% (0.4657 => 0.3720, std. dev.: 0.0328) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.59% (0.2670 => 0.2494, std. dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.54% (22.5627 => 21.0865, std. dev.: 0.0126) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.47% (0.3511 => 0.3284, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.27% (0.3650 => 0.3494, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -4.25% (0.3601 => 0.3448, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: -4.17% (0.3623 => 0.3472, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -4.10% (0.3663 => 0.3513, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -4.09% (0.3646 => 0.3497, std. dev.: 0.0025) SingleSource/UnitTests/ObjC/trivial-interface: -4.00% (0.3578 => 0.3435, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -3.91% (0.3940 => 0.3786, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -3.77% (0.3789 => 0.3646, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: -3.55% (0.3914 => 0.3775, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -3.42% (0.4003 => 0.3866, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.08% (0.8818 => 0.8546, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.72% (0.6576 => 0.6397, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: -2.46% (0.6250 => 0.6096, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: -1.91% (0.5748 => 0.5638, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: -1.89% (0.5818 => 0.5708, std. dev.: 0.0004) MultiSource/Applications/lua/lua: -1.27% (3.7467 => 3.6993, std. dev.: 0.0014) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -10.60% (1.2308 => 1.1003, std. dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.16% (1.0460 => 0.9502, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.53% (0.3139 => 0.2934, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2650, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9475, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.80% (1.3780 => 1.3118, std. dev.: 0.0111) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.96% (2.5089 => 2.4095, std. dev.: 0.0015) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.67% (0.3458 => 0.3331, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.61% (1.9762 => 1.9049, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.30% (20.3410 => 19.8731, std. dev.: 0.0897) SingleSource/Benchmarks/Shootout/lists: -2.20% (6.3560 => 6.2159, std. dev.: 0.0135) SingleSource/Benchmarks/Misc/richards_benchmark: -2.15% (1.1560 => 1.1312, std. dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: -1.87% (28.2225 => 27.6953, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.87% (6.6320 => 6.5083, std. dev.: 0.0057) MultiSource/Applications/minisat/minisat: -1.83% (9.3358 => 9.1654, std. dev.: 0.0210) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9954, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.48% (3.9173 => 3.8593, std. dev.: 0.0080) MultiSource/Applications/lua/lua: -1.29% (26.5159 => 26.1747, std. dev.: 0.0143) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.82s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue May 8 01:07:25 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 8 May 2012 03:07:25 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120508080725.10CD42A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/565?compare_to=564&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 565, Order: 156373, Start Time: 2012-05-08 07:11:17, End Time: 2012-05-08 08:08:02 To: 564, Order: 156369, Start Time: 2012-05-08 05:44:30, End Time: 2012-05-08 06:40:57 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (54 on baseline) Performance Improvements: 0 (41 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 891 (793 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/McGill/chomp: 1.11% (1.1003 => 1.1125, std. dev.: 0.0010) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.56% (2.0176 => 2.2710, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.04% (0.3130 => 0.3319, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.01% (0.2721 => 0.2830, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.13% (3.9660 => 4.0900, std. dev.: 0.0120) MultiSource/Applications/SPASS/SPASS: 2.67% (13.8202 => 14.1895, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.64% (0.6959 => 0.7143, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 2.49% (1.0594 => 1.0858, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.44% (0.9199 => 0.9423, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.43% (0.5265 => 0.5393, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/football/football: 2.42% (0.8310 => 0.8511, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.36% (1.1364 => 1.1632, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.29% (1.2193 => 1.2472, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.02% (0.5637 => 0.5751, std. dev.: 0.0023) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.01% (0.7710 => 0.7865, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.84% (1.4563 => 1.4831, std. dev.: 0.0064) MultiSource/Applications/siod/siod: 1.67% (2.1791 => 2.2154, std. dev.: 0.0057) MultiSource/Benchmarks/MallocBench/gs/gs: 1.65% (3.8646 => 3.9285, std. dev.: 0.0052) MultiSource/Applications/kimwitu++/kc: 1.57% (16.6129 => 16.8737, std. dev.: 0.0138) MultiSource/Applications/Burg/burg: 1.47% (1.1061 => 1.1224, std. dev.: 0.0033) MultiSource/Applications/lambda-0_1_3/lambda: 1.44% (0.7038 => 0.7139, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.42% (1.3245 => 1.3433, std. dev.: 0.0022) MultiSource/Applications/SIBsim4/SIBsim4: 1.40% (1.2749 => 1.2927, std. dev.: 0.0030) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.38% (0.7460 => 0.7563, std. dev.: 0.0013) MultiSource/Applications/treecc/treecc: 1.25% (1.9270 => 1.9511, std. dev.: 0.0065) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.20% (3.2742 => 3.3136, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.15% (1.3813 => 1.3972, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.14% (3.6692 => 3.7111, std. dev.: 0.0103) MultiSource/Applications/sqlite3/sqlite3: 1.10% (16.2614 => 16.4399, std. dev.: 0.0111) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.04% (2.1007 => 2.1225, std. dev.: 0.0015) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.17% (1.8175 => 2.2568, std. dev.: 0.0176) SingleSource/Benchmarks/Misc/mandel-2: 7.25% (1.2998 => 1.3940, std. dev.: 0.0107) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6754, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8147, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.87% (1.9144 => 1.9885, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.71% (1.7688 => 1.8344, std. dev.: 0.0059) SingleSource/Benchmarks/Misc/salsa20: 3.57% (7.4271 => 7.6923, std. dev.: 0.0035) MultiSource/Benchmarks/nbench/nbench: 3.13% (11.2619 => 11.6140, std. dev.: 0.0033) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4544, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-6: 2.89% (1.9199 => 1.9753, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.78% (8.8259 => 9.0715, std. dev.: 0.0232) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9393, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.44% (7.9275 => 8.1207, std. dev.: 0.0143) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.61% (0.8273 => 0.8406, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.42% (1.4298 => 1.4501, std. dev.: 0.0013) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5088, std. dev.: 0.0024) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.28% (1.9433 => 1.9681, std. dev.: 0.0051) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.26% (2.0200 => 2.0455, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bisort/bisort: 1.26% (0.8239 => 0.8343, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1772, std. dev.: 0.0010) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.49% (22.5627 => 21.0989, std. dev.: 0.0033) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.44% (0.2670 => 0.2498, std. dev.: 0.0018) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.38% (0.3511 => 0.3287, std. dev.: 0.0039) SingleSource/UnitTests/ObjC/exceptions-3: -4.28% (0.3623 => 0.3468, std. dev.: 0.0023) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.25% (0.3650 => 0.3495, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-2: -4.22% (0.3601 => 0.3449, std. dev.: 0.0030) SingleSource/UnitTests/ObjC/exceptions-4: -4.11% (0.3646 => 0.3496, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: -4.11% (0.3578 => 0.3431, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -4.07% (0.3663 => 0.3514, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -3.81% (0.3940 => 0.3790, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -3.75% (0.3789 => 0.3647, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -3.63% (0.3914 => 0.3772, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -3.60% (0.4003 => 0.3859, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.10% (0.8818 => 0.8545, std. dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/bigfib: -2.46% (0.6250 => 0.6096, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.39% (0.6576 => 0.6419, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/Hello: -1.81% (0.5748 => 0.5644, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: -1.75% (0.5818 => 0.5716, std. dev.: 0.0027) MultiSource/Applications/lua/lua: -1.14% (3.7467 => 3.7041, std. dev.: 0.0029) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -9.61% (1.2308 => 1.1125, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.56% (0.3139 => 0.2933, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9474, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.51% (1.3780 => 1.3158, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -4.03% (2.5089 => 2.4077, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.73% (0.3458 => 0.3329, std. dev.: 0.0011) MultiSource/Benchmarks/Olden/bh/bh: -3.66% (1.9762 => 1.9038, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/lists: -2.20% (6.3560 => 6.2161, std. dev.: 0.0158) SingleSource/Benchmarks/Misc/richards_benchmark: -2.15% (1.1560 => 1.1311, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.08% (20.3410 => 19.9180, std. dev.: 0.0783) MultiSource/Benchmarks/mafft/pairlocalalign: -1.89% (28.2225 => 27.6905, std. dev.: 0.0027) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.81% (6.6320 => 6.5117, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3446, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9957, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: -1.45% (9.3358 => 9.2004, std. dev.: 0.0241) MultiSource/Applications/lua/lua: -1.27% (26.5159 => 26.1782, std. dev.: 0.0263) SingleSource/Benchmarks/Shootout/heapsort: -1.15% (3.9173 => 3.8724, std. dev.: 0.0025) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.46s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue May 8 02:30:45 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 8 May 2012 04:30:45 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120508093045.D5E4E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/566?compare_to=565&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 566, Order: 156375, Start Time: 2012-05-08 08:34:43, End Time: 2012-05-08 09:31:24 To: 565, Order: 156373, Start Time: 2012-05-08 07:11:17, End Time: 2012-05-08 08:08:02 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (54 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (794 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 11.82% (2.0176 => 2.2560, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.68% (0.3130 => 0.3339, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.37% (0.2721 => 0.2840, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.96% (3.9660 => 4.0832, std. dev.: 0.0029) MultiSource/Benchmarks/nbench/nbench: 2.69% (1.0594 => 1.0879, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.62% (0.6959 => 0.7141, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.60% (0.5265 => 0.5402, std. dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: 2.57% (13.8202 => 14.1759, std. dev.: 0.0147) MultiSource/Benchmarks/Prolangs-C/football/football: 2.47% (0.8310 => 0.8515, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.41% (0.9199 => 0.9421, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.29% (0.5637 => 0.5766, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.21% (1.2193 => 1.2462, std. dev.: 0.0033) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.09% (1.1364 => 1.1602, std. dev.: 0.0035) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.92% (1.4563 => 1.4843, std. dev.: 0.0022) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.92% (0.7710 => 0.7858, std. dev.: 0.0011) MultiSource/Applications/siod/siod: 1.82% (2.1791 => 2.2187, std. dev.: 0.0038) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.69% (13.2842 => 13.5084, std. dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.58% (1.3245 => 1.3454, std. dev.: 0.0007) MultiSource/Applications/kimwitu++/kc: 1.57% (16.6129 => 16.8744, std. dev.: 0.0181) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.54% (0.7460 => 0.7575, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 1.53% (3.8646 => 3.9237, std. dev.: 0.0017) MultiSource/Applications/Burg/burg: 1.47% (1.1061 => 1.1224, std. dev.: 0.0006) MultiSource/Applications/treecc/treecc: 1.45% (1.9270 => 1.9549, std. dev.: 0.0011) MultiSource/Applications/lambda-0_1_3/lambda: 1.42% (0.7038 => 0.7138, std. dev.: 0.0027) MultiSource/Applications/sqlite3/sqlite3: 1.34% (16.2614 => 16.4790, std. dev.: 0.0056) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.21% (1.3819 => 1.3986, std. dev.: 0.0012) MultiSource/Applications/SIBsim4/SIBsim4: 1.17% (1.2749 => 1.2898, std. dev.: 0.0018) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.15% (1.3813 => 1.3972, std. dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.14% (3.2742 => 3.3116, std. dev.: 0.0060) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.09% (3.6692 => 3.7093, std. dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.04% (2.1007 => 2.1225, std. dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.62% (1.8175 => 2.2650, std. dev.: 0.0385) SingleSource/Benchmarks/Misc/mandel-2: 8.32% (1.2998 => 1.4080, std. dev.: 0.0057) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.90% (1.5824 => 1.6757, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9880, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.72% (1.7688 => 1.8346, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: 3.55% (7.4271 => 7.6909, std. dev.: 0.0041) MultiSource/Benchmarks/nbench/nbench: 3.18% (11.2619 => 11.6204, std. dev.: 0.0030) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 3.00% (8.8259 => 9.0911, std. dev.: 0.0053) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4543, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: 2.88% (1.9199 => 1.9751, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9393, std. dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.25% (7.9275 => 8.1058, std. dev.: 0.0132) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.56% (0.8273 => 0.8402, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.49% (1.4298 => 1.4511, std. dev.: 0.0006) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5092, std. dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.27% (2.0200 => 2.0457, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/flops: 1.11% (9.0760 => 9.1763, std. dev.: 0.0020) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -16.86% (0.4657 => 0.3872, std. dev.: 0.0123) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.93% (0.2670 => 0.2485, std. dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.48% (22.5627 => 21.1011, std. dev.: 0.0189) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.21% (0.3511 => 0.3293, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.08% (0.3650 => 0.3501, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-3: -4.03% (0.3623 => 0.3477, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -4.00% (0.3601 => 0.3457, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -3.93% (0.3663 => 0.3519, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -3.92% (0.3646 => 0.3503, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -3.86% (0.3578 => 0.3440, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -3.81% (0.3940 => 0.3790, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -3.54% (0.3789 => 0.3655, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/parameter-passing: -3.37% (0.4003 => 0.3868, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: -3.35% (0.3914 => 0.3783, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.87% (0.8818 => 0.8565, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.59% (0.6576 => 0.6406, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/bigfib: -2.24% (0.6250 => 0.6110, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: -1.82% (0.5818 => 0.5712, std. dev.: 0.0032) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -11.12% (1.2308 => 1.0939, std. dev.: 0.0100) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.16% (1.0460 => 0.9502, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.53% (0.3139 => 0.2934, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.41% (1.3780 => 1.3035, std. dev.: 0.0130) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9473, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -4.06% (2.5089 => 2.4070, std. dev.: 0.0013) MultiSource/Benchmarks/Olden/bh/bh: -3.64% (1.9762 => 1.9043, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.59% (0.3458 => 0.3334, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -2.21% (6.3560 => 6.2158, std. dev.: 0.0080) SingleSource/Benchmarks/Misc/richards_benchmark: -2.14% (1.1560 => 1.1313, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: -2.02% (9.3358 => 9.1469, std. dev.: 0.0097) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.92% (6.6320 => 6.5049, std. dev.: 0.0033) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6913, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9956, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.49% (20.3410 => 20.0379, std. dev.: 0.0194) SingleSource/Benchmarks/Shootout/heapsort: -1.29% (3.9173 => 3.8669, std. dev.: 0.0144) MultiSource/Applications/lua/lua: -1.26% (26.5159 => 26.1830, std. dev.: 0.0072) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.60s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue May 8 03:53:36 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 8 May 2012 05:53:36 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120508105336.6CFE52A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/567?compare_to=566&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 567, Order: 156377, Start Time: 2012-05-08 09:57:45, End Time: 2012-05-08 10:54:15 To: 566, Order: 156375, Start Time: 2012-05-08 08:34:43, End Time: 2012-05-08 09:31:24 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (55 on baseline) Performance Improvements: 0 (42 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (791 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.57% (2.0176 => 2.2712, std. dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.91% (0.3130 => 0.3315, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.15% (0.2721 => 0.2834, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.95% (3.9660 => 4.0828, std. dev.: 0.0046) MultiSource/Applications/SPASS/SPASS: 2.65% (13.8202 => 14.1869, std. dev.: 0.0192) MultiSource/Benchmarks/nbench/nbench: 2.56% (1.0594 => 1.0865, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.53% (0.5265 => 0.5398, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/football/football: 2.42% (0.8310 => 0.8511, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.23% (0.9199 => 0.9404, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.23% (0.6959 => 0.7114, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.18% (1.1364 => 1.1612, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.07% (1.2193 => 1.2445, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.95% (0.5637 => 0.5747, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.79% (0.5577 => 0.5677, std. dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: 1.75% (0.7038 => 0.7161, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.74% (1.4563 => 1.4817, std. dev.: 0.0022) MultiSource/Benchmarks/MallocBench/gs/gs: 1.59% (3.8646 => 3.9261, std. dev.: 0.0045) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.53% (0.7460 => 0.7574, std. dev.: 0.0010) MultiSource/Applications/siod/siod: 1.52% (2.1791 => 2.2122, std. dev.: 0.0040) MultiSource/Applications/kimwitu++/kc: 1.52% (16.6129 => 16.8649, std. dev.: 0.0129) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.41% (1.3819 => 1.4014, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.39% (1.3245 => 1.3429, std. dev.: 0.0012) MultiSource/Applications/treecc/treecc: 1.36% (1.9270 => 1.9532, std. dev.: 0.0031) MultiSource/Applications/Burg/burg: 1.36% (1.1061 => 1.1211, std. dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: 1.29% (16.2614 => 16.4711, std. dev.: 0.0094) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.27% (1.3813 => 1.3988, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.22% (3.6692 => 3.7138, std. dev.: 0.0055) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.20% (3.2742 => 3.3136, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.19% (13.2842 => 13.4429, std. dev.: 0.0056) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.10% (2.1007 => 2.1238, std. dev.: 0.0011) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 23.83% (1.8175 => 2.2507, std. dev.: 0.0058) SingleSource/Benchmarks/Misc/mandel-2: 6.62% (1.2998 => 1.3859, std. dev.: 0.0160) SingleSource/Benchmarks/Misc/flops-4: 6.52% (1.0640 => 1.1334, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.90% (1.5824 => 1.6757, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9880, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.64% (1.7688 => 1.8331, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/salsa20: 3.60% (7.4271 => 7.6943, std. dev.: 0.0040) MultiSource/Benchmarks/nbench/nbench: 3.19% (11.2619 => 11.6210, std. dev.: 0.0016) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4545, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-6: 2.83% (1.9199 => 1.9743, std. dev.: 0.0017) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.81% (8.8259 => 9.0741, std. dev.: 0.0135) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9393, std. dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.29% (7.9275 => 8.1093, std. dev.: 0.0155) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0085) SingleSource/Benchmarks/Misc/ffbench: 1.60% (0.8273 => 0.8405, std. dev.: 0.0023) MultiSource/Benchmarks/NPB-serial/is/is: 1.44% (8.3908 => 8.5113, std. dev.: 0.0040) MultiSource/Applications/lemon/lemon: 1.41% (1.4298 => 1.4500, std. dev.: 0.0005) MultiSource/Benchmarks/sim/sim: 1.34% (5.0168 => 5.0840, std. dev.: 0.0049) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.30% (2.0200 => 2.0462, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.20% (1.9433 => 1.9666, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1775, std. dev.: 0.0019) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -17.16% (0.4657 => 0.3858, std. dev.: 0.0104) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.48% (22.5627 => 21.0998, std. dev.: 0.0233) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.48% (0.2670 => 0.2497, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.21% (0.3511 => 0.3293, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-3: -4.50% (0.3623 => 0.3460, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -4.50% (0.3601 => 0.3439, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -4.39% (0.3646 => 0.3486, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: -4.39% (0.3578 => 0.3421, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -4.37% (0.3663 => 0.3503, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.30% (0.3650 => 0.3493, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/property: -4.16% (0.3940 => 0.3776, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -4.01% (0.3789 => 0.3637, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: -3.88% (0.3914 => 0.3762, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -3.77% (0.4003 => 0.3852, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.07% (0.8818 => 0.8547, std. dev.: 0.0057) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.62% (0.6576 => 0.6404, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/bigfib: -2.58% (0.6250 => 0.6089, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: -2.18% (0.5818 => 0.5691, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: -1.98% (0.5748 => 0.5634, std. dev.: 0.0012) MultiSource/Applications/lua/lua: -1.13% (3.7467 => 3.7043, std. dev.: 0.0038) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -10.42% (1.2308 => 1.1026, std. dev.: 0.0079) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0013) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.50% (0.3139 => 0.2935, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/perlin: -4.83% (6.2497 => 5.9476, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.51% (1.3780 => 1.3158, std. dev.: 0.0031) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/dry: -3.99% (2.5089 => 2.4088, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.73% (0.3458 => 0.3329, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.65% (1.9762 => 1.9040, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -2.28% (6.3560 => 6.2113, std. dev.: 0.0046) SingleSource/Benchmarks/Misc/richards_benchmark: -2.12% (1.1560 => 1.1315, std. dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.00% (20.3410 => 19.9351, std. dev.: 0.0529) MultiSource/Applications/minisat/minisat: -1.96% (9.3358 => 9.1529, std. dev.: 0.0115) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.89% (6.6320 => 6.5065, std. dev.: 0.0036) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6911, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3446, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9953, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.31% (3.9173 => 3.8659, std. dev.: 0.0044) MultiSource/Applications/lua/lua: -1.30% (26.5159 => 26.1712, std. dev.: 0.0101) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.08s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue May 8 06:45:08 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 8 May 2012 08:45:08 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120508134508.C33F12A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/568?compare_to=567&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 568, Order: 156379, Start Time: 2012-05-08 12:49:17, End Time: 2012-05-08 13:45:48 To: 567, Order: 156377, Start Time: 2012-05-08 09:57:45, End Time: 2012-05-08 10:54:15 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (55 on baseline) Performance Improvements: 1 (45 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 890 (788 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 1.49% (1.3859 => 1.4065, std. dev.: 0.0020) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -4.20% (0.3858 => 0.3696, std. dev.: 0.0037) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.07% (2.0176 => 2.2611, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.78% (0.3130 => 0.3311, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.86% (0.2721 => 0.2826, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.85% (3.9660 => 4.0792, std. dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 2.57% (13.8202 => 14.1750, std. dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.41% (0.5265 => 0.5392, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/football/football: 2.27% (0.8310 => 0.8499, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.26% (0.6959 => 0.7116, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.23% (0.9199 => 0.9404, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 2.14% (1.0594 => 1.0821, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.04% (0.5637 => 0.5752, std. dev.: 0.0016) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.94% (1.1364 => 1.1585, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.93% (1.2193 => 1.2428, std. dev.: 0.0016) MultiSource/Applications/siod/siod: 1.92% (2.1791 => 2.2210, std. dev.: 0.0035) MultiSource/Applications/lambda-0_1_3/lambda: 1.69% (0.7038 => 0.7157, std. dev.: 0.0009) MultiSource/Applications/kimwitu++/kc: 1.61% (16.6129 => 16.8811, std. dev.: 0.0057) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.59% (1.4563 => 1.4795, std. dev.: 0.0024) MultiSource/Benchmarks/MallocBench/gs/gs: 1.53% (3.8646 => 3.9236, std. dev.: 0.0148) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.45% (0.7460 => 0.7568, std. dev.: 0.0008) MultiSource/Applications/Burg/burg: 1.39% (1.1061 => 1.1215, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.34% (0.7710 => 0.7813, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.30% (13.2842 => 13.4565, std. dev.: 0.0243) MultiSource/Applications/treecc/treecc: 1.22% (1.9270 => 1.9506, std. dev.: 0.0053) MultiSource/Applications/sqlite3/sqlite3: 1.20% (16.2614 => 16.4570, std. dev.: 0.0260) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.20% (1.3245 => 1.3404, std. dev.: 0.0024) MultiSource/Applications/SIBsim4/SIBsim4: 1.18% (1.2749 => 1.2900, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.14% (1.3819 => 1.3977, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.12% (3.2742 => 3.3110, std. dev.: 0.0066) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.04% (1.3813 => 1.3956, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.03% (2.1007 => 2.1223, std. dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.17% (1.8175 => 2.2568, std. dev.: 0.0442) SingleSource/Benchmarks/Misc/mandel-2: 8.21% (1.2998 => 1.4065, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6754, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.81% (1.9144 => 1.9874, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.65% (1.7688 => 1.8333, std. dev.: 0.0068) SingleSource/Benchmarks/Misc/salsa20: 3.55% (7.4271 => 7.6910, std. dev.: 0.0082) MultiSource/Benchmarks/nbench/nbench: 3.14% (11.2619 => 11.6152, std. dev.: 0.0016) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4548, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: 2.86% (1.9199 => 1.9748, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9393, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.71% (8.8259 => 9.0654, std. dev.: 0.0247) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.48% (7.9275 => 8.1244, std. dev.: 0.0144) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.61% (0.8273 => 0.8406, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.48% (1.4298 => 1.4509, std. dev.: 0.0006) MultiSource/Benchmarks/sim/sim: 1.46% (5.0168 => 5.0899, std. dev.: 0.0068) MultiSource/Benchmarks/NPB-serial/is/is: 1.39% (8.3908 => 8.5075, std. dev.: 0.0079) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.28% (2.0200 => 2.0458, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.21% (1.9433 => 1.9669, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1772, std. dev.: 0.0010) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -20.64% (0.4657 => 0.3696, std. dev.: 0.0037) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.89% (0.2670 => 0.2486, std. dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.49% (22.5627 => 21.0986, std. dev.: 0.0235) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.32% (0.3511 => 0.3289, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.60% (0.3650 => 0.3482, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -4.58% (0.3601 => 0.3436, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -4.53% (0.3646 => 0.3481, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -4.47% (0.3578 => 0.3418, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -4.47% (0.3623 => 0.3461, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -4.42% (0.3663 => 0.3501, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -4.16% (0.3940 => 0.3776, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -4.06% (0.3789 => 0.3635, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -3.99% (0.3914 => 0.3758, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: -3.70% (0.4003 => 0.3855, std. dev.: 0.0049) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.49% (0.8818 => 0.8510, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: -2.59% (0.6250 => 0.6088, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.45% (0.6576 => 0.6415, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: -2.31% (0.5748 => 0.5615, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference-object: -2.11% (0.5818 => 0.5695, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: -1.49% (0.7061 => 0.6956, std. dev.: 0.0014) MultiSource/Applications/lua/lua: -1.18% (3.7467 => 3.7025, std. dev.: 0.0024) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.12% (0.9108 => 0.9006, std. dev.: 0.0008) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -10.24% (1.2308 => 1.1048, std. dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.16% (1.0460 => 0.9502, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.50% (0.3139 => 0.2935, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2640, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9472, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.58% (1.3780 => 1.3149, std. dev.: 0.0090) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.99% (2.5089 => 2.4087, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -3.61% (1.9762 => 1.9048, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -2.30% (6.3560 => 6.2098, std. dev.: 0.0078) SingleSource/Benchmarks/Misc/richards_benchmark: -2.15% (1.1560 => 1.1312, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: -1.92% (9.3358 => 9.1567, std. dev.: 0.0371) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6912, std. dev.: 0.0016) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.88% (6.6320 => 6.5075, std. dev.: 0.0022) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.81% (20.3410 => 19.9731, std. dev.: 0.0457) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9954, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.43% (3.9173 => 3.8611, std. dev.: 0.0032) MultiSource/Applications/lua/lua: -1.29% (26.5159 => 26.1733, std. dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.02% (3.8887 => 3.8490, std. dev.: 0.0023) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.25s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue May 8 09:01:08 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 8 May 2012 11:01:08 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120508160108.2C9FE2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/569?compare_to=568&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 569, Order: 156381, Start Time: 2012-05-08 15:05:19, End Time: 2012-05-08 16:01:46 To: 568, Order: 156379, Start Time: 2012-05-08 12:49:17, End Time: 2012-05-08 13:45:48 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (52 on baseline) Performance Improvements: 0 (43 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (793 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.10% (2.0176 => 2.2618, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.75% (0.3130 => 0.3310, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.86% (0.2721 => 0.2826, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.99% (3.9660 => 4.0845, std. dev.: 0.0040) MultiSource/Applications/SPASS/SPASS: 2.62% (13.8202 => 14.1820, std. dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.41% (0.5265 => 0.5392, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/football/football: 2.33% (0.8310 => 0.8504, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.30% (0.9199 => 0.9411, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.30% (0.6959 => 0.7119, std. dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 2.20% (1.0594 => 1.0827, std. dev.: 0.0026) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.07% (1.1364 => 1.1599, std. dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.93% (1.2193 => 1.2428, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.88% (0.5637 => 0.5743, std. dev.: 0.0027) MultiSource/Applications/lambda-0_1_3/lambda: 1.75% (0.7038 => 0.7161, std. dev.: 0.0008) MultiSource/Applications/siod/siod: 1.74% (2.1791 => 2.2170, std. dev.: 0.0112) MultiSource/Applications/kimwitu++/kc: 1.64% (16.6129 => 16.8858, std. dev.: 0.0083) MultiSource/Benchmarks/MallocBench/gs/gs: 1.60% (3.8646 => 3.9264, std. dev.: 0.0024) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.49% (0.7460 => 0.7571, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 1.39% (1.1061 => 1.1215, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.35% (1.3245 => 1.3424, std. dev.: 0.0007) MultiSource/Applications/SIBsim4/SIBsim4: 1.26% (1.2749 => 1.2909, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.23% (3.2742 => 3.3146, std. dev.: 0.0044) MultiSource/Applications/sqlite3/sqlite3: 1.23% (16.2614 => 16.4608, std. dev.: 0.0146) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.22% (13.2842 => 13.4467, std. dev.: 0.0132) MultiSource/Applications/treecc/treecc: 1.21% (1.9270 => 1.9504, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.13% (1.3813 => 1.3969, std. dev.: 0.0036) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.11% (1.3819 => 1.3973, std. dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.04% (2.1007 => 2.1226, std. dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.50% (1.8175 => 2.2628, std. dev.: 0.0316) SingleSource/Benchmarks/Misc/mandel-2: 7.25% (1.2998 => 1.3940, std. dev.: 0.0129) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.89% (1.5824 => 1.6756, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9875, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.73% (1.7688 => 1.8348, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 3.67% (7.4271 => 7.6996, std. dev.: 0.0092) MultiSource/Benchmarks/nbench/nbench: 3.14% (11.2619 => 11.6153, std. dev.: 0.0038) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4554, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.97% (8.8259 => 9.0876, std. dev.: 0.0163) SingleSource/Benchmarks/Misc/flops-6: 2.91% (1.9199 => 1.9757, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9394, std. dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.51% (7.9275 => 8.1268, std. dev.: 0.0060) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.58% (0.8273 => 0.8404, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.52% (1.4298 => 1.4516, std. dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5098, std. dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.27% (2.0200 => 2.0457, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2135, std. dev.: 0.0034) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.16% (1.9433 => 1.9659, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 1.13% (9.0760 => 9.1789, std. dev.: 0.0008) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -21.77% (0.4657 => 0.3643, std. dev.: 0.0070) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.74% (0.2670 => 0.2490, std. dev.: 0.0024) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.46% (22.5627 => 21.1061, std. dev.: 0.0134) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.29% (0.3511 => 0.3290, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-3: -4.61% (0.3623 => 0.3456, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.55% (0.3650 => 0.3484, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-2: -4.47% (0.3601 => 0.3440, std. dev.: 0.0032) SingleSource/UnitTests/ObjC/synchronized: -4.40% (0.3663 => 0.3502, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -4.36% (0.3646 => 0.3487, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -4.36% (0.3578 => 0.3422, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -4.14% (0.3940 => 0.3777, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -3.99% (0.3789 => 0.3638, std. dev.: 0.0058) SingleSource/UnitTests/ObjC/exceptions: -3.93% (0.3914 => 0.3760, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -3.67% (0.4003 => 0.3856, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.59% (0.8818 => 0.8501, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/bigfib: -2.66% (0.6250 => 0.6084, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.40% (0.6576 => 0.6418, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/Hello: -2.24% (0.5748 => 0.5619, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: -2.11% (0.5818 => 0.5695, std. dev.: 0.0005) MultiSource/Applications/lua/lua: -1.19% (3.7467 => 3.7023, std. dev.: 0.0016) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -9.86% (1.2308 => 1.1094, std. dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.56% (0.3139 => 0.2933, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9473, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.29% (1.3780 => 1.3189, std. dev.: 0.0137) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -3.98% (2.5089 => 2.4091, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/bh/bh: -3.63% (1.9762 => 1.9044, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.59% (0.3458 => 0.3334, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -2.17% (1.1560 => 1.1309, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -1.97% (6.3560 => 6.2309, std. dev.: 0.0029) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.90% (20.3410 => 19.9542, std. dev.: 0.0447) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6908, std. dev.: 0.0021) MultiSource/Applications/minisat/minisat: -1.86% (9.3358 => 9.1623, std. dev.: 0.0303) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.82% (6.6320 => 6.5110, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9951, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.46% (3.9173 => 3.8600, std. dev.: 0.0037) MultiSource/Applications/lua/lua: -1.35% (26.5159 => 26.1571, std. dev.: 0.0157) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.14% (3.8887 => 3.8445, std. dev.: 0.0048) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.61s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue May 8 10:23:55 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 8 May 2012 12:23:55 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120508172355.8C4602A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/570?compare_to=569&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 570, Order: 156382, Start Time: 2012-05-08 16:28:05, End Time: 2012-05-08 17:24:34 To: 569, Order: 156381, Start Time: 2012-05-08 15:05:19, End Time: 2012-05-08 16:01:46 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (52 on baseline) Performance Improvements: 0 (44 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (792 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.09% (2.0176 => 2.2616, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.88% (0.3130 => 0.3314, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.82% (0.2721 => 0.2825, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.00% (3.9660 => 4.0849, std. dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 2.61% (13.8202 => 14.1815, std. dev.: 0.0103) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.51% (0.6959 => 0.7134, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.49% (0.5265 => 0.5396, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 2.27% (1.0594 => 1.0835, std. dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.27% (0.9199 => 0.9408, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 2.26% (0.8310 => 0.8498, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.06% (1.1364 => 1.1598, std. dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.98% (1.2193 => 1.2434, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.97% (0.5637 => 0.5748, std. dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: 1.86% (0.7038 => 0.7169, std. dev.: 0.0009) MultiSource/Applications/siod/siod: 1.77% (2.1791 => 2.2177, std. dev.: 0.0011) MultiSource/Applications/kimwitu++/kc: 1.76% (16.6129 => 16.9055, std. dev.: 0.0062) MultiSource/Benchmarks/MallocBench/gs/gs: 1.71% (3.8646 => 3.9308, std. dev.: 0.0034) MultiSource/Applications/Burg/burg: 1.46% (1.1061 => 1.1222, std. dev.: 0.0016) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.42% (0.7460 => 0.7566, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.42% (1.3245 => 1.3433, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 1.37% (1.9270 => 1.9534, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.27% (1.3819 => 1.3995, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.24% (13.2842 => 13.4493, std. dev.: 0.0042) MultiSource/Applications/sqlite3/sqlite3: 1.19% (16.2614 => 16.4547, std. dev.: 0.0202) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.18% (1.3813 => 1.3976, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.10% (2.1007 => 2.1238, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.03% (3.2742 => 3.3078, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.01% (3.6692 => 3.7061, std. dev.: 0.0028) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.01% (1.8175 => 2.2538, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/mandel-2: 8.12% (1.2998 => 1.4053, std. dev.: 0.0043) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7298, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.90% (1.5824 => 1.6757, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9875, std. dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.65% (1.7688 => 1.8333, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/salsa20: 3.58% (7.4271 => 7.6931, std. dev.: 0.0068) MultiSource/Benchmarks/nbench/nbench: 3.13% (11.2619 => 11.6140, std. dev.: 0.0041) MultiSource/Applications/hexxagon/hexxagon: 2.98% (12.0921 => 12.4528, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/flops-6: 2.92% (1.9199 => 1.9759, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.85% (8.8259 => 9.0770, std. dev.: 0.0166) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9394, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.65% (7.9275 => 8.1377, std. dev.: 0.0112) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.60% (1.9290 => 1.9599, std. dev.: 0.0080) MultiSource/Applications/lemon/lemon: 1.45% (1.4298 => 1.4506, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5083, std. dev.: 0.0025) MultiSource/Benchmarks/sim/sim: 1.33% (5.0168 => 5.0837, std. dev.: 0.0078) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.25% (2.0200 => 2.0453, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.16% (1.9433 => 1.9658, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 1.11% (9.0760 => 9.1763, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -19.86% (0.4657 => 0.3732, std. dev.: 0.0097) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.85% (0.2670 => 0.2487, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.36% (22.5627 => 21.1279, std. dev.: 0.0114) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.04% (0.3511 => 0.3299, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-3: -4.64% (0.3623 => 0.3455, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.55% (0.3650 => 0.3484, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -4.53% (0.3601 => 0.3438, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: -4.47% (0.3578 => 0.3418, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -4.44% (0.3646 => 0.3484, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: -4.37% (0.3663 => 0.3503, std. dev.: 0.0021) SingleSource/UnitTests/ObjC/property: -4.26% (0.3940 => 0.3772, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -4.06% (0.3789 => 0.3635, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: -3.93% (0.3914 => 0.3760, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -3.62% (0.4003 => 0.3858, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.53% (0.8818 => 0.8507, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: -2.62% (0.6250 => 0.6086, std. dev.: 0.0051) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.52% (0.6576 => 0.6410, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/Hello: -2.33% (0.5748 => 0.5614, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: -2.13% (0.5818 => 0.5694, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: -1.44% (0.7061 => 0.6959, std. dev.: 0.0002) MultiSource/Applications/lua/lua: -1.04% (3.7467 => 3.7076, std. dev.: 0.0046) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -10.46% (1.2308 => 1.1020, std. dev.: 0.0073) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.53% (0.3139 => 0.2934, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2650, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9474, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.67% (1.3780 => 1.3137, std. dev.: 0.0038) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -4.04% (2.5089 => 2.4075, std. dev.: 0.0012) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.55% (1.9762 => 1.9061, std. dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.56% (20.3410 => 19.8209, std. dev.: 0.0964) SingleSource/Benchmarks/Shootout/lists: -2.22% (6.3560 => 6.2148, std. dev.: 0.0064) SingleSource/Benchmarks/Misc/richards_benchmark: -2.15% (1.1560 => 1.1312, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: -2.05% (9.3358 => 9.1448, std. dev.: 0.0044) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6910, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.87% (6.6320 => 6.5077, std. dev.: 0.0052) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9954, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.56% (0.9692 => 0.9541, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.29% (3.9173 => 3.8666, std. dev.: 0.0016) MultiSource/Applications/lua/lua: -1.28% (26.5159 => 26.1778, std. dev.: 0.0278) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.04% (3.8887 => 3.8483, std. dev.: 0.0027) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.11s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue May 8 11:46:46 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 8 May 2012 13:46:46 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120508184646.EB6262A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/571?compare_to=570&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 571, Order: 156387, Start Time: 2012-05-08 17:50:54, End Time: 2012-05-08 18:47:26 To: 570, Order: 156382, Start Time: 2012-05-08 16:28:05, End Time: 2012-05-08 17:24:34 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (55 on baseline) Performance Improvements: 0 (45 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 891 (788 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 1.75% (3.7793 => 3.8456, std. dev.: 0.0156) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.69% (2.0176 => 2.2736, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.29% (0.3130 => 0.3327, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.08% (0.2721 => 0.2832, std. dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.96% (3.9660 => 4.0833, std. dev.: 0.0023) MultiSource/Applications/SPASS/SPASS: 2.80% (13.8202 => 14.2077, std. dev.: 0.0083) MultiSource/Benchmarks/nbench/nbench: 2.60% (1.0594 => 1.0869, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.55% (0.5265 => 0.5399, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.52% (0.9199 => 0.9431, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.46% (0.6959 => 0.7130, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/football/football: 2.44% (0.8310 => 0.8513, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.24% (1.1364 => 1.1619, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.19% (1.2193 => 1.2460, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.97% (0.5637 => 0.5748, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.83% (1.4563 => 1.4830, std. dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: 1.78% (0.7038 => 0.7163, std. dev.: 0.0008) MultiSource/Applications/siod/siod: 1.75% (2.1791 => 2.2173, std. dev.: 0.0024) MultiSource/Applications/kimwitu++/kc: 1.61% (16.6129 => 16.8800, std. dev.: 0.0151) MultiSource/Benchmarks/MallocBench/gs/gs: 1.60% (3.8646 => 3.9265, std. dev.: 0.0068) MultiSource/Applications/Burg/burg: 1.57% (1.1061 => 1.1235, std. dev.: 0.0058) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.47% (0.7460 => 0.7570, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.45% (1.3245 => 1.3437, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.42% (3.2742 => 3.3206, std. dev.: 0.0050) MultiSource/Applications/treecc/treecc: 1.37% (1.9270 => 1.9534, std. dev.: 0.0009) MultiSource/Applications/SIBsim4/SIBsim4: 1.33% (1.2749 => 1.2918, std. dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: 1.32% (16.2614 => 16.4768, std. dev.: 0.0062) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.32% (1.3813 => 1.3995, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.30% (2.1007 => 2.1281, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.30% (13.2842 => 13.4565, std. dev.: 0.0053) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.26% (1.3819 => 1.3993, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.16% (3.6692 => 3.7117, std. dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.26% (1.8175 => 2.2585, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/mandel-2: 7.47% (1.2998 => 1.3969, std. dev.: 0.0050) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.89% (1.5824 => 1.6756, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9879, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.66% (1.7688 => 1.8335, std. dev.: 0.0067) SingleSource/Benchmarks/Misc/salsa20: 3.62% (7.4271 => 7.6956, std. dev.: 0.0022) MultiSource/Benchmarks/nbench/nbench: 3.14% (11.2619 => 11.6155, std. dev.: 0.0044) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4539, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-6: 2.94% (1.9199 => 1.9763, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.80% (8.8259 => 9.0728, std. dev.: 0.0099) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9392, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.25% (7.9275 => 8.1057, std. dev.: 0.0105) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/llubenchmark/llu: 1.92% (3.7731 => 3.8456, std. dev.: 0.0156) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.56% (0.8273 => 0.8402, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.48% (1.4298 => 1.4509, std. dev.: 0.0019) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5084, std. dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.25% (2.0200 => 2.0453, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2135, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.13% (9.0760 => 9.1789, std. dev.: 0.0005) MultiSource/Benchmarks/sim/sim: 1.11% (5.0168 => 5.0727, std. dev.: 0.0083) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -22.35% (0.4657 => 0.3616, std. dev.: 0.0322) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.40% (0.2670 => 0.2499, std. dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.40% (22.5627 => 21.1193, std. dev.: 0.0204) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.29% (0.3511 => 0.3290, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -4.83% (0.3601 => 0.3427, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -4.78% (0.3623 => 0.3450, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.77% (0.3650 => 0.3476, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/trivial-interface: -4.70% (0.3578 => 0.3410, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -4.67% (0.3663 => 0.3492, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: -4.61% (0.3646 => 0.3478, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -4.29% (0.3940 => 0.3771, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -4.28% (0.3789 => 0.3627, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -4.09% (0.3914 => 0.3754, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: -3.95% (0.4003 => 0.3845, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.24% (0.8818 => 0.8532, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.68% (0.6576 => 0.6400, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: -2.56% (0.6250 => 0.6090, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: -2.42% (0.5748 => 0.5609, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: -2.32% (0.5818 => 0.5683, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: -1.70% (0.7061 => 0.6941, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.09% (1.9828 => 1.9611, std. dev.: 0.0028) MultiSource/Applications/lua/lua: -1.07% (3.7467 => 3.7066, std. dev.: 0.0008) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -9.86% (1.2308 => 1.1094, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.59% (0.3139 => 0.2932, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2641, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9473, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.75% (1.3780 => 1.3125, std. dev.: 0.0062) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -4.07% (2.5089 => 2.4068, std. dev.: 0.0008) MultiSource/Benchmarks/Olden/bh/bh: -3.71% (1.9762 => 1.9028, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.67% (0.3458 => 0.3331, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -2.20% (6.3560 => 6.2162, std. dev.: 0.0047) SingleSource/Benchmarks/Misc/richards_benchmark: -2.15% (1.1560 => 1.1311, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.95% (20.3410 => 19.9442, std. dev.: 0.0256) MultiSource/Applications/minisat/minisat: -1.93% (9.3358 => 9.1555, std. dev.: 0.0143) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.90% (6.6320 => 6.5058, std. dev.: 0.0029) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6919, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3446, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9954, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/heapsort: -1.44% (3.9173 => 3.8610, std. dev.: 0.0134) MultiSource/Applications/lua/lua: -1.37% (26.5159 => 26.1539, std. dev.: 0.0259) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.05% (3.8887 => 3.8478, std. dev.: 0.0088) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.21s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue May 8 13:09:34 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 8 May 2012 15:09:34 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120508200934.D872A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/572?compare_to=571&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 572, Order: 156396, Start Time: 2012-05-08 19:13:43, End Time: 2012-05-08 20:10:12 To: 571, Order: 156387, Start Time: 2012-05-08 17:50:54, End Time: 2012-05-08 18:47:26 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (53 on baseline) Performance Improvements: 1 (44 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 891 (791 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -2.13% (3.8456 => 3.7637, std. dev.: 0.0284) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.72% (2.0176 => 2.2742, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.07% (0.3130 => 0.3320, std. dev.: 0.0048) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.97% (0.2721 => 0.2829, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 2.81% (13.8202 => 14.2080, std. dev.: 0.0094) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.53% (0.5265 => 0.5398, std. dev.: 0.0037) MultiSource/Benchmarks/nbench/nbench: 2.50% (1.0594 => 1.0859, std. dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/football/football: 2.45% (0.8310 => 0.8514, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.36% (0.6959 => 0.7123, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.28% (0.9199 => 0.9409, std. dev.: 0.0017) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.21% (1.1364 => 1.1615, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.16% (1.2193 => 1.2456, std. dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.08% (0.5637 => 0.5754, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.99% (0.5577 => 0.5688, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.81% (1.4563 => 1.4827, std. dev.: 0.0023) MultiSource/Applications/siod/siod: 1.68% (2.1791 => 2.2156, std. dev.: 0.0075) MultiSource/Applications/kimwitu++/kc: 1.63% (16.6129 => 16.8839, std. dev.: 0.0147) MultiSource/Applications/lambda-0_1_3/lambda: 1.61% (0.7038 => 0.7151, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.53% (1.3819 => 1.4031, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.51% (0.7460 => 0.7573, std. dev.: 0.0016) MultiSource/Applications/treecc/treecc: 1.48% (1.9270 => 1.9555, std. dev.: 0.0030) MultiSource/Applications/Burg/burg: 1.42% (1.1061 => 1.1218, std. dev.: 0.0007) MultiSource/Applications/SIBsim4/SIBsim4: 1.36% (1.2749 => 1.2923, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.36% (1.3813 => 1.4001, std. dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: 1.33% (16.2614 => 16.4775, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.30% (13.2842 => 13.4575, std. dev.: 0.0142) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.29% (3.2742 => 3.3164, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.26% (2.1007 => 2.1272, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.22% (3.6692 => 3.7138, std. dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.09% (1.5188 => 1.5354, std. dev.: 0.0007) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.11% (1.8175 => 2.2557, std. dev.: 0.0054) SingleSource/Benchmarks/Misc/mandel-2: 8.29% (1.2998 => 1.4075, std. dev.: 0.0061) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6754, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8143, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9882, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.74% (1.7688 => 1.8350, std. dev.: 0.0177) SingleSource/Benchmarks/Misc/salsa20: 3.72% (7.4271 => 7.7031, std. dev.: 0.0030) MultiSource/Benchmarks/nbench/nbench: 3.11% (11.2619 => 11.6124, std. dev.: 0.0028) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4545, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: 2.86% (1.9199 => 1.9749, std. dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.84% (8.8259 => 9.0763, std. dev.: 0.0090) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.74% (2.8606 => 2.9391, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.28% (7.9275 => 8.1085, std. dev.: 0.0169) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 1.57% (0.8273 => 0.8403, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.48% (1.4298 => 1.4510, std. dev.: 0.0025) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5087, std. dev.: 0.0072) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.29% (2.0200 => 2.0460, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 1.27% (5.0168 => 5.0803, std. dev.: 0.0093) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.10% (9.0760 => 9.1759, std. dev.: 0.0021) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -16.00% (0.4657 => 0.3912, std. dev.: 0.0189) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.40% (22.5627 => 21.1191, std. dev.: 0.0104) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.37% (0.2670 => 0.2500, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.32% (0.3511 => 0.3289, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: -4.91% (0.3623 => 0.3445, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.74% (0.3650 => 0.3477, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -4.72% (0.3601 => 0.3431, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -4.70% (0.3578 => 0.3410, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -4.66% (0.3646 => 0.3476, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -4.64% (0.3663 => 0.3493, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -4.31% (0.3940 => 0.3770, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -4.22% (0.3789 => 0.3629, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -4.22% (0.3914 => 0.3749, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -3.97% (0.4003 => 0.3844, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.28% (0.8818 => 0.8529, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.65% (0.6576 => 0.6402, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/Hello: -2.44% (0.5748 => 0.5608, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: -2.43% (0.6250 => 0.6098, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: -2.27% (0.5818 => 0.5686, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: -1.67% (0.7061 => 0.6943, std. dev.: 0.0034) MultiSource/Applications/lua/lua: -1.13% (3.7467 => 3.7044, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.09% (1.9828 => 1.9612, std. dev.: 0.0021) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -10.46% (1.2308 => 1.1021, std. dev.: 0.0049) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.56% (0.3139 => 0.2933, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2640, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.93% (1.3780 => 1.3100, std. dev.: 0.0048) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9474, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -4.06% (2.5089 => 2.4070, std. dev.: 0.0013) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.63% (1.9762 => 1.9044, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/lists: -2.34% (6.3560 => 6.2072, std. dev.: 0.0145) SingleSource/Benchmarks/Misc/richards_benchmark: -2.13% (1.1560 => 1.1314, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: -1.98% (9.3358 => 9.1514, std. dev.: 0.0267) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.92% (6.6320 => 6.5044, std. dev.: 0.0070) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6918, std. dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.74% (20.3410 => 19.9866, std. dev.: 0.0342) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9954, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) MultiSource/Applications/lua/lua: -1.42% (26.5159 => 26.1406, std. dev.: 0.0377) SingleSource/Benchmarks/Shootout/heapsort: -1.39% (3.9173 => 3.8627, std. dev.: 0.0151) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.15s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue May 8 14:32:22 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 8 May 2012 16:32:22 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120508213222.3AA362A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/573?compare_to=572&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 573, Order: 156411, Start Time: 2012-05-08 20:36:30, End Time: 2012-05-08 21:33:01 To: 572, Order: 156396, Start Time: 2012-05-08 19:13:43, End Time: 2012-05-08 20:10:12 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (56 on baseline) Performance Improvements: 0 (41 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 891 (791 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC++/property-reference: 1.54% (0.6943 => 0.7050, std. dev.: 0.0017) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.33% (2.0176 => 2.2664, std. dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.01% (0.3130 => 0.3318, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.93% (0.2721 => 0.2828, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.96% (3.9660 => 4.0835, std. dev.: 0.0098) MultiSource/Applications/SPASS/SPASS: 2.58% (13.8202 => 14.1769, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.51% (0.5265 => 0.5397, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 2.38% (1.0594 => 1.0846, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 2.33% (0.8310 => 0.8504, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.31% (0.6959 => 0.7120, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.23% (0.9199 => 0.9404, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.11% (1.2193 => 1.2450, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.10% (1.1364 => 1.1603, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 1.95% (0.7038 => 0.7175, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.93% (0.5637 => 0.5746, std. dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: 1.91% (16.6129 => 16.9294, std. dev.: 0.0115) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.65% (1.4563 => 1.4803, std. dev.: 0.0019) MultiSource/Applications/siod/siod: 1.65% (2.1791 => 2.2150, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/gs/gs: 1.63% (3.8646 => 3.9277, std. dev.: 0.0071) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.34% (0.7460 => 0.7560, std. dev.: 0.0006) MultiSource/Applications/Burg/burg: 1.34% (1.1061 => 1.1209, std. dev.: 0.0007) MultiSource/Applications/SIBsim4/SIBsim4: 1.32% (1.2749 => 1.2917, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.28% (1.3245 => 1.3415, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.20% (3.2742 => 3.3134, std. dev.: 0.0019) MultiSource/Applications/sqlite3/sqlite3: 1.18% (16.2614 => 16.4531, std. dev.: 0.0246) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.18% (13.2842 => 13.4407, std. dev.: 0.0055) MultiSource/Applications/treecc/treecc: 1.18% (1.9270 => 1.9497, std. dev.: 0.0008) MultiSource/Applications/hbd/hbd: 1.12% (1.3693 => 1.3846, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.06% (1.3819 => 1.3965, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.02% (3.6692 => 3.7065, std. dev.: 0.0055) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.01% (1.3813 => 1.3952, std. dev.: 0.0020) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 26.51% (1.8175 => 2.2993, std. dev.: 0.0359) SingleSource/Benchmarks/Misc/mandel-2: 7.29% (1.2998 => 1.3945, std. dev.: 0.0109) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6755, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8143, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9881, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.69% (1.7688 => 1.8340, std. dev.: 0.0178) SingleSource/Benchmarks/Misc/salsa20: 3.59% (7.4271 => 7.6937, std. dev.: 0.0063) MultiSource/Benchmarks/nbench/nbench: 3.14% (11.2619 => 11.6157, std. dev.: 0.0016) MultiSource/Applications/hexxagon/hexxagon: 3.01% (12.0921 => 12.4565, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.87% (8.8259 => 9.0791, std. dev.: 0.0056) SingleSource/Benchmarks/Misc/flops-6: 2.81% (1.9199 => 1.9738, std. dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9393, std. dev.: 0.0024) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.31% (7.9275 => 8.1110, std. dev.: 0.0103) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/ffbench: 1.61% (0.8273 => 0.8406, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.43% (8.3908 => 8.5104, std. dev.: 0.0059) MultiSource/Applications/lemon/lemon: 1.42% (1.4298 => 1.4501, std. dev.: 0.0019) MultiSource/Benchmarks/sim/sim: 1.42% (5.0168 => 5.0879, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.29% (2.0200 => 2.0460, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.23% (1.9433 => 1.9672, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bisort/bisort: 1.21% (0.8239 => 0.8339, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1772, std. dev.: 0.0010) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -21.00% (0.4657 => 0.3679, std. dev.: 0.0368) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.85% (0.2670 => 0.2487, std. dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.40% (22.5627 => 21.1195, std. dev.: 0.0051) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.27% (0.3511 => 0.3291, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: -4.55% (0.3623 => 0.3458, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -4.36% (0.3601 => 0.3444, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -4.34% (0.3663 => 0.3504, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: -4.28% (0.3646 => 0.3490, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: -4.28% (0.3578 => 0.3425, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.22% (0.3650 => 0.3496, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/property: -3.93% (0.3940 => 0.3785, std. dev.: 0.0027) SingleSource/UnitTests/ObjC/for-in: -3.91% (0.3789 => 0.3641, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -3.83% (0.3914 => 0.3764, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -3.62% (0.4003 => 0.3858, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.50% (0.8818 => 0.8509, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.06% (0.6576 => 0.6375, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/bigfib: -2.19% (0.6250 => 0.6113, std. dev.: 0.0006) MultiSource/Applications/lua/lua: -1.13% (3.7467 => 3.7044, std. dev.: 0.0024) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -10.12% (1.2308 => 1.1063, std. dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.16% (1.0460 => 0.9502, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.56% (0.3139 => 0.2933, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.12% (1.3780 => 1.3075, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9475, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0011) SingleSource/Benchmarks/Dhrystone/dry: -4.03% (2.5089 => 2.4078, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.73% (0.3458 => 0.3329, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.61% (1.9762 => 1.9049, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/richards_benchmark: -2.15% (1.1560 => 1.1312, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -2.12% (6.3560 => 6.2210, std. dev.: 0.0059) MultiSource/Applications/minisat/minisat: -2.04% (9.3358 => 9.1451, std. dev.: 0.0342) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.04% (20.3410 => 19.9268, std. dev.: 0.0727) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.95% (6.6320 => 6.5029, std. dev.: 0.0014) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6921, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9955, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.56% (0.9692 => 0.9541, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.39% (3.9173 => 3.8629, std. dev.: 0.0016) MultiSource/Applications/lua/lua: -1.33% (26.5159 => 26.1635, std. dev.: 0.0395) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.05% (3.8887 => 3.8479, std. dev.: 0.0042) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.16s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue May 8 15:55:00 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 8 May 2012 17:55:00 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120508225500.DC4D92A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/574?compare_to=573&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 574, Order: 156421, Start Time: 2012-05-08 21:59:14, End Time: 2012-05-08 22:55:40 To: 573, Order: 156411, Start Time: 2012-05-08 20:36:30, End Time: 2012-05-08 21:33:01 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (52 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (797 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.30% (2.0176 => 2.2860, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.20% (0.3130 => 0.3324, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.26% (0.2721 => 0.2837, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.26% (3.9660 => 4.0953, std. dev.: 0.0019) MultiSource/Applications/SPASS/SPASS: 2.76% (13.8202 => 14.2016, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.70% (0.5265 => 0.5407, std. dev.: 0.0043) MultiSource/Benchmarks/nbench/nbench: 2.60% (1.0594 => 1.0869, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: 2.56% (0.8310 => 0.8523, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.46% (0.6959 => 0.7130, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.46% (0.9199 => 0.9425, std. dev.: 0.0030) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.26% (1.1364 => 1.1621, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.19% (1.2193 => 1.2460, std. dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.18% (0.5637 => 0.5760, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.83% (1.4563 => 1.4829, std. dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 1.56% (16.6129 => 16.8723, std. dev.: 0.0073) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.54% (13.2842 => 13.4888, std. dev.: 0.0190) MultiSource/Applications/siod/siod: 1.53% (2.1791 => 2.2125, std. dev.: 0.0053) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.49% (0.7460 => 0.7571, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.45% (1.3245 => 1.3437, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 1.44% (0.7038 => 0.7139, std. dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: 1.42% (1.2749 => 1.2930, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.39% (0.7710 => 0.7817, std. dev.: 0.0017) MultiSource/Benchmarks/MallocBench/gs/gs: 1.36% (3.8646 => 3.9170, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.31% (3.6692 => 3.7171, std. dev.: 0.0032) MultiSource/Applications/hbd/hbd: 1.28% (1.3693 => 1.3868, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.18% (3.2742 => 3.3128, std. dev.: 0.0013) MultiSource/Applications/sqlite3/sqlite3: 1.17% (16.2614 => 16.4523, std. dev.: 0.0211) MultiSource/Applications/JM/lencod/lencod: 1.07% (14.8535 => 15.0131, std. dev.: 0.0119) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.69% (1.8175 => 2.2662, std. dev.: 0.0475) SingleSource/Benchmarks/Misc/mandel-2: 8.41% (1.2998 => 1.4091, std. dev.: 0.0068) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7298, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.87% (1.5824 => 1.6753, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8146, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9877, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.68% (1.7688 => 1.8339, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: 3.61% (7.4271 => 7.6949, std. dev.: 0.0025) MultiSource/Benchmarks/nbench/nbench: 3.12% (11.2619 => 11.6134, std. dev.: 0.0031) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4549, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-6: 2.89% (1.9199 => 1.9754, std. dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.80% (8.8259 => 9.0734, std. dev.: 0.0192) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9393, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.38% (7.9275 => 8.1160, std. dev.: 0.0145) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.55% (0.8273 => 0.8401, std. dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5091, std. dev.: 0.0015) MultiSource/Applications/lemon/lemon: 1.36% (1.4298 => 1.4492, std. dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.25% (2.0200 => 2.0453, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.18% (1.9433 => 1.9662, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 1.11% (9.0760 => 9.1769, std. dev.: 0.0015) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -21.64% (0.4657 => 0.3649, std. dev.: 0.0054) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.30% (0.2670 => 0.2475, std. dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.32% (22.5627 => 21.1370, std. dev.: 0.0185) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.70% (0.3511 => 0.3311, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -3.70% (0.3623 => 0.3489, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.62% (0.3650 => 0.3518, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -3.53% (0.3601 => 0.3474, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: -3.47% (0.3663 => 0.3536, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -3.43% (0.3646 => 0.3521, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -3.38% (0.3940 => 0.3807, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -3.17% (0.3789 => 0.3669, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -3.12% (0.3914 => 0.3792, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -3.02% (0.4003 => 0.3882, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.94% (0.8818 => 0.8559, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/bigfib: -2.18% (0.6250 => 0.6114, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.17% (0.6576 => 0.6433, std. dev.: 0.0016) MultiSource/Applications/lua/lua: -1.28% (3.7467 => 3.6986, std. dev.: 0.0156) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -10.39% (1.2308 => 1.1029, std. dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.16% (1.0460 => 0.9502, std. dev.: 0.0013) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.56% (0.3139 => 0.2933, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9474, std. dev.: 0.0003) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.44% (1.3780 => 1.3168, std. dev.: 0.0045) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -3.99% (2.5089 => 2.4087, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.73% (0.3458 => 0.3329, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.61% (1.9762 => 1.9049, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: -2.13% (1.1560 => 1.1314, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -2.04% (6.3560 => 6.2263, std. dev.: 0.0073) MultiSource/Applications/minisat/minisat: -1.91% (9.3358 => 9.1574, std. dev.: 0.0090) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6910, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.88% (6.6320 => 6.5075, std. dev.: 0.0030) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.87% (20.3410 => 19.9609, std. dev.: 0.0500) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3444, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9953, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.56% (0.9692 => 0.9541, std. dev.: 0.0000) MultiSource/Applications/lua/lua: -1.46% (26.5159 => 26.1289, std. dev.: 0.0234) SingleSource/Benchmarks/Shootout/heapsort: -1.41% (3.9173 => 3.8619, std. dev.: 0.0021) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.15s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue May 8 17:17:42 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 8 May 2012 19:17:42 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120509001742.D6B0C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/575?compare_to=574&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 575, Order: 156431, Start Time: 2012-05-08 23:21:53, End Time: 2012-05-09 00:18:22 To: 574, Order: 156421, Start Time: 2012-05-08 21:59:14, End Time: 2012-05-08 22:55:40 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (56 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 891 (792 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 3.18% (2.2662 => 2.3383, std. dev.: 0.0118) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.41% (2.0176 => 2.2680, std. dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.17% (0.3130 => 0.3323, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.19% (0.2721 => 0.2835, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.18% (3.9660 => 4.0922, std. dev.: 0.0031) MultiSource/Applications/SPASS/SPASS: 2.68% (13.8202 => 14.1900, std. dev.: 0.0126) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.58% (0.5265 => 0.5401, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.54% (0.6959 => 0.7136, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 2.53% (0.8310 => 0.8520, std. dev.: 0.0034) MultiSource/Benchmarks/nbench/nbench: 2.46% (1.0594 => 1.0855, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.32% (0.9199 => 0.9412, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.16% (1.1364 => 1.1609, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.15% (1.2193 => 1.2455, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.04% (0.5637 => 0.5752, std. dev.: 0.0028) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.81% (1.4563 => 1.4827, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 1.78% (0.7038 => 0.7163, std. dev.: 0.0007) MultiSource/Applications/siod/siod: 1.67% (2.1791 => 2.2155, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/gs/gs: 1.65% (3.8646 => 3.9284, std. dev.: 0.0031) MultiSource/Applications/kimwitu++/kc: 1.63% (16.6129 => 16.8843, std. dev.: 0.0195) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.54% (0.7460 => 0.7575, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.45% (1.3245 => 1.3437, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 1.45% (1.1061 => 1.1221, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.43% (13.2842 => 13.4740, std. dev.: 0.0069) MultiSource/Applications/SIBsim4/SIBsim4: 1.43% (1.2749 => 1.2931, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.40% (0.7710 => 0.7818, std. dev.: 0.0029) MultiSource/Applications/treecc/treecc: 1.33% (1.9270 => 1.9527, std. dev.: 0.0061) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.32% (1.3813 => 1.3995, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.31% (3.2742 => 3.3172, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.30% (1.3819 => 1.3999, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.22% (3.6692 => 3.7139, std. dev.: 0.0050) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.18% (2.1007 => 2.1255, std. dev.: 0.0077) MultiSource/Applications/sqlite3/sqlite3: 1.13% (16.2614 => 16.4453, std. dev.: 0.0151) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.07% (1.5188 => 1.5350, std. dev.: 0.0000) MultiSource/Applications/hbd/hbd: 1.04% (1.3693 => 1.3836, std. dev.: 0.0019) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 28.65% (1.8175 => 2.3383, std. dev.: 0.0118) SingleSource/Benchmarks/Misc/mandel-2: 8.05% (1.2998 => 1.4044, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.90% (1.5824 => 1.6757, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8147, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9882, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 3.61% (7.4271 => 7.6954, std. dev.: 0.0087) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.61% (1.7688 => 1.8326, std. dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 3.14% (11.2619 => 11.6156, std. dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4537, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/flops-6: 2.86% (1.9199 => 1.9749, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.79% (8.8259 => 9.0719, std. dev.: 0.0152) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9393, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.43% (7.9275 => 8.1201, std. dev.: 0.0044) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0083) SingleSource/Benchmarks/Misc/ffbench: 1.55% (0.8273 => 0.8401, std. dev.: 0.0032) MultiSource/Applications/lemon/lemon: 1.41% (1.4298 => 1.4499, std. dev.: 0.0020) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5082, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.31% (2.0200 => 2.0465, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.13% (9.0760 => 9.1786, std. dev.: 0.0005) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.70% (0.2670 => 0.2491, std. dev.: 0.0028) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.44% (22.5627 => 21.1102, std. dev.: 0.0106) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.78% (0.3511 => 0.3308, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: -4.64% (0.3623 => 0.3455, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.41% (0.3650 => 0.3489, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/trivial-interface: -4.39% (0.3578 => 0.3421, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: -4.30% (0.3601 => 0.3446, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -4.22% (0.3646 => 0.3492, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -4.18% (0.3663 => 0.3510, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -4.06% (0.3940 => 0.3780, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -3.91% (0.3914 => 0.3761, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -3.80% (0.3789 => 0.3645, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -3.67% (0.4003 => 0.3856, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.85% (0.8818 => 0.8567, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: -2.56% (0.6250 => 0.6090, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.55% (0.6576 => 0.6408, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: -1.97% (0.5748 => 0.5635, std. dev.: 0.0004) MultiSource/Applications/lua/lua: -1.15% (3.7467 => 3.7037, std. dev.: 0.0050) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -10.89% (1.2308 => 1.0968, std. dev.: 0.0044) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.16% (1.0460 => 0.9502, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.53% (0.3139 => 0.2934, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.99% (1.3780 => 1.3092, std. dev.: 0.0073) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9475, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -4.07% (2.5089 => 2.4068, std. dev.: 0.0013) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.68% (1.9762 => 1.9035, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: -2.15% (1.1560 => 1.1312, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout/lists: -1.98% (6.3560 => 6.2304, std. dev.: 0.0017) MultiSource/Applications/minisat/minisat: -1.93% (9.3358 => 9.1558, std. dev.: 0.0110) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6910, std. dev.: 0.0031) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.84% (6.6320 => 6.5098, std. dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.81% (20.3410 => 19.9724, std. dev.: 0.0097) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9955, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) MultiSource/Applications/lua/lua: -1.40% (26.5159 => 26.1442, std. dev.: 0.0412) SingleSource/Benchmarks/Shootout/heapsort: -1.39% (3.9173 => 3.8629, std. dev.: 0.0018) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.20s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue May 8 18:40:27 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 8 May 2012 20:40:27 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120509014027.89C5C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/576?compare_to=575&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 576, Order: 156449, Start Time: 2012-05-09 00:44:38, End Time: 2012-05-09 01:41:07 To: 575, Order: 156431, Start Time: 2012-05-08 23:21:53, End Time: 2012-05-09 00:18:22 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (59 on baseline) Performance Improvements: 1 (40 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 889 (789 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 1.32% (1.9682 => 1.9941, std. dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/McGill/chomp: 1.60% (1.0968 => 1.1144, std. dev.: 0.0026) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/fbench: -3.61% (2.3383 => 2.2540, std. dev.: 0.0049) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.32% (2.0176 => 2.2661, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.39% (0.3130 => 0.3330, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.19% (0.2721 => 0.2835, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.44% (3.9660 => 4.1024, std. dev.: 0.0044) MultiSource/Applications/SPASS/SPASS: 2.77% (13.8202 => 14.2036, std. dev.: 0.0166) MultiSource/Benchmarks/nbench/nbench: 2.67% (1.0594 => 1.0877, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.66% (0.5265 => 0.5405, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.60% (0.6959 => 0.7140, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 2.60% (0.8310 => 0.8526, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 2.54% (0.4328 => 0.4438, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.50% (1.2193 => 1.2498, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.47% (0.9199 => 0.9426, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.22% (0.5637 => 0.5762, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.21% (1.1364 => 1.1615, std. dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 2.01% (16.6129 => 16.9463, std. dev.: 0.0241) MultiSource/Applications/lambda-0_1_3/lambda: 1.97% (0.7038 => 0.7177, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.94% (1.4563 => 1.4845, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.83% (0.5577 => 0.5679, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 1.76% (2.1791 => 2.2175, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 1.76% (3.8646 => 3.9326, std. dev.: 0.0021) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.72% (0.7460 => 0.7588, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 1.56% (1.3693 => 1.3907, std. dev.: 0.0016) MultiSource/Applications/Burg/burg: 1.54% (1.1061 => 1.1231, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.53% (1.3245 => 1.3447, std. dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.49% (2.1007 => 2.1319, std. dev.: 0.0039) MultiSource/Applications/treecc/treecc: 1.46% (1.9270 => 1.9552, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.46% (13.2842 => 13.4778, std. dev.: 0.0121) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.45% (3.6692 => 3.7224, std. dev.: 0.0067) MultiSource/Applications/SIBsim4/SIBsim4: 1.40% (1.2749 => 1.2927, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.25% (1.3813 => 1.3986, std. dev.: 0.0024) MultiSource/Applications/sqlite3/sqlite3: 1.17% (16.2614 => 16.4518, std. dev.: 0.0068) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.14% (1.3819 => 1.3977, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.09% (1.5188 => 1.5354, std. dev.: 0.0015) MultiSource/Benchmarks/Bullet/bullet: 1.07% (33.2944 => 33.6505, std. dev.: 0.0017) MultiSource/Applications/JM/lencod/lencod: 1.04% (14.8535 => 15.0084, std. dev.: 0.0094) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.02% (1.8175 => 2.2540, std. dev.: 0.0049) SingleSource/Benchmarks/Misc/mandel-2: 7.52% (1.2998 => 1.3976, std. dev.: 0.0104) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.92% (1.5824 => 1.6761, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9877, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.67% (1.7688 => 1.8338, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: 3.61% (7.4271 => 7.6953, std. dev.: 0.0099) MultiSource/Benchmarks/nbench/nbench: 3.13% (11.2619 => 11.6142, std. dev.: 0.0040) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4553, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: 2.93% (1.9199 => 1.9761, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.85% (8.8259 => 9.0771, std. dev.: 0.0106) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.74% (2.8606 => 2.9391, std. dev.: 0.0026) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.58% (7.9275 => 8.1324, std. dev.: 0.0086) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.61% (0.8273 => 0.8406, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.48% (1.4298 => 1.4510, std. dev.: 0.0033) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5088, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.28% (2.0200 => 2.0459, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.20% (1.9433 => 1.9667, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0045) SingleSource/Benchmarks/Misc/flops: 1.11% (9.0760 => 9.1769, std. dev.: 0.0013) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -21.02% (0.4657 => 0.3678, std. dev.: 0.0032) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.19% (0.2670 => 0.2478, std. dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.29% (22.5627 => 21.1439, std. dev.: 0.0088) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.70% (0.3511 => 0.3311, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -4.03% (0.3623 => 0.3477, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.84% (0.3650 => 0.3510, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -3.83% (0.3601 => 0.3463, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -3.80% (0.3578 => 0.3442, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -3.79% (0.3663 => 0.3524, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -3.78% (0.3646 => 0.3508, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: -3.55% (0.3940 => 0.3800, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -3.33% (0.3789 => 0.3663, std. dev.: 0.0029) SingleSource/UnitTests/ObjC/exceptions: -3.32% (0.3914 => 0.3784, std. dev.: 0.0042) SingleSource/UnitTests/ObjC/parameter-passing: -3.12% (0.4003 => 0.3878, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.93% (0.8818 => 0.8560, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/bigfib: -1.90% (0.6250 => 0.6131, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.90% (0.6576 => 0.6451, std. dev.: 0.0012) MultiSource/Applications/lua/lua: -1.06% (3.7467 => 3.7070, std. dev.: 0.0019) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -9.46% (1.2308 => 1.1144, std. dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.16% (1.0460 => 0.9502, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.56% (0.3139 => 0.2933, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9473, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.68% (1.3780 => 1.3135, std. dev.: 0.0039) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0011) SingleSource/Benchmarks/Dhrystone/dry: -3.98% (2.5089 => 2.4090, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.67% (0.3458 => 0.3331, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.62% (1.9762 => 1.9046, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: -2.17% (1.1560 => 1.1309, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -2.02% (6.3560 => 6.2274, std. dev.: 0.0080) MultiSource/Applications/minisat/minisat: -1.90% (9.3358 => 9.1588, std. dev.: 0.0278) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.89% (6.6320 => 6.5064, std. dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: -1.87% (28.2225 => 27.6953, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.73% (20.3410 => 19.9896, std. dev.: 0.0569) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9952, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.41% (3.9173 => 3.8620, std. dev.: 0.0018) MultiSource/Applications/lua/lua: -1.32% (26.5159 => 26.1664, std. dev.: 0.0274) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.33s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue May 8 20:03:15 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 8 May 2012 22:03:15 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120509030315.238BB2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/577?compare_to=576&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 577, Order: 156457, Start Time: 2012-05-09 02:07:25, End Time: 2012-05-09 03:03:54 To: 576, Order: 156449, Start Time: 2012-05-09 00:44:38, End Time: 2012-05-09 01:41:07 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (63 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (786 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.37% (2.0176 => 2.2671, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.42% (0.3130 => 0.3331, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.48% (0.2721 => 0.2843, std. dev.: 0.0028) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.49% (3.9660 => 4.1046, std. dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/hash2: 2.93% (0.4328 => 0.4455, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 2.91% (13.8202 => 14.2227, std. dev.: 0.0069) MultiSource/Benchmarks/nbench/nbench: 2.89% (1.0594 => 1.0900, std. dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.87% (0.5265 => 0.5416, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/football/football: 2.80% (0.8310 => 0.8543, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.77% (0.6959 => 0.7152, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.70% (1.2193 => 1.2522, std. dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.70% (0.9199 => 0.9447, std. dev.: 0.0017) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.46% (1.1364 => 1.1644, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.41% (0.5637 => 0.5773, std. dev.: 0.0018) MultiSource/Applications/lambda-0_1_3/lambda: 2.24% (0.7038 => 0.7196, std. dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 2.20% (16.6129 => 16.9783, std. dev.: 0.0113) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.07% (1.4563 => 1.4865, std. dev.: 0.0030) MultiSource/Applications/siod/siod: 2.00% (2.1791 => 2.2227, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/gs/gs: 1.95% (3.8646 => 3.9398, std. dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.92% (0.5577 => 0.5684, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.85% (0.7460 => 0.7598, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.84% (0.7710 => 0.7852, std. dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (3.2742 => 3.3331, std. dev.: 0.0014) MultiSource/Applications/Burg/burg: 1.76% (1.1061 => 1.1256, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 1.72% (1.3693 => 1.3928, std. dev.: 0.0020) MultiSource/Applications/SIBsim4/SIBsim4: 1.69% (1.2749 => 1.2965, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.68% (1.3245 => 1.3467, std. dev.: 0.0006) MultiSource/Applications/treecc/treecc: 1.65% (1.9270 => 1.9588, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.65% (3.6692 => 3.7296, std. dev.: 0.0061) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.48% (13.2842 => 13.4802, std. dev.: 0.0151) MultiSource/Applications/sqlite3/sqlite3: 1.42% (16.2614 => 16.4926, std. dev.: 0.0164) MultiSource/Applications/JM/lencod/lencod: 1.41% (14.8535 => 15.0624, std. dev.: 0.0132) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.40% (2.1007 => 2.1301, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.38% (1.3813 => 1.4004, std. dev.: 0.0045) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.31% (1.3819 => 1.4000, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.25% (1.5188 => 1.5378, std. dev.: 0.0010) MultiSource/Applications/JM/ldecod/ldecod: 1.17% (6.5754 => 6.6525, std. dev.: 0.0056) MultiSource/Applications/hexxagon/hexxagon: 1.11% (1.2292 => 1.2429, std. dev.: 0.0001) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.20% (1.8175 => 2.2573, std. dev.: 0.0522) SingleSource/Benchmarks/Misc/mandel-2: 7.04% (1.2998 => 1.3913, std. dev.: 0.0130) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.86% (1.5824 => 1.6752, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 3.87% (1.9144 => 1.9884, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.67% (1.7688 => 1.8338, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/salsa20: 3.61% (7.4271 => 7.6949, std. dev.: 0.0014) MultiSource/Benchmarks/nbench/nbench: 3.12% (11.2619 => 11.6137, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-6: 2.99% (1.9199 => 1.9774, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4534, std. dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.83% (8.8259 => 9.0756, std. dev.: 0.0113) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.76% (2.8606 => 2.9396, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.19% (7.9275 => 8.1015, std. dev.: 0.0210) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.60% (0.8273 => 0.8405, std. dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.43% (8.3908 => 8.5111, std. dev.: 0.0009) MultiSource/Applications/lemon/lemon: 1.41% (1.4298 => 1.4499, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.27% (2.0200 => 2.0456, std. dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 1.24% (5.0168 => 5.0789, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2139, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1772, std. dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.11% (1.9433 => 1.9648, std. dev.: 0.0011) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -20.72% (0.4657 => 0.3692, std. dev.: 0.0175) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.04% (0.2670 => 0.2482, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.20% (22.5627 => 21.1637, std. dev.: 0.0087) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.33% (0.3511 => 0.3324, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: -3.48% (0.3623 => 0.3497, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: -3.30% (0.3578 => 0.3460, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.26% (0.3650 => 0.3531, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-2: -3.14% (0.3601 => 0.3488, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -3.08% (0.3663 => 0.3550, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/property: -3.05% (0.3940 => 0.3820, std. dev.: 0.0032) SingleSource/UnitTests/ObjC/exceptions-4: -2.99% (0.3646 => 0.3537, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: -2.86% (0.3914 => 0.3802, std. dev.: 0.0027) SingleSource/UnitTests/ObjC/for-in: -2.85% (0.3789 => 0.3681, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -2.65% (0.4003 => 0.3897, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.60% (0.6576 => 0.6405, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.46% (0.8818 => 0.8601, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/bigfib: -1.68% (0.6250 => 0.6145, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -10.25% (1.2308 => 1.1046, std. dev.: 0.0055) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.66% (0.3139 => 0.2930, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.85% (1.3780 => 1.3111, std. dev.: 0.0065) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9475, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0011) SingleSource/Benchmarks/Dhrystone/dry: -4.07% (2.5089 => 2.4069, std. dev.: 0.0015) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.62% (1.9762 => 1.9046, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -2.17% (6.3560 => 6.2182, std. dev.: 0.0121) SingleSource/Benchmarks/Misc/richards_benchmark: -2.15% (1.1560 => 1.1311, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: -2.01% (9.3358 => 9.1486, std. dev.: 0.0381) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6921, std. dev.: 0.0014) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.88% (6.6320 => 6.5075, std. dev.: 0.0041) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.86% (20.3410 => 19.9629, std. dev.: 0.0604) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9954, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) MultiSource/Applications/lua/lua: -1.32% (26.5159 => 26.1664, std. dev.: 0.0150) SingleSource/Benchmarks/Shootout/heapsort: -1.16% (3.9173 => 3.8719, std. dev.: 0.0028) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.52s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue May 8 21:26:12 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 8 May 2012 23:26:12 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120509042612.903512A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/578?compare_to=577&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 578, Order: 156460, Start Time: 2012-05-09 03:30:23, End Time: 2012-05-09 04:26:52 To: 577, Order: 156457, Start Time: 2012-05-09 02:07:25, End Time: 2012-05-09 03:03:54 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (63 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (786 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.39% (2.0176 => 2.2676, std. dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.49% (0.3130 => 0.3333, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.37% (0.2721 => 0.2840, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.55% (3.9660 => 4.1068, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.02% (0.5265 => 0.5424, std. dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 2.92% (13.8202 => 14.2241, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/hash2: 2.91% (0.4328 => 0.4454, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.87% (0.6959 => 0.7159, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 2.86% (0.8310 => 0.8548, std. dev.: 0.0034) MultiSource/Benchmarks/nbench/nbench: 2.77% (1.0594 => 1.0887, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.67% (1.2193 => 1.2518, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.64% (0.9199 => 0.9442, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.51% (1.1364 => 1.1649, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.29% (0.5637 => 0.5766, std. dev.: 0.0008) MultiSource/Applications/lambda-0_1_3/lambda: 2.27% (0.7038 => 0.7198, std. dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 2.14% (16.6129 => 16.9683, std. dev.: 0.0257) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.11% (1.4563 => 1.4870, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.08% (0.5577 => 0.5693, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 2.03% (3.8646 => 3.9430, std. dev.: 0.0052) MultiSource/Applications/siod/siod: 2.02% (2.1791 => 2.2232, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.02% (1.3245 => 1.3513, std. dev.: 0.0041) MultiSource/Applications/Burg/burg: 1.87% (1.1061 => 1.1268, std. dev.: 0.0062) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.86% (0.7460 => 0.7599, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.85% (0.7710 => 0.7853, std. dev.: 0.0031) MultiSource/Applications/hbd/hbd: 1.84% (1.3693 => 1.3945, std. dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.78% (3.2742 => 3.3324, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.68% (3.6692 => 3.7309, std. dev.: 0.0042) MultiSource/Applications/treecc/treecc: 1.68% (1.9270 => 1.9593, std. dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 1.67% (1.2749 => 1.2962, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.58% (13.2842 => 13.4942, std. dev.: 0.0014) MultiSource/Applications/sqlite3/sqlite3: 1.43% (16.2614 => 16.4940, std. dev.: 0.0065) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.41% (2.1007 => 2.1303, std. dev.: 0.0069) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.35% (1.3819 => 1.4005, std. dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 1.34% (14.8535 => 15.0526, std. dev.: 0.0167) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.29% (1.5188 => 1.5384, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.28% (1.3813 => 1.3990, std. dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 1.15% (1.2292 => 1.2433, std. dev.: 0.0007) MultiSource/Applications/JM/ldecod/ldecod: 1.12% (6.5754 => 6.6492, std. dev.: 0.0225) MultiSource/Benchmarks/Bullet/bullet: 1.02% (33.2944 => 33.6356, std. dev.: 0.0059) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 25.24% (1.8175 => 2.2763, std. dev.: 0.0142) SingleSource/Benchmarks/Misc/mandel-2: 8.40% (1.2998 => 1.4090, std. dev.: 0.0120) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6755, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8142, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.81% (1.9144 => 1.9873, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.67% (1.7688 => 1.8337, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: 3.62% (7.4271 => 7.6959, std. dev.: 0.0078) MultiSource/Benchmarks/nbench/nbench: 3.18% (11.2619 => 11.6202, std. dev.: 0.0018) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4539, std. dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.90% (8.8259 => 9.0818, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/flops-6: 2.86% (1.9199 => 1.9749, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.76% (2.8606 => 2.9396, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.21% (7.9275 => 8.1029, std. dev.: 0.0114) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.52% (0.8273 => 0.8399, std. dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5097, std. dev.: 0.0079) MultiSource/Applications/lemon/lemon: 1.36% (1.4298 => 1.4493, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.31% (2.0200 => 2.0464, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.28% (1.9433 => 1.9681, std. dev.: 0.0095) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 1.13% (9.0760 => 9.1789, std. dev.: 0.0007) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -21.15% (0.4657 => 0.3672, std. dev.: 0.0024) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.08% (0.2670 => 0.2481, std. dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.19% (22.5627 => 21.1661, std. dev.: 0.0074) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.33% (0.3511 => 0.3324, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -3.51% (0.3623 => 0.3496, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -3.36% (0.3601 => 0.3480, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -3.33% (0.3663 => 0.3541, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.26% (0.3650 => 0.3531, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -3.24% (0.3578 => 0.3462, std. dev.: 0.0028) SingleSource/UnitTests/ObjC/exceptions-4: -3.24% (0.3646 => 0.3528, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: -3.05% (0.3940 => 0.3820, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: -2.89% (0.3914 => 0.3801, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -2.88% (0.3789 => 0.3680, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -2.67% (0.4003 => 0.3896, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.59% (0.6576 => 0.6406, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.54% (0.8818 => 0.8594, std. dev.: 0.0012) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -10.77% (1.2308 => 1.0982, std. dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.16% (1.0460 => 0.9502, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.56% (0.3139 => 0.2933, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.27% (2.4152 => 2.2637, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9472, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.81% (1.3780 => 1.3117, std. dev.: 0.0029) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -4.03% (2.5089 => 2.4077, std. dev.: 0.0014) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.62% (1.9762 => 1.9046, std. dev.: 0.0085) SingleSource/Benchmarks/Misc/richards_benchmark: -2.16% (1.1560 => 1.1310, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: -2.07% (9.3358 => 9.1430, std. dev.: 0.0163) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.06% (20.3410 => 19.9214, std. dev.: 0.0416) SingleSource/Benchmarks/Shootout/lists: -2.04% (6.3560 => 6.2263, std. dev.: 0.0069) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -2.00% (6.6320 => 6.4994, std. dev.: 0.0062) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6913, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9953, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.32% (3.9173 => 3.8657, std. dev.: 0.0048) MultiSource/Applications/lua/lua: -1.22% (26.5159 => 26.1920, std. dev.: 0.0481) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.09% (3.8887 => 3.8464, std. dev.: 0.0097) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.32s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue May 8 23:04:48 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 9 May 2012 01:04:48 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120509060448.559612A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/579?compare_to=578&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 579, Order: 156462, Start Time: 2012-05-09 05:08:55, End Time: 2012-05-09 06:05:28 To: 578, Order: 156460, Start Time: 2012-05-09 03:30:23, End Time: 2012-05-09 04:26:52 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (62 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (787 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.32% (2.0176 => 2.2661, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.39% (0.3130 => 0.3330, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.41% (0.2721 => 0.2841, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.47% (3.9660 => 4.1038, std. dev.: 0.0023) MultiSource/Applications/SPASS/SPASS: 3.05% (13.8202 => 14.2413, std. dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/hash2: 2.93% (0.4328 => 0.4455, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.91% (0.5265 => 0.5418, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: 2.86% (0.8310 => 0.8548, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.79% (0.9199 => 0.9456, std. dev.: 0.0025) MultiSource/Benchmarks/nbench/nbench: 2.78% (1.0594 => 1.0888, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.77% (0.6959 => 0.7152, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.60% (1.2193 => 1.2510, std. dev.: 0.0027) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.53% (1.1364 => 1.1652, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.38% (0.5637 => 0.5771, std. dev.: 0.0038) MultiSource/Applications/lambda-0_1_3/lambda: 2.36% (0.7038 => 0.7204, std. dev.: 0.0011) MultiSource/Applications/kimwitu++/kc: 2.15% (16.6129 => 16.9708, std. dev.: 0.0138) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.10% (1.4563 => 1.4869, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.06% (0.5577 => 0.5692, std. dev.: 0.0012) MultiSource/Applications/siod/siod: 2.05% (2.1791 => 2.2238, std. dev.: 0.0056) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.96% (0.7460 => 0.7606, std. dev.: 0.0045) MultiSource/Benchmarks/MallocBench/gs/gs: 1.92% (3.8646 => 3.9387, std. dev.: 0.0049) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.81% (3.2742 => 3.3334, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.80% (1.3245 => 1.3484, std. dev.: 0.0013) MultiSource/Applications/hbd/hbd: 1.75% (1.3693 => 1.3933, std. dev.: 0.0054) MultiSource/Applications/SIBsim4/SIBsim4: 1.75% (1.2749 => 1.2972, std. dev.: 0.0037) MultiSource/Applications/Burg/burg: 1.72% (1.1061 => 1.1251, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.67% (3.6692 => 3.7304, std. dev.: 0.0031) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.60% (0.7710 => 0.7833, std. dev.: 0.0025) MultiSource/Applications/treecc/treecc: 1.56% (1.9270 => 1.9570, std. dev.: 0.0022) MultiSource/Applications/minisat/minisat: 1.48% (0.6744 => 0.6844, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.47% (13.2842 => 13.4790, std. dev.: 0.0081) MultiSource/Applications/JM/lencod/lencod: 1.44% (14.8535 => 15.0669, std. dev.: 0.0118) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.42% (2.1007 => 2.1306, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.36% (1.3819 => 1.4007, std. dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: 1.35% (16.2614 => 16.4810, std. dev.: 0.0079) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.35% (1.3813 => 1.3999, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.34% (1.5188 => 1.5392, std. dev.: 0.0011) MultiSource/Applications/JM/ldecod/ldecod: 1.13% (6.5754 => 6.6499, std. dev.: 0.0062) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.10% (1.8175 => 2.2555, std. dev.: 0.0127) SingleSource/Benchmarks/Misc/mandel-2: 7.69% (1.2998 => 1.3998, std. dev.: 0.0072) SingleSource/Benchmarks/Misc/flops-4: 6.52% (1.0640 => 1.1334, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6754, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8146, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9878, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.69% (1.7688 => 1.8341, std. dev.: 0.0060) SingleSource/Benchmarks/Misc/salsa20: 3.69% (7.4271 => 7.7008, std. dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 3.17% (8.8259 => 9.1054, std. dev.: 0.0034) MultiSource/Benchmarks/nbench/nbench: 3.14% (11.2619 => 11.6152, std. dev.: 0.0022) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4537, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: 2.86% (1.9199 => 1.9748, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9393, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.39% (7.9275 => 8.1169, std. dev.: 0.0076) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.58% (0.8273 => 0.8404, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.49% (1.4298 => 1.4511, std. dev.: 0.0016) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5091, std. dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.26% (2.0200 => 2.0454, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.14% (1.9433 => 1.9655, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: 1.13% (9.0760 => 9.1789, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -21.75% (0.4657 => 0.3644, std. dev.: 0.0056) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.04% (0.2670 => 0.2482, std. dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.18% (22.5627 => 21.1693, std. dev.: 0.0122) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.33% (0.3511 => 0.3324, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: -3.39% (0.3623 => 0.3500, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -3.39% (0.3601 => 0.3479, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -3.30% (0.3663 => 0.3542, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -3.24% (0.3578 => 0.3462, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.21% (0.3650 => 0.3533, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-4: -3.18% (0.3646 => 0.3530, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -3.07% (0.3940 => 0.3819, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -2.84% (0.3914 => 0.3803, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -2.80% (0.3789 => 0.3683, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: -2.65% (0.4003 => 0.3897, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.54% (0.6576 => 0.6409, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.48% (0.8818 => 0.8599, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: -1.68% (0.6250 => 0.6145, std. dev.: 0.0005) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -10.20% (1.2308 => 1.1052, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.50% (0.3139 => 0.2935, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9473, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -4.04% (2.5089 => 2.4076, std. dev.: 0.0025) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.73% (0.3458 => 0.3329, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.60% (1.9762 => 1.9051, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.18% (20.3410 => 19.8985, std. dev.: 0.0611) SingleSource/Benchmarks/Misc/richards_benchmark: -2.11% (1.1560 => 1.1316, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.97% (6.3560 => 6.2307, std. dev.: 0.0061) MultiSource/Applications/minisat/minisat: -1.94% (9.3358 => 9.1547, std. dev.: 0.0114) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6909, std. dev.: 0.0014) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.84% (6.6320 => 6.5100, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3444, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9954, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.56% (0.9692 => 0.9541, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.43% (3.9173 => 3.8613, std. dev.: 0.0092) MultiSource/Applications/lua/lua: -1.30% (26.5159 => 26.1708, std. dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.02% (3.8887 => 3.8491, std. dev.: 0.0018) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.25s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed May 9 01:33:14 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 9 May 2012 03:33:14 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120509083314.3524A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/580?compare_to=579&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 580, Order: 156465, Start Time: 2012-05-09 07:37:00, End Time: 2012-05-09 08:33:53 To: 579, Order: 156462, Start Time: 2012-05-09 05:08:55, End Time: 2012-05-09 06:05:28 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (65 on baseline) Performance Improvements: 0 (28 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (795 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.07% (2.0176 => 2.2612, std. dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.68% (0.3130 => 0.3339, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.34% (0.2721 => 0.2839, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.86% (3.9660 => 4.1192, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash2: 3.49% (0.4328 => 0.4479, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.15% (0.5265 => 0.5431, std. dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/football/football: 2.96% (0.8310 => 0.8556, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 2.95% (1.0594 => 1.0906, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.92% (0.6959 => 0.7162, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.82% (0.9199 => 0.9458, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.71% (1.2193 => 1.2524, std. dev.: 0.0034) MultiSource/Applications/hbd/hbd: 2.68% (1.3693 => 1.4060, std. dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/hash: 2.58% (0.4062 => 0.4167, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.56% (1.1364 => 1.1655, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.54% (0.5637 => 0.5780, std. dev.: 0.0025) MultiSource/Applications/lambda-0_1_3/lambda: 2.47% (0.7038 => 0.7212, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.28% (0.5577 => 0.5704, std. dev.: 0.0021) MultiSource/Applications/kimwitu++/kc: 2.20% (16.6129 => 16.9776, std. dev.: 0.0084) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.19% (1.4563 => 1.4882, std. dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.17% (0.4791 => 0.4895, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.11% (0.7710 => 0.7873, std. dev.: 0.0025) MultiSource/Applications/Burg/burg: 2.05% (1.1061 => 1.1288, std. dev.: 0.0034) MultiSource/Benchmarks/MallocBench/gs/gs: 2.04% (3.8646 => 3.9435, std. dev.: 0.0019) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.01% (0.7460 => 0.7610, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.94% (3.2742 => 3.3377, std. dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.87% (3.6692 => 3.7377, std. dev.: 0.0047) MultiSource/Applications/hexxagon/hexxagon: 1.84% (1.2292 => 1.2518, std. dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.83% (1.3245 => 1.3488, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.82% (13.2842 => 13.5264, std. dev.: 0.0090) MultiSource/Applications/sqlite3/sqlite3: 1.71% (16.2614 => 16.5396, std. dev.: 0.0133) MultiSource/Applications/SIBsim4/SIBsim4: 1.69% (1.2749 => 1.2965, std. dev.: 0.0068) MultiSource/Applications/JM/lencod/lencod: 1.66% (14.8535 => 15.1007, std. dev.: 0.0108) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.49% (2.1007 => 2.1319, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.48% (1.9828 => 2.0121, std. dev.: 0.0010) MultiSource/Applications/JM/ldecod/ldecod: 1.43% (6.5754 => 6.6697, std. dev.: 0.0110) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.34% (1.3819 => 1.4004, std. dev.: 0.0013) MultiSource/Benchmarks/Bullet/bullet: 1.32% (33.2944 => 33.7329, std. dev.: 0.0153) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.29% (1.5188 => 1.5384, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.20% (7.2180 => 7.3044, std. dev.: 0.0091) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.32% (1.8175 => 2.2596, std. dev.: 0.0098) SingleSource/Benchmarks/Misc/mandel-2: 7.32% (1.2998 => 1.3950, std. dev.: 0.0089) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.90% (1.5824 => 1.6757, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9879, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.68% (1.7688 => 1.8339, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 3.63% (7.4271 => 7.6970, std. dev.: 0.0030) MultiSource/Benchmarks/nbench/nbench: 3.17% (11.2619 => 11.6187, std. dev.: 0.0031) MultiSource/Applications/hexxagon/hexxagon: 2.98% (12.0921 => 12.4529, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/flops-6: 2.86% (1.9199 => 1.9749, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9394, std. dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.48% (8.8259 => 9.0444, std. dev.: 0.0309) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.27% (7.9275 => 8.1075, std. dev.: 0.0111) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.58% (0.8273 => 0.8404, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: 1.46% (1.9290 => 1.9572, std. dev.: 0.0014) MultiSource/Applications/lemon/lemon: 1.43% (1.4298 => 1.4503, std. dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5100, std. dev.: 0.0011) MultiSource/Benchmarks/Olden/bisort/bisort: 1.29% (0.8239 => 0.8345, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.27% (2.0200 => 2.0456, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 1.14% (5.0168 => 5.0739, std. dev.: 0.0054) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1778, std. dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.10% (1.9433 => 1.9646, std. dev.: 0.0059) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.19% (0.2670 => 0.2478, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.11% (22.5627 => 21.1836, std. dev.: 0.0090) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.41% (0.3511 => 0.3321, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.57% (0.8818 => 0.8591, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.20% (0.6576 => 0.6431, std. dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -10.10% (1.2308 => 1.1065, std. dev.: 0.0067) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.59% (0.3139 => 0.2932, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9473, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.72% (1.3780 => 1.3129, std. dev.: 0.0025) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.99% (2.5089 => 2.4089, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: -3.69% (1.9762 => 1.9033, std. dev.: 0.0036) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.59% (0.3458 => 0.3334, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.13% (20.3410 => 19.9083, std. dev.: 0.0516) SingleSource/Benchmarks/Misc/richards_benchmark: -2.11% (1.1560 => 1.1316, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -2.06% (6.3560 => 6.2248, std. dev.: 0.0051) MultiSource/Applications/minisat/minisat: -2.00% (9.3358 => 9.1494, std. dev.: 0.0053) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.89% (6.6320 => 6.5064, std. dev.: 0.0025) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6915, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9952, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.32% (3.9173 => 3.8655, std. dev.: 0.0061) MultiSource/Applications/lua/lua: -1.18% (26.5159 => 26.2020, std. dev.: 0.0463) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.01% (3.8887 => 3.8494, std. dev.: 0.0036) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.38s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed May 9 02:56:12 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 9 May 2012 04:56:12 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120509095612.9BE912A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/581?compare_to=580&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 581, Order: 156468, Start Time: 2012-05-09 09:00:15, End Time: 2012-05-09 09:56:51 To: 580, Order: 156465, Start Time: 2012-05-09 07:37:00, End Time: 2012-05-09 08:33:53 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (64 on baseline) Performance Improvements: 1 (36 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 891 (788 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -13.25% (0.4325 => 0.3752, std. dev.: 0.0072) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.07% (2.0176 => 2.2611, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.58% (0.3130 => 0.3336, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.34% (0.2721 => 0.2839, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.62% (3.9660 => 4.1094, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.19% (0.5265 => 0.5433, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/hash2: 3.19% (0.4328 => 0.4466, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 2.96% (13.8202 => 14.2294, std. dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C/football/football: 2.94% (0.8310 => 0.8554, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.93% (0.6959 => 0.7163, std. dev.: 0.0014) MultiSource/Benchmarks/nbench/nbench: 2.84% (1.0594 => 1.0895, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.76% (0.9199 => 0.9453, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.73% (1.2193 => 1.2526, std. dev.: 0.0018) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.53% (1.1364 => 1.1651, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.41% (0.5637 => 0.5773, std. dev.: 0.0007) MultiSource/Applications/hbd/hbd: 2.39% (1.3693 => 1.4020, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.27% (1.4563 => 1.4893, std. dev.: 0.0074) MultiSource/Applications/lambda-0_1_3/lambda: 2.26% (0.7038 => 0.7197, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.15% (0.7710 => 0.7876, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.10% (0.7460 => 0.7617, std. dev.: 0.0006) MultiSource/Applications/siod/siod: 2.08% (2.1791 => 2.2244, std. dev.: 0.0107) MultiSource/Applications/kimwitu++/kc: 2.07% (16.6129 => 16.9572, std. dev.: 0.0122) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.06% (0.5577 => 0.5692, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 2.01% (3.8646 => 3.9421, std. dev.: 0.0150) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.87% (3.6692 => 3.7378, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.84% (3.2742 => 3.3346, std. dev.: 0.0054) MultiSource/Applications/Burg/burg: 1.83% (1.1061 => 1.1263, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.82% (1.3245 => 1.3486, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.75% (13.2842 => 13.5164, std. dev.: 0.0272) MultiSource/Applications/SIBsim4/SIBsim4: 1.73% (1.2749 => 1.2970, std. dev.: 0.0016) MultiSource/Applications/treecc/treecc: 1.72% (1.9270 => 1.9601, std. dev.: 0.0015) MultiSource/Applications/JM/lencod/lencod: 1.63% (14.8535 => 15.0951, std. dev.: 0.0165) MultiSource/Applications/hexxagon/hexxagon: 1.52% (1.2292 => 1.2479, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.46% (2.1007 => 2.1314, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 1.44% (16.2614 => 16.4952, std. dev.: 0.0109) MultiSource/Applications/JM/ldecod/ldecod: 1.36% (6.5754 => 6.6650, std. dev.: 0.0116) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.35% (1.5188 => 1.5393, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.34% (1.3813 => 1.3998, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.34% (1.3819 => 1.4004, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.04% (7.2180 => 7.2933, std. dev.: 0.0055) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.1333 => 1.1451, std. dev.: 0.0011) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.29% (1.8175 => 2.2590, std. dev.: 0.0048) SingleSource/Benchmarks/Misc/mandel-2: 7.77% (1.2998 => 1.4008, std. dev.: 0.0066) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.86% (1.5824 => 1.6752, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9877, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: 3.67% (7.4271 => 7.6999, std. dev.: 0.0046) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.62% (1.7688 => 1.8329, std. dev.: 0.0059) MultiSource/Benchmarks/nbench/nbench: 3.17% (11.2619 => 11.6189, std. dev.: 0.0048) MultiSource/Applications/hexxagon/hexxagon: 3.01% (12.0921 => 12.4557, std. dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.89% (8.8259 => 9.0811, std. dev.: 0.0053) SingleSource/Benchmarks/Misc/flops-6: 2.89% (1.9199 => 1.9754, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9392, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.26% (7.9275 => 8.1069, std. dev.: 0.0166) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9600, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 1.60% (0.8273 => 0.8405, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.43% (1.4298 => 1.4502, std. dev.: 0.0006) MultiSource/Benchmarks/NPB-serial/is/is: 1.43% (8.3908 => 8.5104, std. dev.: 0.0060) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.27% (2.0200 => 2.0456, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.22% (1.9433 => 1.9670, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/flops: 1.13% (9.0760 => 9.1785, std. dev.: 0.0005) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -19.43% (0.4657 => 0.3752, std. dev.: 0.0072) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.27% (0.2670 => 0.2476, std. dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.23% (22.5627 => 21.1560, std. dev.: 0.0103) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.44% (0.3511 => 0.3320, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-3: -3.04% (0.3623 => 0.3513, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -2.94% (0.3601 => 0.3495, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -2.90% (0.3650 => 0.3544, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -2.82% (0.3578 => 0.3477, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -2.81% (0.3663 => 0.3560, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -2.77% (0.3646 => 0.3545, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.64% (0.8818 => 0.8585, std. dev.: 0.0049) SingleSource/UnitTests/ObjC/property: -2.56% (0.3940 => 0.3839, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.34% (0.6576 => 0.6422, std. dev.: 0.0009) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -10.77% (1.2308 => 1.0982, std. dev.: 0.0063) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.56% (0.3139 => 0.2933, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.88% (1.3780 => 1.3108, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9473, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -4.05% (2.5089 => 2.4074, std. dev.: 0.0010) MultiSource/Benchmarks/Olden/bh/bh: -3.67% (1.9762 => 1.9036, std. dev.: 0.0112) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.67% (0.3458 => 0.3331, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: -2.16% (1.1560 => 1.1310, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -2.02% (6.3560 => 6.2278, std. dev.: 0.0058) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.93% (6.6320 => 6.5041, std. dev.: 0.0040) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6911, std. dev.: 0.0038) MultiSource/Applications/minisat/minisat: -1.84% (9.3358 => 9.1636, std. dev.: 0.0388) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.65% (20.3410 => 20.0053, std. dev.: 0.0355) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9956, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.34% (3.9173 => 3.8648, std. dev.: 0.0115) MultiSource/Applications/lua/lua: -1.21% (26.5159 => 26.1959, std. dev.: 0.0222) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.02% (3.8887 => 3.8491, std. dev.: 0.0038) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.63s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed May 9 04:19:14 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 9 May 2012 06:19:14 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120509111914.6EC872A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/582?compare_to=581&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 582, Order: 156469, Start Time: 2012-05-09 10:23:10, End Time: 2012-05-09 11:19:54 To: 581, Order: 156468, Start Time: 2012-05-09 09:00:15, End Time: 2012-05-09 09:56:51 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (63 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (791 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.33% (2.0176 => 2.2664, std. dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.13% (0.3130 => 0.3322, std. dev.: 0.0047) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.34% (0.2721 => 0.2839, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.53% (3.9660 => 4.1060, std. dev.: 0.0048) MultiSource/Benchmarks/nbench/nbench: 2.91% (1.0594 => 1.0902, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/football/football: 2.86% (0.8310 => 0.8548, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.83% (0.5265 => 0.5414, std. dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 2.78% (13.8202 => 14.2044, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.76% (1.2193 => 1.2529, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 2.63% (0.4328 => 0.4442, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.62% (0.6959 => 0.7141, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.60% (0.9199 => 0.9438, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.53% (1.1364 => 1.1652, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.36% (0.5637 => 0.5770, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.31% (1.4563 => 1.4899, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.11% (0.4791 => 0.4892, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.01% (3.6692 => 3.7431, std. dev.: 0.0015) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.96% (0.7710 => 0.7861, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.92% (0.5577 => 0.5684, std. dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: 1.80% (1.2749 => 1.2979, std. dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.79% (3.2742 => 3.3328, std. dev.: 0.0024) MultiSource/Applications/lambda-0_1_3/lambda: 1.78% (0.7038 => 0.7163, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.73% (1.3245 => 1.3474, std. dev.: 0.0058) MultiSource/Applications/hbd/hbd: 1.72% (1.3693 => 1.3928, std. dev.: 0.0064) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.70% (0.7460 => 0.7587, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: 1.69% (3.8646 => 3.9298, std. dev.: 0.0133) MultiSource/Applications/Burg/burg: 1.67% (1.1061 => 1.1246, std. dev.: 0.0040) MultiSource/Applications/kimwitu++/kc: 1.61% (16.6129 => 16.8796, std. dev.: 0.0075) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.56% (13.2842 => 13.4919, std. dev.: 0.0168) MultiSource/Applications/JM/lencod/lencod: 1.56% (14.8535 => 15.0857, std. dev.: 0.0173) MultiSource/Applications/siod/siod: 1.54% (2.1791 => 2.2126, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.48% (1.3819 => 1.4023, std. dev.: 0.0028) MultiSource/Applications/treecc/treecc: 1.43% (1.9270 => 1.9545, std. dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: 1.42% (16.2614 => 16.4931, std. dev.: 0.0188) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.35% (1.3813 => 1.4000, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.31% (2.1007 => 2.1283, std. dev.: 0.0010) MultiSource/Applications/JM/ldecod/ldecod: 1.25% (6.5754 => 6.6577, std. dev.: 0.0171) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.22% (1.5188 => 1.5374, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.01% (7.2180 => 7.2912, std. dev.: 0.0072) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.77% (1.8175 => 2.2677, std. dev.: 0.0337) SingleSource/Benchmarks/Misc/mandel-2: 8.15% (1.2998 => 1.4057, std. dev.: 0.0083) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.52% (2.5629 => 2.7299, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6755, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9877, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.67% (1.7688 => 1.8337, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/salsa20: 3.61% (7.4271 => 7.6951, std. dev.: 0.0033) MultiSource/Benchmarks/nbench/nbench: 3.15% (11.2619 => 11.6164, std. dev.: 0.0040) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4538, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: 2.83% (1.9199 => 1.9742, std. dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.79% (8.8259 => 9.0723, std. dev.: 0.0121) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.76% (2.8606 => 2.9396, std. dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.29% (7.9275 => 8.1094, std. dev.: 0.0094) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.55% (0.8273 => 0.8401, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: 1.47% (1.4298 => 1.4508, std. dev.: 0.0009) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5101, std. dev.: 0.0093) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.27% (2.0200 => 2.0456, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0033) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.13% (1.9433 => 1.9652, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1775, std. dev.: 0.0017) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -19.28% (0.4657 => 0.3759, std. dev.: 0.0303) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.93% (0.2670 => 0.2485, std. dev.: 0.0028) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.36% (22.5627 => 21.1284, std. dev.: 0.0017) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.64% (0.3511 => 0.3313, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-3: -2.87% (0.3623 => 0.3519, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: -2.74% (0.3650 => 0.3550, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/property: -2.64% (0.3940 => 0.3836, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.32% (0.8818 => 0.8613, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.17% (0.6576 => 0.6433, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/bigfib: -1.81% (0.6250 => 0.6137, std. dev.: 0.0005) MultiSource/Applications/lua/lua: -1.03% (3.7467 => 3.7082, std. dev.: 0.0129) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -9.74% (1.2308 => 1.1109, std. dev.: 0.0213) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.53% (0.3139 => 0.2934, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2641, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9473, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.51% (1.3780 => 1.3158, std. dev.: 0.0027) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.99% (2.5089 => 2.4089, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.73% (0.3458 => 0.3329, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.62% (1.9762 => 1.9046, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/lists: -2.39% (6.3560 => 6.2040, std. dev.: 0.0101) SingleSource/Benchmarks/Misc/richards_benchmark: -2.12% (1.1560 => 1.1315, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: -2.03% (9.3358 => 9.1459, std. dev.: 0.0434) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.96% (20.3410 => 19.9420, std. dev.: 0.0325) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6918, std. dev.: 0.0017) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.86% (6.6320 => 6.5088, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3446, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9959, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) MultiSource/Applications/lua/lua: -1.47% (26.5159 => 26.1249, std. dev.: 0.0500) SingleSource/Benchmarks/Shootout/heapsort: -1.37% (3.9173 => 3.8635, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.01% (3.8887 => 3.8493, std. dev.: 0.0045) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.12s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed May 9 09:11:36 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 9 May 2012 11:11:36 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120509161136.0CEEA2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/583?compare_to=582&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 583, Order: 156471, Start Time: 2012-05-09 15:15:34, End Time: 2012-05-09 16:12:14 To: 582, Order: 156469, Start Time: 2012-05-09 10:23:10, End Time: 2012-05-09 11:19:54 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (59 on baseline) Performance Improvements: 0 (31 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (798 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.33% (2.0176 => 2.2664, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.26% (0.3130 => 0.3326, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.45% (0.2721 => 0.2842, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.54% (3.9660 => 4.1063, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 2.97% (1.0594 => 1.0909, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/football/football: 2.95% (0.8310 => 0.8555, std. dev.: 0.0020) MultiSource/Applications/SPASS/SPASS: 2.93% (13.8202 => 14.2247, std. dev.: 0.0125) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.81% (0.5265 => 0.5413, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.76% (1.2193 => 1.2530, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.76% (0.6959 => 0.7151, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.63% (0.9199 => 0.9441, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 2.56% (0.4328 => 0.4439, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.53% (1.1364 => 1.1651, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.45% (0.5637 => 0.5775, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.27% (0.7710 => 0.7885, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.12% (1.4563 => 1.4872, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.99% (0.5577 => 0.5688, std. dev.: 0.0019) MultiSource/Applications/lambda-0_1_3/lambda: 1.88% (0.7038 => 0.7170, std. dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: 1.84% (16.6129 => 16.9178, std. dev.: 0.0056) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.79% (3.2742 => 3.3329, std. dev.: 0.0160) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.77% (3.6692 => 3.7342, std. dev.: 0.0092) MultiSource/Benchmarks/MallocBench/gs/gs: 1.76% (3.8646 => 3.9325, std. dev.: 0.0067) MultiSource/Applications/hbd/hbd: 1.75% (1.3693 => 1.3932, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.68% (1.3245 => 1.3468, std. dev.: 0.0012) MultiSource/Applications/JM/lencod/lencod: 1.58% (14.8535 => 15.0882, std. dev.: 0.0055) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.57% (13.2842 => 13.4927, std. dev.: 0.0087) MultiSource/Applications/siod/siod: 1.55% (2.1791 => 2.2129, std. dev.: 0.0061) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.52% (1.3819 => 1.4029, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.48% (1.3813 => 1.4017, std. dev.: 0.0017) MultiSource/Applications/treecc/treecc: 1.46% (1.9270 => 1.9552, std. dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: 1.37% (16.2614 => 16.4834, std. dev.: 0.0090) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.32% (2.1007 => 2.1285, std. dev.: 0.0012) MultiSource/Applications/JM/ldecod/ldecod: 1.27% (6.5754 => 6.6587, std. dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.13% (1.5188 => 1.5359, std. dev.: 0.0010) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.49% (1.8175 => 2.2626, std. dev.: 0.0378) SingleSource/Benchmarks/Misc/mandel-2: 8.39% (1.2998 => 1.4089, std. dev.: 0.0054) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.86% (1.5824 => 1.6751, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9877, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.69% (1.7688 => 1.8340, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/salsa20: 3.59% (7.4271 => 7.6935, std. dev.: 0.0074) MultiSource/Benchmarks/nbench/nbench: 3.11% (11.2619 => 11.6125, std. dev.: 0.0042) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4546, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-6: 2.90% (1.9199 => 1.9755, std. dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.79% (8.8259 => 9.0721, std. dev.: 0.0081) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9393, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.54% (7.9275 => 8.1286, std. dev.: 0.0052) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.60% (0.8273 => 0.8405, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.59% (1.4298 => 1.4525, std. dev.: 0.0024) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5091, std. dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.27% (2.0200 => 2.0456, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.23% (1.9433 => 1.9672, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 1.12% (5.0168 => 5.0730, std. dev.: 0.0104) SingleSource/Benchmarks/Dhrystone/fldry: 1.10% (1.9290 => 1.9502, std. dev.: 0.0047) SingleSource/Benchmarks/Misc/flops: 1.09% (9.0760 => 9.1749, std. dev.: 0.0025) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.93% (0.2670 => 0.2485, std. dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.39% (22.5627 => 21.1210, std. dev.: 0.0245) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.58% (0.3511 => 0.3315, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-3: -2.87% (0.3623 => 0.3519, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -2.77% (0.3650 => 0.3549, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -2.66% (0.3940 => 0.3835, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.39% (0.8818 => 0.8607, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.87% (0.6576 => 0.6453, std. dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/bigfib: -1.81% (0.6250 => 0.6137, std. dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -10.64% (1.2308 => 1.0998, std. dev.: 0.0061) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.56% (0.3139 => 0.2933, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2650, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.90% (1.3780 => 1.3105, std. dev.: 0.0062) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9471, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -4.07% (2.5089 => 2.4069, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.67% (1.9762 => 1.9036, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout/lists: -2.28% (6.3560 => 6.2109, std. dev.: 0.0048) SingleSource/Benchmarks/Misc/richards_benchmark: -2.16% (1.1560 => 1.1310, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.03% (20.3410 => 19.9289, std. dev.: 0.0382) MultiSource/Applications/minisat/minisat: -1.93% (9.3358 => 9.1557, std. dev.: 0.0134) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6925, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.87% (6.6320 => 6.5081, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9957, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.36% (3.9173 => 3.8641, std. dev.: 0.0020) MultiSource/Applications/lua/lua: -1.35% (26.5159 => 26.1589, std. dev.: 0.0315) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.32s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed May 9 10:34:31 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 9 May 2012 12:34:31 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120509173431.87FA02A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/584?compare_to=583&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 584, Order: 156474, Start Time: 2012-05-09 16:38:39, End Time: 2012-05-09 17:35:11 To: 583, Order: 156471, Start Time: 2012-05-09 15:15:34, End Time: 2012-05-09 16:12:14 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (67 on baseline) Performance Improvements: 1 (29 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 891 (792 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -4.36% (0.3898 => 0.3728, std. dev.: 0.0049) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.85% (2.0176 => 2.2768, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.20% (0.3130 => 0.3324, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.34% (0.2721 => 0.2839, std. dev.: 0.0022) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.51% (3.9660 => 4.1051, std. dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/hash2: 3.19% (0.4328 => 0.4466, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 3.00% (0.8310 => 0.8559, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.97% (0.6959 => 0.7166, std. dev.: 0.0017) MultiSource/Benchmarks/nbench/nbench: 2.95% (1.0594 => 1.0906, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.94% (0.5265 => 0.5420, std. dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 2.93% (13.8202 => 14.2245, std. dev.: 0.0168) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.74% (0.9199 => 0.9451, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.74% (1.2193 => 1.2527, std. dev.: 0.0023) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.61% (1.1364 => 1.1661, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.27% (0.5637 => 0.5765, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.26% (0.5577 => 0.5703, std. dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.23% (0.4791 => 0.4898, std. dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 2.20% (16.6129 => 16.9777, std. dev.: 0.0046) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.14% (1.4563 => 1.4875, std. dev.: 0.0017) MultiSource/Applications/lambda-0_1_3/lambda: 1.99% (0.7038 => 0.7178, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.96% (0.7710 => 0.7861, std. dev.: 0.0031) MultiSource/Applications/hbd/hbd: 1.91% (1.3693 => 1.3955, std. dev.: 0.0093) MultiSource/Benchmarks/MallocBench/gs/gs: 1.88% (3.8646 => 3.9372, std. dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.87% (1.3245 => 1.3493, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.85% (13.2842 => 13.5302, std. dev.: 0.0070) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.80% (3.6692 => 3.7352, std. dev.: 0.0025) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.80% (1.3813 => 1.4061, std. dev.: 0.0012) MultiSource/Applications/SIBsim4/SIBsim4: 1.79% (1.2749 => 1.2977, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.77% (0.7460 => 0.7592, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.73% (3.2742 => 3.3309, std. dev.: 0.0010) MultiSource/Applications/siod/siod: 1.73% (2.1791 => 2.2168, std. dev.: 0.0073) MultiSource/Applications/Burg/burg: 1.67% (1.1061 => 1.1246, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 1.62% (1.9270 => 1.9582, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.61% (1.3819 => 1.4041, std. dev.: 0.0016) MultiSource/Applications/sqlite3/sqlite3: 1.60% (16.2614 => 16.5222, std. dev.: 0.0124) MultiSource/Applications/JM/lencod/lencod: 1.60% (14.8535 => 15.0915, std. dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.49% (2.1007 => 2.1321, std. dev.: 0.0016) MultiSource/Applications/hexxagon/hexxagon: 1.35% (1.2292 => 1.2458, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 1.25% (6.5754 => 6.6573, std. dev.: 0.0067) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.23% (1.5188 => 1.5375, std. dev.: 0.0011) MultiSource/Benchmarks/Bullet/bullet: 1.13% (33.2944 => 33.6705, std. dev.: 0.0118) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.03% (7.2180 => 7.2921, std. dev.: 0.0030) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.07% (1.8175 => 2.2549, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/mandel-2: 6.69% (1.2998 => 1.3867, std. dev.: 0.0169) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.89% (1.5824 => 1.6756, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9876, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.68% (1.7688 => 1.8339, std. dev.: 0.0157) SingleSource/Benchmarks/Misc/salsa20: 3.62% (7.4271 => 7.6959, std. dev.: 0.0077) MultiSource/Benchmarks/nbench/nbench: 3.13% (11.2619 => 11.6148, std. dev.: 0.0033) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4547, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: 2.90% (1.9199 => 1.9756, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9394, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.58% (8.8259 => 9.0538, std. dev.: 0.0257) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.27% (7.9275 => 8.1078, std. dev.: 0.0164) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.60% (0.8273 => 0.8405, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.52% (1.4298 => 1.4515, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.50% (8.3908 => 8.5166, std. dev.: 0.0047) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.27% (2.0200 => 2.0457, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bisort/bisort: 1.21% (0.8239 => 0.8339, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 1.14% (9.0760 => 9.1791, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.13% (1.9433 => 1.9652, std. dev.: 0.0080) MultiSource/Benchmarks/sim/sim: 1.02% (5.0168 => 5.0682, std. dev.: 0.0116) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -19.95% (0.4657 => 0.3728, std. dev.: 0.0049) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.37% (0.2670 => 0.2500, std. dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.18% (22.5627 => 21.1690, std. dev.: 0.0146) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.67% (0.3511 => 0.3312, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.47% (0.8818 => 0.8600, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.92% (0.6576 => 0.6450, std. dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -10.86% (1.2308 => 1.0971, std. dev.: 0.0058) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.16% (1.0460 => 0.9502, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.56% (0.3139 => 0.2933, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9471, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.41% (1.3780 => 1.3172, std. dev.: 0.0052) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -4.05% (2.5089 => 2.4074, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.73% (0.3458 => 0.3329, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: -3.67% (1.9762 => 1.9036, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: -2.15% (1.1560 => 1.1312, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -2.07% (6.3560 => 6.2243, std. dev.: 0.0057) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.05% (0.4867 => 0.4767, std. dev.: 0.0014) MultiSource/Applications/minisat/minisat: -1.97% (9.3358 => 9.1521, std. dev.: 0.0310) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6928, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.84% (6.6320 => 6.5099, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9952, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.60% (20.3410 => 20.0155, std. dev.: 0.0282) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.56% (0.9692 => 0.9541, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.48% (3.9173 => 3.8592, std. dev.: 0.0189) MultiSource/Applications/lua/lua: -1.20% (26.5159 => 26.1967, std. dev.: 0.0048) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.96s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed May 9 12:05:11 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 9 May 2012 14:05:11 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120509190511.8D8D42A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/585?compare_to=584&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 585, Order: 156484, Start Time: 2012-05-09 18:09:10, End Time: 2012-05-09 19:05:51 To: 584, Order: 156474, Start Time: 2012-05-09 16:38:39, End Time: 2012-05-09 17:35:11 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (71 on baseline) Performance Improvements: 0 (28 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 891 (789 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 1.67% (1.3867 => 1.4099, std. dev.: 0.0016) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.17% (2.0176 => 2.2833, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.52% (0.3130 => 0.3334, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.48% (0.2721 => 0.2843, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.78% (3.9660 => 4.1158, std. dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/hash2: 3.54% (0.4328 => 0.4481, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.23% (0.5265 => 0.5435, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 3.21% (1.0594 => 1.0934, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/football/football: 3.15% (0.8310 => 0.8572, std. dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 3.09% (13.8202 => 14.2474, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.89% (0.9199 => 0.9465, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.84% (1.2193 => 1.2539, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.83% (0.6959 => 0.7156, std. dev.: 0.0017) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.82% (1.1364 => 1.1684, std. dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.73% (0.5637 => 0.5791, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 2.51% (0.4062 => 0.4164, std. dev.: 0.0030) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.45% (1.4563 => 1.4920, std. dev.: 0.0120) MultiSource/Applications/hbd/hbd: 2.23% (1.3693 => 1.3998, std. dev.: 0.0075) MultiSource/Applications/kimwitu++/kc: 2.13% (16.6129 => 16.9675, std. dev.: 0.0091) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.12% (0.5577 => 0.5695, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.11% (0.7710 => 0.7873, std. dev.: 0.0026) MultiSource/Applications/lambda-0_1_3/lambda: 2.09% (0.7038 => 0.7185, std. dev.: 0.0013) MultiSource/Applications/SIBsim4/SIBsim4: 2.07% (1.2749 => 1.3013, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.05% (3.6692 => 3.7443, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.05% (1.3245 => 1.3516, std. dev.: 0.0085) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.01% (0.7460 => 0.7610, std. dev.: 0.0012) MultiSource/Applications/JM/lencod/lencod: 1.94% (14.8535 => 15.1424, std. dev.: 0.0036) MultiSource/Applications/Burg/burg: 1.90% (1.1061 => 1.1271, std. dev.: 0.0054) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.84% (13.2842 => 13.5288, std. dev.: 0.0190) MultiSource/Benchmarks/MallocBench/gs/gs: 1.83% (3.8646 => 3.9354, std. dev.: 0.0032) MultiSource/Applications/siod/siod: 1.82% (2.1791 => 2.2188, std. dev.: 0.0143) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.81% (3.2742 => 3.3334, std. dev.: 0.0022) MultiSource/Applications/sqlite3/sqlite3: 1.80% (16.2614 => 16.5542, std. dev.: 0.0089) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.78% (0.6283 => 0.6395, std. dev.: 0.0006) MultiSource/Applications/treecc/treecc: 1.74% (1.9270 => 1.9606, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.72% (1.3819 => 1.4057, std. dev.: 0.0033) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.61% (1.3813 => 1.4035, std. dev.: 0.0082) MultiSource/Applications/hexxagon/hexxagon: 1.59% (1.2292 => 1.2488, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: 1.57% (0.6744 => 0.6850, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.53% (2.1007 => 2.1329, std. dev.: 0.0056) MultiSource/Applications/JM/ldecod/ldecod: 1.52% (6.5754 => 6.6755, std. dev.: 0.0135) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.38% (1.5188 => 1.5398, std. dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: 1.35% (33.2944 => 33.7446, std. dev.: 0.0172) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.27% (7.2180 => 7.3097, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.24% (1.9828 => 2.0074, std. dev.: 0.0020) MultiSource/Applications/d/make_dparser: 1.19% (3.1889 => 3.2269, std. dev.: 0.0139) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.08% (4.3801 => 4.4276, std. dev.: 0.0031) MultiSource/Benchmarks/mafft/pairlocalalign: 1.02% (8.4961 => 8.5828, std. dev.: 0.0012) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.36% (1.8175 => 2.2603, std. dev.: 0.0321) SingleSource/Benchmarks/Misc/mandel-2: 8.47% (1.2998 => 1.4099, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6755, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9877, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.66% (1.7688 => 1.8335, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/salsa20: 3.56% (7.4271 => 7.6914, std. dev.: 0.0121) MultiSource/Benchmarks/nbench/nbench: 3.15% (11.2619 => 11.6167, std. dev.: 0.0030) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4551, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: 2.88% (1.9199 => 1.9752, std. dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.81% (8.8259 => 9.0738, std. dev.: 0.0320) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.74% (2.8606 => 2.9391, std. dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.31% (7.9275 => 8.1106, std. dev.: 0.0084) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9601, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.56% (0.8273 => 0.8402, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.51% (1.4298 => 1.4514, std. dev.: 0.0009) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5095, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.29% (2.0200 => 2.0460, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.27% (1.9433 => 1.9680, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 1.13% (9.0760 => 9.1785, std. dev.: 0.0018) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -18.40% (0.4657 => 0.3800, std. dev.: 0.0090) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.89% (0.2670 => 0.2486, std. dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.03% (22.5627 => 21.2031, std. dev.: 0.0061) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.72% (0.3511 => 0.3310, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.19% (0.8818 => 0.8625, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.54% (0.6576 => 0.6475, std. dev.: 0.0013) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -9.77% (1.2308 => 1.1105, std. dev.: 0.0068) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.44% (0.3139 => 0.2937, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9472, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.46% (1.3780 => 1.3166, std. dev.: 0.0123) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.99% (2.5089 => 2.4088, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.67% (0.3458 => 0.3331, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.60% (1.9762 => 1.9050, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/lists: -2.26% (6.3560 => 6.2121, std. dev.: 0.0097) SingleSource/Benchmarks/Misc/richards_benchmark: -2.14% (1.1560 => 1.1313, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: -1.98% (9.3358 => 9.1512, std. dev.: 0.0184) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.91% (6.6320 => 6.5050, std. dev.: 0.0021) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6906, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3446, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.67% (20.3410 => 20.0010, std. dev.: 0.0702) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9951, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.41% (3.9173 => 3.8621, std. dev.: 0.0009) MultiSource/Applications/lua/lua: -1.31% (26.5159 => 26.1673, std. dev.: 0.0372) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.40s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed May 9 13:28:09 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 9 May 2012 15:28:09 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120509202809.C96A42A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/586?compare_to=585&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 586, Order: 156503, Start Time: 2012-05-09 19:32:07, End Time: 2012-05-09 20:28:49 To: 585, Order: 156484, Start Time: 2012-05-09 18:09:10, End Time: 2012-05-09 19:05:51 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (63 on baseline) Performance Improvements: 0 (32 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (793 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.87% (2.0176 => 2.2772, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.36% (0.3130 => 0.3329, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.26% (0.2721 => 0.2837, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.63% (3.9660 => 4.1098, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/hash2: 3.28% (0.4328 => 0.4470, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 3.07% (0.8310 => 0.8565, std. dev.: 0.0054) MultiSource/Benchmarks/nbench/nbench: 3.06% (1.0594 => 1.0918, std. dev.: 0.0019) MultiSource/Applications/SPASS/SPASS: 3.05% (13.8202 => 14.2414, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.95% (0.9199 => 0.9470, std. dev.: 0.0101) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.64% (1.1364 => 1.1664, std. dev.: 0.0020) MultiSource/Applications/kimwitu++/kc: 2.62% (16.6129 => 17.0477, std. dev.: 0.0072) MultiSource/Applications/hbd/hbd: 2.61% (1.3693 => 1.4051, std. dev.: 0.0010) MultiSource/Benchmarks/McCat/05-eks/eks: 2.53% (0.4113 => 0.4217, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 2.51% (0.7038 => 0.7215, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.40% (1.4563 => 1.4913, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.34% (0.4791 => 0.4903, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 2.17% (3.8646 => 3.9484, std. dev.: 0.0089) MultiSource/Applications/siod/siod: 2.16% (2.1791 => 2.2261, std. dev.: 0.0021) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.09% (0.7710 => 0.7871, std. dev.: 0.0017) MultiSource/Applications/Burg/burg: 2.04% (1.1061 => 1.1287, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.89% (3.2742 => 3.3361, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.88% (0.7460 => 0.7600, std. dev.: 0.0008) MultiSource/Applications/SIBsim4/SIBsim4: 1.85% (1.2749 => 1.2985, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.82% (3.6692 => 3.7361, std. dev.: 0.0041) MultiSource/Applications/treecc/treecc: 1.81% (1.9270 => 1.9619, std. dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.77% (2.1007 => 2.1378, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.75% (0.6283 => 0.6393, std. dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 1.75% (16.2614 => 16.5457, std. dev.: 0.0111) MultiSource/Applications/hexxagon/hexxagon: 1.64% (1.2292 => 1.2494, std. dev.: 0.0042) MultiSource/Applications/JM/lencod/lencod: 1.57% (14.8535 => 15.0867, std. dev.: 0.0122) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.54% (13.2842 => 13.4893, std. dev.: 0.0192) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.49% (1.5188 => 1.5414, std. dev.: 0.0015) SingleSource/UnitTests/ObjC++/property-reference: 1.49% (0.7061 => 0.7166, std. dev.: 0.0021) MultiSource/Applications/minisat/minisat: 1.48% (0.6744 => 0.6844, std. dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: 1.38% (33.2944 => 33.7553, std. dev.: 0.0102) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.33% (1.3819 => 1.4003, std. dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.26% (1.9828 => 2.0077, std. dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: 1.20% (6.5754 => 6.6541, std. dev.: 0.0089) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.37% (1.8175 => 2.2605, std. dev.: 0.0177) SingleSource/Benchmarks/Misc/mandel-2: 7.99% (1.2998 => 1.4037, std. dev.: 0.0124) SingleSource/Benchmarks/Misc/flops-4: 6.52% (1.0640 => 1.1334, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.90% (1.5824 => 1.6757, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8143, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9878, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.65% (1.7688 => 1.8334, std. dev.: 0.0054) SingleSource/Benchmarks/Misc/salsa20: 3.50% (7.4271 => 7.6868, std. dev.: 0.0092) MultiSource/Benchmarks/nbench/nbench: 3.14% (11.2619 => 11.6160, std. dev.: 0.0027) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4538, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-6: 2.90% (1.9199 => 1.9755, std. dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.82% (8.8259 => 9.0749, std. dev.: 0.0209) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9392, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.24% (7.9275 => 8.1053, std. dev.: 0.0060) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.55% (0.8273 => 0.8401, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: 1.45% (1.4298 => 1.4505, std. dev.: 0.0023) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5099, std. dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.29% (1.9433 => 1.9683, std. dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.28% (2.0200 => 2.0459, std. dev.: 0.0001) MultiSource/Benchmarks/sim/sim: 1.26% (5.0168 => 5.0801, std. dev.: 0.0078) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0098) SingleSource/Benchmarks/Misc/flops: 1.11% (9.0760 => 9.1768, std. dev.: 0.0027) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -16.88% (0.4657 => 0.3871, std. dev.: 0.0290) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.12% (0.2670 => 0.2480, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.08% (22.5627 => 21.1914, std. dev.: 0.0106) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.95% (0.3511 => 0.3302, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: -2.98% (0.3623 => 0.3515, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -2.89% (0.3601 => 0.3497, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: -2.87% (0.3663 => 0.3558, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -2.79% (0.3650 => 0.3548, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.54% (0.8818 => 0.8594, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.20% (0.6576 => 0.6431, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -10.39% (1.2308 => 1.1029, std. dev.: 0.0063) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.53% (0.3139 => 0.2934, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.17% (1.3780 => 1.3068, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9475, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -4.02% (2.5089 => 2.4080, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.67% (0.3458 => 0.3331, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.64% (1.9762 => 1.9042, std. dev.: 0.0098) SingleSource/Benchmarks/Shootout/lists: -2.22% (6.3560 => 6.2151, std. dev.: 0.0073) SingleSource/Benchmarks/Misc/richards_benchmark: -2.13% (1.1560 => 1.1314, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.00% (20.3410 => 19.9335, std. dev.: 0.0984) MultiSource/Applications/minisat/minisat: -1.91% (9.3358 => 9.1578, std. dev.: 0.0261) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6912, std. dev.: 0.0018) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.88% (6.6320 => 6.5074, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9954, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.56% (0.9692 => 0.9541, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.54% (3.9173 => 3.8570, std. dev.: 0.0086) MultiSource/Applications/lua/lua: -1.33% (26.5159 => 26.1623, std. dev.: 0.0126) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.55s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed May 9 14:51:02 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 9 May 2012 16:51:02 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120509215102.3F3E12A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/587?compare_to=586&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 587, Order: 156507, Start Time: 2012-05-09 20:55:06, End Time: 2012-05-09 21:51:42 To: 586, Order: 156503, Start Time: 2012-05-09 19:32:07, End Time: 2012-05-09 20:28:49 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (71 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (783 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.83% (2.0176 => 2.2765, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.39% (0.3130 => 0.3330, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.15% (0.2721 => 0.2834, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.66% (3.9660 => 4.1110, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/hash2: 3.40% (0.4328 => 0.4475, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 3.12% (0.8310 => 0.8569, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 3.06% (1.0594 => 1.0918, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.06% (0.5265 => 0.5426, std. dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.03% (0.6959 => 0.7170, std. dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: 3.01% (13.8202 => 14.2361, std. dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.87% (0.9199 => 0.9463, std. dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: 2.84% (0.7038 => 0.7238, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.75% (1.2193 => 1.2528, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 2.61% (0.4062 => 0.4168, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.60% (1.1364 => 1.1660, std. dev.: 0.0026) MultiSource/Applications/kimwitu++/kc: 2.60% (16.6129 => 17.0446, std. dev.: 0.0008) MultiSource/Applications/hbd/hbd: 2.56% (1.3693 => 1.4044, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.50% (0.5637 => 0.5778, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.34% (0.4791 => 0.4903, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.27% (1.4563 => 1.4893, std. dev.: 0.0033) MultiSource/Benchmarks/MallocBench/gs/gs: 2.14% (3.8646 => 3.9473, std. dev.: 0.0024) MultiSource/Applications/siod/siod: 2.12% (2.1791 => 2.2253, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.12% (0.5577 => 0.5695, std. dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.06% (1.3245 => 1.3518, std. dev.: 0.0009) MultiSource/Applications/Burg/burg: 2.02% (1.1061 => 1.1284, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.95% (3.2742 => 3.3382, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.92% (0.7460 => 0.7603, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.90% (3.6692 => 3.7388, std. dev.: 0.0047) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.87% (0.7710 => 0.7854, std. dev.: 0.0041) MultiSource/Applications/SIBsim4/SIBsim4: 1.80% (1.2749 => 1.2979, std. dev.: 0.0006) MultiSource/Applications/treecc/treecc: 1.77% (1.9270 => 1.9611, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.77% (0.6283 => 0.6394, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 1.76% (0.7061 => 0.7185, std. dev.: 0.0022) MultiSource/Applications/hexxagon/hexxagon: 1.75% (1.2292 => 1.2507, std. dev.: 0.0022) MultiSource/Applications/minisat/minisat: 1.62% (0.6744 => 0.6853, std. dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 1.60% (16.2614 => 16.5214, std. dev.: 0.0214) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.56% (2.1007 => 2.1334, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.53% (13.2842 => 13.4881, std. dev.: 0.0128) MultiSource/Applications/JM/lencod/lencod: 1.53% (14.8535 => 15.0813, std. dev.: 0.0130) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.40% (1.3819 => 1.4013, std. dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.38% (1.5188 => 1.5398, std. dev.: 0.0068) MultiSource/Benchmarks/Bullet/bullet: 1.37% (33.2944 => 33.7494, std. dev.: 0.0109) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.32% (1.9828 => 2.0090, std. dev.: 0.0018) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.32% (1.3813 => 1.3995, std. dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: 1.19% (6.5754 => 6.6536, std. dev.: 0.0132) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.26% (1.8175 => 2.2584, std. dev.: 0.0049) SingleSource/Benchmarks/Misc/mandel-2: 7.40% (1.2998 => 1.3960, std. dev.: 0.0071) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.90% (1.5824 => 1.6757, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.87% (1.9144 => 1.9884, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: 3.67% (7.4271 => 7.6996, std. dev.: 0.0077) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.64% (1.7688 => 1.8331, std. dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 3.14% (11.2619 => 11.6155, std. dev.: 0.0047) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 3.05% (8.8259 => 9.0954, std. dev.: 0.0140) MultiSource/Applications/hexxagon/hexxagon: 2.98% (12.0921 => 12.4524, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-6: 2.84% (1.9199 => 1.9744, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9392, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.20% (7.9275 => 8.1023, std. dev.: 0.0100) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9600, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 1.60% (0.8273 => 0.8405, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.48% (1.4298 => 1.4510, std. dev.: 0.0031) MultiSource/Benchmarks/llubenchmark/llu: 1.46% (3.7731 => 3.8282, std. dev.: 0.0196) MultiSource/Benchmarks/NPB-serial/is/is: 1.44% (8.3908 => 8.5119, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.28% (2.0200 => 2.0458, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1772, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.11% (1.9433 => 1.9649, std. dev.: 0.0063) MultiSource/Benchmarks/sim/sim: 1.02% (5.0168 => 5.0678, std. dev.: 0.0161) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -19.73% (0.4657 => 0.3738, std. dev.: 0.0089) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.19% (0.2670 => 0.2478, std. dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.03% (22.5627 => 21.2032, std. dev.: 0.0107) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.98% (0.3511 => 0.3301, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: -3.04% (0.3623 => 0.3513, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -2.89% (0.3601 => 0.3497, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -2.87% (0.3663 => 0.3558, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -2.80% (0.3646 => 0.3544, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -2.74% (0.3650 => 0.3550, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.55% (0.8818 => 0.8593, std. dev.: 0.0037) SingleSource/UnitTests/ObjC/property: -2.54% (0.3940 => 0.3840, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.20% (0.6576 => 0.6431, std. dev.: 0.0008) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -10.33% (1.2308 => 1.1036, std. dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.50% (0.3139 => 0.2935, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.24% (1.3780 => 1.3058, std. dev.: 0.0055) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9473, std. dev.: 0.0003) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -4.07% (2.5089 => 2.4068, std. dev.: 0.0014) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.64% (1.9762 => 1.9043, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/lists: -2.19% (6.3560 => 6.2169, std. dev.: 0.0092) SingleSource/Benchmarks/Misc/richards_benchmark: -2.16% (1.1560 => 1.1310, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: -1.97% (9.3358 => 9.1522, std. dev.: 0.0055) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6906, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.86% (6.6320 => 6.5084, std. dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.77% (20.3410 => 19.9812, std. dev.: 0.0382) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9956, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/heapsort: -1.51% (3.9173 => 3.8582, std. dev.: 0.0125) MultiSource/Applications/lua/lua: -1.31% (26.5159 => 26.1676, std. dev.: 0.0197) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.50s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed May 9 16:13:58 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 9 May 2012 18:13:58 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120509231358.BA29A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/588?compare_to=587&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 588, Order: 156515, Start Time: 2012-05-09 22:18:00, End Time: 2012-05-09 23:14:39 To: 587, Order: 156507, Start Time: 2012-05-09 20:55:06, End Time: 2012-05-09 21:51:42 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (67 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (782 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.33% (2.0176 => 2.2866, std. dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.42% (0.3130 => 0.3331, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.34% (0.2721 => 0.2839, std. dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.70% (3.9660 => 4.1129, std. dev.: 0.0033) MultiSource/Applications/SPASS/SPASS: 3.08% (13.8202 => 14.2464, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.06% (0.5265 => 0.5426, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/football/football: 2.89% (0.8310 => 0.8550, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.85% (0.6959 => 0.7157, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/hash2: 2.84% (0.4328 => 0.4451, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.67% (0.9199 => 0.9445, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.61% (1.2193 => 1.2511, std. dev.: 0.0087) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.60% (1.1364 => 1.1660, std. dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 2.47% (16.6129 => 17.0239, std. dev.: 0.0148) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.36% (0.5637 => 0.5770, std. dev.: 0.0025) MultiSource/Applications/lambda-0_1_3/lambda: 2.34% (0.7038 => 0.7203, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.33% (0.5577 => 0.5707, std. dev.: 0.0006) MultiSource/Applications/siod/siod: 2.21% (2.1791 => 2.2273, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.20% (1.4563 => 1.4884, std. dev.: 0.0060) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.17% (0.4791 => 0.4895, std. dev.: 0.0019) MultiSource/Benchmarks/MallocBench/gs/gs: 2.12% (3.8646 => 3.9467, std. dev.: 0.0057) MultiSource/Applications/SIBsim4/SIBsim4: 1.99% (1.2749 => 1.3003, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.89% (0.7460 => 0.7601, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.88% (1.3245 => 1.3494, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 1.87% (1.1061 => 1.1268, std. dev.: 0.0071) MultiSource/Applications/hbd/hbd: 1.87% (1.3693 => 1.3949, std. dev.: 0.0043) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.87% (0.7710 => 0.7854, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.86% (13.2842 => 13.5311, std. dev.: 0.0093) MultiSource/Applications/treecc/treecc: 1.81% (1.9270 => 1.9618, std. dev.: 0.0050) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.79% (3.6692 => 3.7348, std. dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.75% (3.2742 => 3.3316, std. dev.: 0.0017) MultiSource/Applications/sqlite3/sqlite3: 1.61% (16.2614 => 16.5240, std. dev.: 0.0249) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.61% (0.6283 => 0.6384, std. dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 1.55% (14.8535 => 15.0830, std. dev.: 0.0117) MultiSource/Applications/minisat/minisat: 1.51% (0.6744 => 0.6846, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.51% (2.1007 => 2.1324, std. dev.: 0.0063) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.42% (1.3819 => 1.4015, std. dev.: 0.0021) MultiSource/Benchmarks/Bullet/bullet: 1.41% (33.2944 => 33.7651, std. dev.: 0.0226) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.39% (1.3813 => 1.4005, std. dev.: 0.0014) MultiSource/Applications/JM/ldecod/ldecod: 1.28% (6.5754 => 6.6598, std. dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.25% (1.5188 => 1.5378, std. dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 1.20% (1.2292 => 1.2440, std. dev.: 0.0012) MultiSource/Applications/d/make_dparser: 1.03% (3.1889 => 3.2217, std. dev.: 0.0062) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.09% (1.8175 => 2.2554, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/mandel-2: 7.05% (1.2998 => 1.3914, std. dev.: 0.0104) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6755, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.79% (1.9144 => 1.9870, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.70% (1.7688 => 1.8342, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: 3.60% (7.4271 => 7.6944, std. dev.: 0.0082) MultiSource/Benchmarks/nbench/nbench: 3.12% (11.2619 => 11.6129, std. dev.: 0.0035) MultiSource/Applications/hexxagon/hexxagon: 2.98% (12.0921 => 12.4529, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: 2.78% (1.9199 => 1.9733, std. dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.76% (2.8606 => 2.9396, std. dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.67% (8.8259 => 9.0614, std. dev.: 0.0176) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.42% (7.9275 => 8.1192, std. dev.: 0.0179) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.57% (1.4298 => 1.4523, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/ffbench: 1.56% (0.8273 => 0.8402, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5089, std. dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.28% (2.0200 => 2.0459, std. dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 1.21% (5.0168 => 5.0777, std. dev.: 0.0094) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.19% (1.9433 => 1.9664, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1775, std. dev.: 0.0019) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -17.74% (0.4657 => 0.3831, std. dev.: 0.0057) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.67% (0.2670 => 0.2492, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.84% (22.5627 => 21.2441, std. dev.: 0.0042) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.61% (0.3511 => 0.3314, std. dev.: 0.0042) SingleSource/UnitTests/ObjC/exceptions-3: -3.67% (0.3623 => 0.3490, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -3.58% (0.3601 => 0.3472, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -3.55% (0.3578 => 0.3451, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -3.54% (0.3646 => 0.3517, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -3.52% (0.3663 => 0.3534, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.51% (0.3650 => 0.3522, std. dev.: 0.0031) SingleSource/UnitTests/ObjC/property: -3.30% (0.3940 => 0.3810, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -3.12% (0.3914 => 0.3792, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -3.09% (0.3789 => 0.3672, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: -2.85% (0.4003 => 0.3889, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.70% (0.8818 => 0.8580, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.25% (0.6576 => 0.6428, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/bigfib: -1.66% (0.6250 => 0.6146, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -10.48% (1.2308 => 1.1018, std. dev.: 0.0046) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.50% (0.3139 => 0.2935, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.93% (1.3780 => 1.3101, std. dev.: 0.0043) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9473, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -4.04% (2.5089 => 2.4075, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.73% (0.3458 => 0.3329, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.60% (1.9762 => 1.9050, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout/lists: -2.36% (6.3560 => 6.2058, std. dev.: 0.0132) SingleSource/Benchmarks/Misc/richards_benchmark: -2.12% (1.1560 => 1.1315, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.92% (6.6320 => 6.5044, std. dev.: 0.0011) MultiSource/Applications/minisat/minisat: -1.90% (9.3358 => 9.1588, std. dev.: 0.0014) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6909, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.75% (20.3410 => 19.9856, std. dev.: 0.0329) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3446, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9960, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.30% (3.9173 => 3.8665, std. dev.: 0.0018) MultiSource/Applications/lua/lua: -1.12% (26.5159 => 26.2187, std. dev.: 0.0273) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.93s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed May 9 17:36:55 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 9 May 2012 19:36:55 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120510003655.2BE3E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/589?compare_to=588&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 589, Order: 156520, Start Time: 2012-05-09 23:40:58, End Time: 2012-05-10 00:37:35 To: 588, Order: 156515, Start Time: 2012-05-09 22:18:00, End Time: 2012-05-09 23:14:39 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (65 on baseline) Performance Improvements: 0 (38 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (785 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.75% (2.0176 => 2.2749, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.36% (0.3130 => 0.3329, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.34% (0.2721 => 0.2839, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.45% (3.9660 => 4.1030, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 3.21% (0.4328 => 0.4467, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 2.91% (13.8202 => 14.2224, std. dev.: 0.0112) MultiSource/Benchmarks/nbench/nbench: 2.87% (1.0594 => 1.0898, std. dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.87% (0.5265 => 0.5416, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.73% (0.6959 => 0.7149, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/football/football: 2.71% (0.8310 => 0.8535, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.64% (0.9199 => 0.9442, std. dev.: 0.0008) MultiSource/Applications/kimwitu++/kc: 2.52% (16.6129 => 17.0313, std. dev.: 0.0105) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.52% (1.2193 => 1.2500, std. dev.: 0.0090) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.31% (1.1364 => 1.1626, std. dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: 2.17% (0.7038 => 0.7191, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.15% (0.5637 => 0.5758, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 2.14% (0.7061 => 0.7212, std. dev.: 0.0032) MultiSource/Applications/hbd/hbd: 2.13% (1.3693 => 1.3985, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.12% (0.5577 => 0.5695, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.07% (1.4563 => 1.4864, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 2.00% (2.1791 => 2.2226, std. dev.: 0.0023) SingleSource/UnitTests/ObjC++/property-reference-object: 1.99% (0.5818 => 0.5934, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 1.92% (3.8646 => 3.9389, std. dev.: 0.0038) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.87% (0.7710 => 0.7854, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 1.80% (1.1061 => 1.1260, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.75% (1.3245 => 1.3477, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.74% (0.7460 => 0.7590, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.73% (3.6692 => 3.7325, std. dev.: 0.0013) MultiSource/Applications/treecc/treecc: 1.65% (1.9270 => 1.9587, std. dev.: 0.0056) MultiSource/Applications/hexxagon/hexxagon: 1.64% (1.2292 => 1.2494, std. dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: 1.55% (1.2749 => 1.2947, std. dev.: 0.0056) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.53% (13.2842 => 13.4869, std. dev.: 0.0086) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.47% (3.2742 => 3.3222, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.40% (1.9828 => 2.0105, std. dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: 1.38% (33.2944 => 33.7528, std. dev.: 0.0187) MultiSource/Applications/sqlite3/sqlite3: 1.30% (16.2614 => 16.4726, std. dev.: 0.0128) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.29% (2.1007 => 2.1277, std. dev.: 0.0018) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.24% (1.3813 => 1.3984, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.24% (1.3819 => 1.3990, std. dev.: 0.0018) MultiSource/Applications/JM/lencod/lencod: 1.23% (14.8535 => 15.0364, std. dev.: 0.0173) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.15% (1.5188 => 1.5362, std. dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 23.86% (1.8175 => 2.2511, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/mandel-2: 8.00% (1.2998 => 1.4038, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.87% (1.5824 => 1.6753, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8146, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.81% (1.9144 => 1.9874, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 3.70% (7.4271 => 7.7019, std. dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.62% (1.7688 => 1.8329, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 3.15% (11.2619 => 11.6165, std. dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 3.11% (8.8259 => 9.1004, std. dev.: 0.0082) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4548, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-6: 2.88% (1.9199 => 1.9751, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9393, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.25% (7.9275 => 8.1055, std. dev.: 0.0157) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9603, std. dev.: 0.0083) SingleSource/Benchmarks/Misc/ffbench: 1.62% (0.8273 => 0.8407, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.48% (1.4298 => 1.4509, std. dev.: 0.0041) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5081, std. dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.28% (2.0200 => 2.0459, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.18% (1.9433 => 1.9662, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1778, std. dev.: 0.0010) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -18.40% (0.4657 => 0.3800, std. dev.: 0.0086) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.74% (0.2670 => 0.2490, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.16% (22.5627 => 21.1739, std. dev.: 0.0086) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.50% (0.3511 => 0.3318, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions-3: -3.28% (0.3623 => 0.3504, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: -3.22% (0.3601 => 0.3485, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.21% (0.3650 => 0.3533, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: -3.13% (0.3578 => 0.3466, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -3.07% (0.3646 => 0.3534, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -3.03% (0.3663 => 0.3552, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.03% (0.8818 => 0.8551, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/property: -2.82% (0.3940 => 0.3829, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -2.63% (0.3914 => 0.3811, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -2.55% (0.4003 => 0.3901, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.92% (0.6576 => 0.6450, std. dev.: 0.0010) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -10.59% (1.2308 => 1.1004, std. dev.: 0.0348) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.56% (0.3139 => 0.2933, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.85% (1.3780 => 1.3111, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9474, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -4.02% (2.5089 => 2.4080, std. dev.: 0.0011) MultiSource/Benchmarks/Olden/bh/bh: -3.68% (1.9762 => 1.9035, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.59% (0.3458 => 0.3334, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -2.12% (6.3560 => 6.2215, std. dev.: 0.0040) SingleSource/Benchmarks/Misc/richards_benchmark: -2.10% (1.1560 => 1.1317, std. dev.: 0.0012) MultiSource/Applications/minisat/minisat: -2.06% (9.3358 => 9.1438, std. dev.: 0.0150) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6912, std. dev.: 0.0014) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.80% (6.6320 => 6.5125, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.78% (20.3410 => 19.9799, std. dev.: 0.0309) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3446, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9954, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.39% (3.9173 => 3.8628, std. dev.: 0.0050) MultiSource/Applications/lua/lua: -1.15% (26.5159 => 26.2099, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.06% (3.8887 => 3.8474, std. dev.: 0.0099) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.82s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed May 9 18:59:54 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 9 May 2012 20:59:54 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120510015954.DFBF72A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/590?compare_to=589&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 590, Order: 156522, Start Time: 2012-05-10 01:04:02, End Time: 2012-05-10 02:00:35 To: 589, Order: 156520, Start Time: 2012-05-09 23:40:58, End Time: 2012-05-10 00:37:35 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (67 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (784 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.73% (2.0176 => 2.2745, std. dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.29% (0.3130 => 0.3327, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.15% (0.2721 => 0.2834, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.44% (3.9660 => 4.1023, std. dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/hash2: 3.26% (0.4328 => 0.4469, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.83% (0.5265 => 0.5414, std. dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 2.83% (13.8202 => 14.2110, std. dev.: 0.0112) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.76% (0.6959 => 0.7151, std. dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 2.70% (1.0594 => 1.0880, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 2.60% (0.8310 => 0.8526, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.50% (0.9199 => 0.9429, std. dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: 2.50% (16.6129 => 17.0276, std. dev.: 0.0069) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.46% (1.1364 => 1.1644, std. dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/hash: 2.46% (0.4062 => 0.4162, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.46% (1.2193 => 1.2493, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.19% (1.4563 => 1.4882, std. dev.: 0.0066) MultiSource/Applications/lambda-0_1_3/lambda: 2.19% (0.7038 => 0.7192, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 2.18% (1.3693 => 1.3992, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.15% (0.5577 => 0.5697, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.11% (0.5637 => 0.5756, std. dev.: 0.0033) SingleSource/UnitTests/ObjC++/property-reference: 2.07% (0.7061 => 0.7207, std. dev.: 0.0018) SingleSource/UnitTests/ObjC++/property-reference-object: 1.99% (0.5818 => 0.5934, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 1.88% (3.8646 => 3.9373, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 1.76% (0.5748 => 0.5849, std. dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 1.70% (1.2292 => 1.2501, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.65% (1.3245 => 1.3463, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.64% (0.7460 => 0.7582, std. dev.: 0.0007) MultiSource/Applications/Burg/burg: 1.56% (1.1061 => 1.1233, std. dev.: 0.0036) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.54% (13.2842 => 13.4888, std. dev.: 0.0061) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.53% (3.2742 => 3.3244, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.53% (0.7710 => 0.7828, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.53% (3.6692 => 3.7252, std. dev.: 0.0043) MultiSource/Applications/treecc/treecc: 1.53% (1.9270 => 1.9564, std. dev.: 0.0006) MultiSource/Applications/SIBsim4/SIBsim4: 1.48% (1.2749 => 1.2938, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.37% (2.1007 => 2.1295, std. dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.33% (1.9828 => 2.0092, std. dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: 1.32% (16.2614 => 16.4767, std. dev.: 0.0141) MultiSource/Benchmarks/Bullet/bullet: 1.32% (33.2944 => 33.7332, std. dev.: 0.0215) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.24% (1.3819 => 1.3991, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.22% (1.5188 => 1.5374, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.21% (1.3813 => 1.3980, std. dev.: 0.0044) MultiSource/Applications/JM/lencod/lencod: 1.20% (14.8535 => 15.0321, std. dev.: 0.0168) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.79% (1.8175 => 2.2681, std. dev.: 0.0339) SingleSource/Benchmarks/Misc/mandel-2: 6.98% (1.2998 => 1.3905, std. dev.: 0.0166) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.90% (1.5824 => 1.6757, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9881, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.70% (1.7688 => 1.8342, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/salsa20: 3.64% (7.4271 => 7.6975, std. dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 3.12% (11.2619 => 11.6137, std. dev.: 0.0024) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4541, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.94% (8.8259 => 9.0855, std. dev.: 0.0100) SingleSource/Benchmarks/Misc/flops-6: 2.93% (1.9199 => 1.9762, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9392, std. dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.35% (7.9275 => 8.1137, std. dev.: 0.0067) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9601, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/ffbench: 1.60% (0.8273 => 0.8405, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.50% (1.4298 => 1.4512, std. dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5079, std. dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.27% (2.0200 => 2.0456, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1781, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.12% (1.9433 => 1.9651, std. dev.: 0.0016) MultiSource/Benchmarks/sim/sim: 1.12% (5.0168 => 5.0730, std. dev.: 0.0022) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -20.31% (0.4657 => 0.3711, std. dev.: 0.0083) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.78% (0.2670 => 0.2489, std. dev.: 0.0040) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.19% (22.5627 => 21.1658, std. dev.: 0.0107) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.50% (0.3511 => 0.3318, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -3.31% (0.3623 => 0.3503, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.26% (0.3650 => 0.3531, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-2: -3.22% (0.3601 => 0.3485, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -3.19% (0.3578 => 0.3464, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -3.06% (0.3663 => 0.3551, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.03% (0.8818 => 0.8551, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-4: -2.99% (0.3646 => 0.3537, std. dev.: 0.0029) SingleSource/UnitTests/ObjC/property: -2.89% (0.3940 => 0.3826, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -2.71% (0.3914 => 0.3808, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -2.64% (0.3789 => 0.3689, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -2.50% (0.4003 => 0.3903, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.95% (0.6576 => 0.6448, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -9.81% (1.2308 => 1.1100, std. dev.: 0.0050) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.16% (1.0460 => 0.9502, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.50% (0.3139 => 0.2935, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9473, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -3.98% (2.5089 => 2.4091, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.67% (1.9762 => 1.9036, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/lists: -2.21% (6.3560 => 6.2156, std. dev.: 0.0081) SingleSource/Benchmarks/Misc/richards_benchmark: -2.15% (1.1560 => 1.1312, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.04% (20.3410 => 19.9267, std. dev.: 0.0682) MultiSource/Applications/minisat/minisat: -1.94% (9.3358 => 9.1543, std. dev.: 0.0130) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.92% (6.6320 => 6.5047, std. dev.: 0.0068) MultiSource/Benchmarks/mafft/pairlocalalign: -1.89% (28.2225 => 27.6905, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9953, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.56% (0.9692 => 0.9541, std. dev.: 0.0000) MultiSource/Applications/lua/lua: -1.36% (26.5159 => 26.1564, std. dev.: 0.0143) SingleSource/Benchmarks/Shootout/heapsort: -1.28% (3.9173 => 3.8670, std. dev.: 0.0007) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.93s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed May 9 20:22:47 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 9 May 2012 22:22:47 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120510032247.8F6872A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/591?compare_to=590&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 591, Order: 156530, Start Time: 2012-05-10 02:26:52, End Time: 2012-05-10 03:23:27 To: 590, Order: 156522, Start Time: 2012-05-10 01:04:02, End Time: 2012-05-10 02:00:35 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (67 on baseline) Performance Improvements: 0 (33 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (788 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.27% (2.0176 => 2.2854, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.36% (0.3130 => 0.3329, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.48% (0.2721 => 0.2843, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.69% (3.9660 => 4.1123, std. dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/hash2: 3.14% (0.4328 => 0.4464, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.13% (0.5265 => 0.5430, std. dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 3.11% (13.8202 => 14.2503, std. dev.: 0.0125) MultiSource/Benchmarks/nbench/nbench: 3.01% (1.0594 => 1.0913, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/football/football: 2.90% (0.8310 => 0.8551, std. dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.87% (0.6959 => 0.7159, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.80% (0.9199 => 0.9457, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.72% (1.2193 => 1.2525, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.62% (1.1364 => 1.1662, std. dev.: 0.0017) MultiSource/Applications/lambda-0_1_3/lambda: 2.60% (0.7038 => 0.7221, std. dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.59% (0.5637 => 0.5783, std. dev.: 0.0013) MultiSource/Applications/kimwitu++/kc: 2.54% (16.6129 => 17.0347, std. dev.: 0.0222) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.43% (1.4563 => 1.4917, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.30% (0.5577 => 0.5705, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.23% (0.4791 => 0.4898, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 2.14% (1.3693 => 1.3986, std. dev.: 0.0087) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.10% (0.7710 => 0.7872, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/gs/gs: 2.07% (3.8646 => 3.9445, std. dev.: 0.0017) MultiSource/Applications/siod/siod: 1.98% (2.1791 => 2.2223, std. dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.98% (3.6692 => 3.7419, std. dev.: 0.0040) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.94% (0.7460 => 0.7605, std. dev.: 0.0013) MultiSource/Applications/Burg/burg: 1.93% (1.1061 => 1.1275, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.92% (1.3245 => 1.3499, std. dev.: 0.0009) MultiSource/Applications/SIBsim4/SIBsim4: 1.86% (1.2749 => 1.2986, std. dev.: 0.0083) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.79% (13.2842 => 13.5215, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.78% (1.3819 => 1.4065, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.77% (3.2742 => 3.3321, std. dev.: 0.0016) MultiSource/Applications/treecc/treecc: 1.74% (1.9270 => 1.9606, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.67% (0.6283 => 0.6388, std. dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 1.59% (14.8535 => 15.0894, std. dev.: 0.0160) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.56% (1.3813 => 1.4029, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.56% (2.1007 => 2.1335, std. dev.: 0.0060) MultiSource/Applications/minisat/minisat: 1.54% (0.6744 => 0.6848, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 1.48% (16.2614 => 16.5022, std. dev.: 0.0058) MultiSource/Applications/hexxagon/hexxagon: 1.48% (1.2292 => 1.2474, std. dev.: 0.0062) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.36% (1.5188 => 1.5394, std. dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: 1.34% (33.2944 => 33.7394, std. dev.: 0.0099) MultiSource/Applications/JM/ldecod/ldecod: 1.28% (6.5754 => 6.6596, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.01% (1.9828 => 2.0029, std. dev.: 0.0075) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.41% (1.8175 => 2.2612, std. dev.: 0.0509) SingleSource/Benchmarks/Misc/mandel-2: 7.82% (1.2998 => 1.4015, std. dev.: 0.0180) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7298, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.90% (1.5824 => 1.6758, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.80% (1.9144 => 1.9872, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.61% (1.7688 => 1.8326, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: 3.58% (7.4271 => 7.6929, std. dev.: 0.0090) MultiSource/Benchmarks/nbench/nbench: 3.13% (11.2619 => 11.6141, std. dev.: 0.0056) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4536, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-6: 2.83% (1.9199 => 1.9742, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.79% (8.8259 => 9.0723, std. dev.: 0.0082) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9393, std. dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.40% (7.9275 => 8.1181, std. dev.: 0.0132) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/ffbench: 1.62% (0.8273 => 0.8407, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.44% (1.4298 => 1.4504, std. dev.: 0.0017) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5088, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.29% (2.0200 => 2.0461, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.18% (1.9433 => 1.9662, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 1.11% (9.0760 => 9.1763, std. dev.: 0.0013) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -19.26% (0.4657 => 0.3760, std. dev.: 0.0247) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.59% (0.2670 => 0.2494, std. dev.: 0.0034) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.90% (22.5627 => 21.2325, std. dev.: 0.0125) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.35% (0.3511 => 0.3323, std. dev.: 0.0026) SingleSource/UnitTests/ObjC/instance-method-metadata: -2.96% (0.3650 => 0.3542, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -2.89% (0.3601 => 0.3497, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: -2.87% (0.3623 => 0.3519, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: -2.82% (0.3578 => 0.3477, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -2.77% (0.3646 => 0.3545, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: -2.76% (0.3663 => 0.3562, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.45% (0.8818 => 0.8602, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.13% (0.6576 => 0.6436, std. dev.: 0.0011) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -10.90% (1.2308 => 1.0967, std. dev.: 0.0095) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.16% (1.0460 => 0.9502, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.59% (0.3139 => 0.2932, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2642, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.85% (1.3780 => 1.3112, std. dev.: 0.0204) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9472, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.99% (2.5089 => 2.4087, std. dev.: 0.0029) MultiSource/Benchmarks/Olden/bh/bh: -3.67% (1.9762 => 1.9036, std. dev.: 0.0012) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.67% (0.3458 => 0.3331, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.20% (20.3410 => 19.8927, std. dev.: 0.0761) SingleSource/Benchmarks/Shootout/lists: -2.18% (6.3560 => 6.2176, std. dev.: 0.0127) SingleSource/Benchmarks/Misc/richards_benchmark: -2.13% (1.1560 => 1.1314, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.90% (6.6320 => 6.5057, std. dev.: 0.0030) MultiSource/Applications/minisat/minisat: -1.90% (9.3358 => 9.1588, std. dev.: 0.0056) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6908, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9959, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.38% (3.9173 => 3.8631, std. dev.: 0.0004) MultiSource/Applications/lua/lua: -1.17% (26.5159 => 26.2051, std. dev.: 0.0167) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.04s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed May 9 21:45:37 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 9 May 2012 23:45:37 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120510044537.12A9F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/592?compare_to=591&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 592, Order: 156534, Start Time: 2012-05-10 03:49:42, End Time: 2012-05-10 04:46:16 To: 591, Order: 156530, Start Time: 2012-05-10 02:26:52, End Time: 2012-05-10 03:23:27 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (61 on baseline) Performance Improvements: 0 (33 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 891 (794 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/McGill/chomp: 1.33% (1.0967 => 1.1113, std. dev.: 0.0031) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.92% (2.0176 => 2.2782, std. dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.39% (0.3130 => 0.3330, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.48% (0.2721 => 0.2843, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.71% (3.9660 => 4.1132, std. dev.: 0.0089) SingleSource/Benchmarks/Shootout-C++/hash2: 3.12% (0.4328 => 0.4463, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.04% (0.5265 => 0.5425, std. dev.: 0.0019) MultiSource/Applications/SPASS/SPASS: 2.99% (13.8202 => 14.2335, std. dev.: 0.0166) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.95% (0.6959 => 0.7164, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/football/football: 2.80% (0.8310 => 0.8543, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.77% (0.9199 => 0.9454, std. dev.: 0.0017) MultiSource/Benchmarks/nbench/nbench: 2.77% (1.0594 => 1.0887, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.71% (1.2193 => 1.2524, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.58% (1.1364 => 1.1657, std. dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: 2.51% (16.6129 => 17.0295, std. dev.: 0.0120) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.48% (0.5637 => 0.5777, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.24% (0.5577 => 0.5702, std. dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: 2.20% (0.7038 => 0.7193, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 2.16% (3.8646 => 3.9479, std. dev.: 0.0016) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.11% (0.7710 => 0.7873, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.10% (1.4563 => 1.4869, std. dev.: 0.0024) MultiSource/Applications/siod/siod: 2.01% (2.1791 => 2.2230, std. dev.: 0.0020) MultiSource/Applications/Burg/burg: 2.00% (1.1061 => 1.1282, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.93% (1.3245 => 1.3500, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 1.91% (1.3693 => 1.3954, std. dev.: 0.0023) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.90% (0.7460 => 0.7602, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.80% (13.2842 => 13.5229, std. dev.: 0.0042) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.72% (1.3819 => 1.4056, std. dev.: 0.0014) MultiSource/Applications/treecc/treecc: 1.71% (1.9270 => 1.9600, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.69% (3.6692 => 3.7313, std. dev.: 0.0110) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.64% (1.3813 => 1.4039, std. dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.60% (3.2742 => 3.3265, std. dev.: 0.0014) MultiSource/Applications/SIBsim4/SIBsim4: 1.58% (1.2749 => 1.2950, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.53% (2.1007 => 2.1329, std. dev.: 0.0069) MultiSource/Applications/JM/lencod/lencod: 1.41% (14.8535 => 15.0631, std. dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: 1.28% (16.2614 => 16.4690, std. dev.: 0.0069) MultiSource/Applications/JM/ldecod/ldecod: 1.23% (6.5754 => 6.6565, std. dev.: 0.0052) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 23.99% (1.8175 => 2.2536, std. dev.: 0.0165) SingleSource/Benchmarks/Misc/mandel-2: 8.52% (1.2998 => 1.4105, std. dev.: 0.0048) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6755, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8147, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 3.80% (1.9144 => 1.9872, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.68% (1.7688 => 1.8339, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/salsa20: 3.59% (7.4271 => 7.6934, std. dev.: 0.0027) MultiSource/Benchmarks/nbench/nbench: 3.15% (11.2619 => 11.6163, std. dev.: 0.0030) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4547, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.78% (8.8259 => 9.0717, std. dev.: 0.0276) SingleSource/Benchmarks/Misc/flops-6: 2.78% (1.9199 => 1.9732, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9394, std. dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.51% (7.9275 => 8.1261, std. dev.: 0.0042) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ffbench: 1.58% (0.8273 => 0.8404, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5088, std. dev.: 0.0015) MultiSource/Benchmarks/sim/sim: 1.39% (5.0168 => 5.0866, std. dev.: 0.0077) MultiSource/Applications/lemon/lemon: 1.36% (1.4298 => 1.4493, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.28% (2.0200 => 2.0459, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.15% (1.9433 => 1.9656, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 1.15% (9.0760 => 9.1800, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -19.71% (0.4657 => 0.3739, std. dev.: 0.0112) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.13% (22.5627 => 21.1792, std. dev.: 0.0173) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.73% (0.2670 => 0.2517, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.16% (0.3511 => 0.3330, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: -2.93% (0.3623 => 0.3517, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -2.88% (0.3650 => 0.3545, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions-2: -2.83% (0.3601 => 0.3499, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -2.78% (0.3663 => 0.3561, std. dev.: 0.0038) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.46% (0.8818 => 0.8601, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.13% (0.6576 => 0.6436, std. dev.: 0.0006) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -9.71% (1.2308 => 1.1113, std. dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.16% (1.0460 => 0.9502, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.56% (0.3139 => 0.2933, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.04% (1.3780 => 1.3086, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9475, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.96% (2.5089 => 2.4096, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.73% (0.3458 => 0.3329, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -3.63% (1.9762 => 1.9045, std. dev.: 0.0039) SingleSource/Benchmarks/Shootout/lists: -2.41% (6.3560 => 6.2027, std. dev.: 0.0149) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.19% (20.3410 => 19.8947, std. dev.: 0.0688) SingleSource/Benchmarks/Misc/richards_benchmark: -2.13% (1.1560 => 1.1314, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: -1.89% (9.3358 => 9.1591, std. dev.: 0.0048) MultiSource/Benchmarks/mafft/pairlocalalign: -1.89% (28.2225 => 27.6904, std. dev.: 0.0023) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.82% (6.6320 => 6.5110, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9955, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.34% (3.9173 => 3.8647, std. dev.: 0.0010) MultiSource/Applications/lua/lua: -1.18% (26.5159 => 26.2021, std. dev.: 0.0173) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.01% (3.8887 => 3.8495, std. dev.: 0.0042) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.44s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed May 9 23:30:43 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 10 May 2012 01:30:43 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120510063043.5D7F12A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/593?compare_to=592&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 593, Order: 156536, Start Time: 2012-05-10 05:34:49, End Time: 2012-05-10 06:31:23 To: 592, Order: 156534, Start Time: 2012-05-10 03:49:42, End Time: 2012-05-10 04:46:16 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (65 on baseline) Performance Improvements: 0 (29 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 890 (794 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 2.22% (3.7626 => 3.8461, std. dev.: 0.0191) SingleSource/Benchmarks/Misc/lowercase: 1.37% (7.9455 => 8.0545, std. dev.: 0.0156) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.39% (2.0176 => 2.2676, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.07% (0.3130 => 0.3320, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.56% (0.2721 => 0.2845, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.56% (3.9660 => 4.1073, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.00% (0.5265 => 0.5423, std. dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 2.94% (13.8202 => 14.2272, std. dev.: 0.0118) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.87% (0.6959 => 0.7159, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash2: 2.87% (0.4328 => 0.4452, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 2.86% (0.8310 => 0.8548, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 2.84% (1.0594 => 1.0895, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.80% (0.9199 => 0.9457, std. dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.74% (1.2193 => 1.2527, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.50% (1.1364 => 1.1648, std. dev.: 0.0017) MultiSource/Applications/kimwitu++/kc: 2.34% (16.6129 => 17.0013, std. dev.: 0.0108) MultiSource/Benchmarks/MallocBench/gs/gs: 2.30% (3.8646 => 3.9535, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.25% (0.5637 => 0.5764, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.25% (1.4563 => 1.4890, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 2.22% (0.7038 => 0.7194, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.19% (0.5577 => 0.5699, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.17% (0.7710 => 0.7877, std. dev.: 0.0034) MultiSource/Applications/siod/siod: 2.02% (2.1791 => 2.2231, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 1.91% (1.1061 => 1.1272, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.86% (1.3245 => 1.3492, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.86% (0.7460 => 0.7599, std. dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.86% (3.6692 => 3.7374, std. dev.: 0.0020) MultiSource/Applications/treecc/treecc: 1.77% (1.9270 => 1.9611, std. dev.: 0.0091) MultiSource/Applications/hbd/hbd: 1.75% (1.3693 => 1.3933, std. dev.: 0.0048) MultiSource/Applications/SIBsim4/SIBsim4: 1.71% (1.2749 => 1.2967, std. dev.: 0.0066) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.70% (1.3819 => 1.4054, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.67% (13.2842 => 13.5054, std. dev.: 0.0017) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.67% (1.3813 => 1.4043, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.64% (3.2742 => 3.3279, std. dev.: 0.0154) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.56% (2.1007 => 2.1335, std. dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 1.49% (14.8535 => 15.0744, std. dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.26% (1.5188 => 1.5379, std. dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 1.24% (16.2614 => 16.4638, std. dev.: 0.0074) MultiSource/Applications/hexxagon/hexxagon: 1.23% (1.2292 => 1.2443, std. dev.: 0.0010) MultiSource/Applications/JM/ldecod/ldecod: 1.19% (6.5754 => 6.6539, std. dev.: 0.0032) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.01% (4.3801 => 4.4242, std. dev.: 0.0070) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.25% (1.8175 => 2.2583, std. dev.: 0.0515) SingleSource/Benchmarks/Misc/mandel-2: 7.47% (1.2998 => 1.3969, std. dev.: 0.0099) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7298, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.90% (1.5824 => 1.6757, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9877, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 3.70% (7.4271 => 7.7019, std. dev.: 0.0036) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.66% (1.7688 => 1.8336, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 3.10% (11.2619 => 11.6114, std. dev.: 0.0033) MultiSource/Applications/hexxagon/hexxagon: 2.98% (12.0921 => 12.4523, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-6: 2.91% (1.9199 => 1.9757, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9394, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.73% (8.8259 => 9.0672, std. dev.: 0.0156) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.55% (7.9275 => 8.1299, std. dev.: 0.0103) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Benchmarks/llubenchmark/llu: 1.93% (3.7731 => 3.8461, std. dev.: 0.0191) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.60% (0.8273 => 0.8405, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.46% (1.4298 => 1.4507, std. dev.: 0.0029) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5079, std. dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.31% (2.0200 => 2.0464, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.24% (1.9433 => 1.9674, std. dev.: 0.0042) MultiSource/Benchmarks/sim/sim: 1.20% (5.0168 => 5.0768, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 1.10% (9.0760 => 9.1761, std. dev.: 0.0013) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -21.26% (0.4657 => 0.3667, std. dev.: 0.0046) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.33% (0.2670 => 0.2501, std. dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.19% (22.5627 => 21.1652, std. dev.: 0.0135) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.16% (0.3511 => 0.3330, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.28% (0.8818 => 0.8617, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.76% (0.6576 => 0.6460, std. dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/bigfib: -1.70% (0.6250 => 0.6144, std. dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -9.64% (1.2308 => 1.1122, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.56% (0.3139 => 0.2933, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2640, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9472, std. dev.: 0.0005) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.66% (1.3780 => 1.3138, std. dev.: 0.0057) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.99% (2.5089 => 2.4087, std. dev.: 0.0011) MultiSource/Benchmarks/Olden/bh/bh: -3.71% (1.9762 => 1.9029, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -2.21% (6.3560 => 6.2153, std. dev.: 0.0097) SingleSource/Benchmarks/Misc/richards_benchmark: -2.13% (1.1560 => 1.1314, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: -1.97% (9.3358 => 9.1520, std. dev.: 0.0196) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.89% (20.3410 => 19.9566, std. dev.: 0.0447) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.88% (6.6320 => 6.5071, std. dev.: 0.0099) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6924, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9953, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) MultiSource/Applications/lua/lua: -1.35% (26.5159 => 26.1584, std. dev.: 0.0250) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.03% (3.8887 => 3.8486, std. dev.: 0.0143) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.04s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu May 10 06:51:47 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 10 May 2012 08:51:47 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120510135147.37C112A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/594?compare_to=593&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 594, Order: 156539, Start Time: 2012-05-10 12:55:36, End Time: 2012-05-10 13:52:27 To: 593, Order: 156536, Start Time: 2012-05-10 05:34:49, End Time: 2012-05-10 06:31:23 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (63 on baseline) Performance Improvements: 0 (27 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (798 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.43% (2.0176 => 2.2683, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.20% (0.3130 => 0.3324, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.48% (0.2721 => 0.2843, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.54% (3.9660 => 4.1064, std. dev.: 0.0025) MultiSource/Applications/SPASS/SPASS: 3.12% (13.8202 => 14.2519, std. dev.: 0.0113) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.08% (0.5265 => 0.5427, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.05% (0.6959 => 0.7171, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 2.91% (0.4328 => 0.4454, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.86% (1.2193 => 1.2542, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 2.85% (0.8310 => 0.8547, std. dev.: 0.0015) MultiSource/Benchmarks/nbench/nbench: 2.84% (1.0594 => 1.0895, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.77% (0.9199 => 0.9454, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.66% (1.1364 => 1.1666, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.50% (0.5637 => 0.5778, std. dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: 2.38% (16.6129 => 17.0075, std. dev.: 0.0118) MultiSource/Applications/lambda-0_1_3/lambda: 2.33% (0.7038 => 0.7202, std. dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.26% (0.5577 => 0.5703, std. dev.: 0.0016) MultiSource/Benchmarks/MallocBench/gs/gs: 2.18% (3.8646 => 3.9489, std. dev.: 0.0020) MultiSource/Applications/siod/siod: 2.15% (2.1791 => 2.2260, std. dev.: 0.0058) MultiSource/Applications/Burg/burg: 2.05% (1.1061 => 1.1288, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.05% (1.4563 => 1.4861, std. dev.: 0.0026) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.02% (0.7460 => 0.7611, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.96% (1.3245 => 1.3504, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.92% (1.3819 => 1.4085, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.80% (0.7710 => 0.7849, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.78% (3.6692 => 3.7346, std. dev.: 0.0018) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.76% (1.3813 => 1.4056, std. dev.: 0.0012) MultiSource/Applications/SIBsim4/SIBsim4: 1.76% (1.2749 => 1.2973, std. dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.75% (3.2742 => 3.3316, std. dev.: 0.0049) MultiSource/Applications/treecc/treecc: 1.68% (1.9270 => 1.9594, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.64% (13.2842 => 13.5027, std. dev.: 0.0072) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.61% (0.6283 => 0.6384, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.49% (2.1007 => 2.1319, std. dev.: 0.0019) MultiSource/Applications/JM/lencod/lencod: 1.48% (14.8535 => 15.0739, std. dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.36% (1.5188 => 1.5395, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 1.30% (16.2614 => 16.4733, std. dev.: 0.0076) MultiSource/Applications/hexxagon/hexxagon: 1.20% (1.2292 => 1.2440, std. dev.: 0.0031) MultiSource/Applications/JM/ldecod/ldecod: 1.20% (6.5754 => 6.6542, std. dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.01% (7.2180 => 7.2909, std. dev.: 0.0033) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 23.68% (1.8175 => 2.2479, std. dev.: 0.0109) SingleSource/Benchmarks/Misc/mandel-2: 7.62% (1.2998 => 1.3989, std. dev.: 0.0042) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.86% (1.5824 => 1.6751, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8143, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: 3.87% (1.9144 => 1.9884, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: 3.65% (7.4271 => 7.6985, std. dev.: 0.0026) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.61% (1.7688 => 1.8326, std. dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 3.12% (11.2619 => 11.6138, std. dev.: 0.0021) MultiSource/Applications/hexxagon/hexxagon: 2.98% (12.0921 => 12.4526, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-6: 2.81% (1.9199 => 1.9739, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9392, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.51% (8.8259 => 9.0474, std. dev.: 0.0144) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.32% (7.9275 => 8.1112, std. dev.: 0.0184) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0044) MultiSource/Applications/lemon/lemon: 1.54% (1.4298 => 1.4518, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/ffbench: 1.54% (0.8273 => 0.8400, std. dev.: 0.0015) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5089, std. dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.29% (2.0200 => 2.0461, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.24% (1.9433 => 1.9673, std. dev.: 0.0089) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1778, std. dev.: 0.0020) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.33% (0.2670 => 0.2501, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.05% (22.5627 => 21.1980, std. dev.: 0.0059) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.30% (0.3511 => 0.3325, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.29% (0.8818 => 0.8616, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/bigfib: -1.82% (0.6250 => 0.6136, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.64% (0.6576 => 0.6468, std. dev.: 0.0010) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -10.10% (1.2308 => 1.1065, std. dev.: 0.0044) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.16% (1.0460 => 0.9502, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.53% (0.3139 => 0.2934, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9475, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.95% (2.5089 => 2.4097, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -3.66% (1.9762 => 1.9039, std. dev.: 0.0038) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.59% (0.3458 => 0.3334, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -2.19% (6.3560 => 6.2166, std. dev.: 0.0115) SingleSource/Benchmarks/Misc/richards_benchmark: -2.15% (1.1560 => 1.1312, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.08% (20.3410 => 19.9181, std. dev.: 0.0671) MultiSource/Applications/minisat/minisat: -2.04% (9.3358 => 9.1456, std. dev.: 0.0124) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6909, std. dev.: 0.0025) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.82% (6.6320 => 6.5113, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9953, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) MultiSource/Applications/lua/lua: -1.42% (26.5159 => 26.1407, std. dev.: 0.0349) SingleSource/Benchmarks/Shootout/heapsort: -1.27% (3.9173 => 3.8674, std. dev.: 0.0019) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.34s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu May 10 08:14:48 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 10 May 2012 10:14:48 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120510151448.05FF92A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/595?compare_to=594&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 595, Order: 156541, Start Time: 2012-05-10 14:18:46, End Time: 2012-05-10 15:15:28 To: 594, Order: 156539, Start Time: 2012-05-10 12:55:36, End Time: 2012-05-10 13:52:27 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (63 on baseline) Performance Improvements: 0 (29 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (796 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.39% (2.0176 => 2.2676, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.20% (0.3130 => 0.3324, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.48% (0.2721 => 0.2843, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.54% (3.9660 => 4.1063, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.08% (0.5265 => 0.5427, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.08% (0.6959 => 0.7173, std. dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 2.98% (13.8202 => 14.2317, std. dev.: 0.0163) MultiSource/Benchmarks/Prolangs-C/football/football: 2.90% (0.8310 => 0.8551, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 2.89% (0.4328 => 0.4453, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 2.86% (1.0594 => 1.0897, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.77% (0.9199 => 0.9454, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.74% (1.2193 => 1.2527, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.67% (1.1364 => 1.1667, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.38% (0.5637 => 0.5771, std. dev.: 0.0010) MultiSource/Applications/kimwitu++/kc: 2.31% (16.6129 => 16.9964, std. dev.: 0.0103) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.27% (1.4563 => 1.4893, std. dev.: 0.0017) MultiSource/Applications/lambda-0_1_3/lambda: 2.26% (0.7038 => 0.7197, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.21% (0.5577 => 0.5700, std. dev.: 0.0038) MultiSource/Benchmarks/MallocBench/gs/gs: 2.14% (3.8646 => 3.9473, std. dev.: 0.0020) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.05% (0.7710 => 0.7868, std. dev.: 0.0045) MultiSource/Applications/Burg/burg: 1.94% (1.1061 => 1.1276, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 1.93% (2.1791 => 2.2212, std. dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.93% (1.3245 => 1.3500, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.92% (0.7460 => 0.7603, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.89% (1.3813 => 1.4074, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.85% (3.6692 => 3.7371, std. dev.: 0.0042) MultiSource/Applications/hbd/hbd: 1.83% (1.3693 => 1.3943, std. dev.: 0.0059) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.73% (1.3819 => 1.4058, std. dev.: 0.0015) MultiSource/Applications/SIBsim4/SIBsim4: 1.71% (1.2749 => 1.2967, std. dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.68% (3.2742 => 3.3292, std. dev.: 0.0013) MultiSource/Applications/treecc/treecc: 1.68% (1.9270 => 1.9593, std. dev.: 0.0115) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.66% (13.2842 => 13.5046, std. dev.: 0.0049) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.56% (2.1007 => 2.1334, std. dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 1.44% (14.8535 => 15.0675, std. dev.: 0.0093) MultiSource/Applications/sqlite3/sqlite3: 1.41% (16.2614 => 16.4909, std. dev.: 0.0038) MultiSource/Applications/hexxagon/hexxagon: 1.24% (1.2292 => 1.2445, std. dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.20% (1.5188 => 1.5370, std. dev.: 0.0016) MultiSource/Applications/JM/ldecod/ldecod: 1.20% (6.5754 => 6.6540, std. dev.: 0.0052) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.52% (1.8175 => 2.2632, std. dev.: 0.0447) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7298, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.89% (1.5824 => 1.6756, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: 5.70% (1.2998 => 1.3739, std. dev.: 0.0216) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9879, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.66% (1.7688 => 1.8335, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/salsa20: 3.62% (7.4271 => 7.6960, std. dev.: 0.0077) MultiSource/Benchmarks/nbench/nbench: 3.12% (11.2619 => 11.6137, std. dev.: 0.0029) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4542, std. dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.90% (8.8259 => 9.0819, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/flops-6: 2.88% (1.9199 => 1.9751, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.76% (2.8606 => 2.9395, std. dev.: 0.0022) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.38% (7.9275 => 8.1158, std. dev.: 0.0125) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.60% (1.9290 => 1.9598, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/ffbench: 1.60% (0.8273 => 0.8405, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.50% (1.4298 => 1.4513, std. dev.: 0.0047) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5083, std. dev.: 0.0007) MultiSource/Benchmarks/sim/sim: 1.25% (5.0168 => 5.0797, std. dev.: 0.0094) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.24% (2.0200 => 2.0451, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.22% (1.9433 => 1.9671, std. dev.: 0.0086) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.13% (9.0760 => 9.1785, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -18.98% (0.4657 => 0.3773, std. dev.: 0.0294) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.33% (0.2670 => 0.2501, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.07% (22.5627 => 21.1934, std. dev.: 0.0043) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.16% (0.3511 => 0.3330, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.22% (0.8818 => 0.8622, std. dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/bigfib: -1.68% (0.6250 => 0.6145, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.64% (0.6576 => 0.6468, std. dev.: 0.0015) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -10.42% (1.2308 => 1.1026, std. dev.: 0.0065) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.16% (1.0460 => 0.9502, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.56% (0.3139 => 0.2933, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.83% (6.2497 => 5.9476, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.80% (1.3780 => 1.3119, std. dev.: 0.0040) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -4.07% (2.5089 => 2.4069, std. dev.: 0.0048) MultiSource/Benchmarks/Olden/bh/bh: -3.71% (1.9762 => 1.9028, std. dev.: 0.0012) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.59% (0.3458 => 0.3334, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -2.30% (6.3560 => 6.2098, std. dev.: 0.0136) SingleSource/Benchmarks/Misc/richards_benchmark: -2.11% (1.1560 => 1.1316, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.90% (6.6320 => 6.5057, std. dev.: 0.0032) MultiSource/Applications/minisat/minisat: -1.90% (9.3358 => 9.1583, std. dev.: 0.0035) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6918, std. dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.71% (20.3410 => 19.9939, std. dev.: 0.0270) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9954, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) MultiSource/Applications/lua/lua: -1.30% (26.5159 => 26.1724, std. dev.: 0.0252) SingleSource/Benchmarks/Shootout/heapsort: -1.21% (3.9173 => 3.8700, std. dev.: 0.0125) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.44s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu May 10 10:31:17 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 10 May 2012 12:31:17 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120510173117.878BA2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/596?compare_to=595&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 596, Order: 156548, Start Time: 2012-05-10 16:35:14, End Time: 2012-05-10 17:31:58 To: 595, Order: 156541, Start Time: 2012-05-10 14:18:46, End Time: 2012-05-10 15:15:28 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (61 on baseline) Performance Improvements: 0 (30 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 891 (797 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 2.84% (1.3739 => 1.4129, std. dev.: 0.0041) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.54% (2.0176 => 2.2707, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.20% (0.3130 => 0.3324, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.34% (0.2721 => 0.2839, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.62% (3.9660 => 4.1097, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.09% (0.6959 => 0.7174, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.04% (0.5265 => 0.5425, std. dev.: 0.0016) MultiSource/Applications/SPASS/SPASS: 2.90% (13.8202 => 14.2208, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/football/football: 2.86% (0.8310 => 0.8548, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hash2: 2.77% (0.4328 => 0.4448, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 2.73% (1.0594 => 1.0883, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.72% (0.9199 => 0.9449, std. dev.: 0.0020) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.69% (1.1364 => 1.1670, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.62% (1.2193 => 1.2512, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.42% (1.4563 => 1.4915, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.38% (0.5637 => 0.5771, std. dev.: 0.0036) MultiSource/Applications/lambda-0_1_3/lambda: 2.29% (0.7038 => 0.7199, std. dev.: 0.0014) MultiSource/Applications/kimwitu++/kc: 2.25% (16.6129 => 16.9862, std. dev.: 0.0079) MultiSource/Benchmarks/MallocBench/gs/gs: 2.20% (3.8646 => 3.9495, std. dev.: 0.0098) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.13% (0.7710 => 0.7874, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.10% (0.5577 => 0.5694, std. dev.: 0.0009) MultiSource/Applications/siod/siod: 2.07% (2.1791 => 2.2242, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.02% (0.7460 => 0.7611, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.93% (1.3245 => 1.3500, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.80% (13.2842 => 13.5228, std. dev.: 0.0067) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.74% (3.6692 => 3.7331, std. dev.: 0.0031) MultiSource/Applications/treecc/treecc: 1.74% (1.9270 => 1.9605, std. dev.: 0.0058) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.70% (1.3813 => 1.4048, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.70% (1.3819 => 1.4054, std. dev.: 0.0019) MultiSource/Applications/SIBsim4/SIBsim4: 1.69% (1.2749 => 1.2965, std. dev.: 0.0037) MultiSource/Applications/hbd/hbd: 1.65% (1.3693 => 1.3919, std. dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.61% (3.2742 => 3.3270, std. dev.: 0.0023) MultiSource/Applications/JM/lencod/lencod: 1.47% (14.8535 => 15.0724, std. dev.: 0.0169) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.47% (2.1007 => 2.1316, std. dev.: 0.0025) MultiSource/Applications/sqlite3/sqlite3: 1.34% (16.2614 => 16.4797, std. dev.: 0.0101) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.26% (1.5188 => 1.5380, std. dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: 1.20% (6.5754 => 6.6541, std. dev.: 0.0084) MultiSource/Applications/hexxagon/hexxagon: 1.03% (1.2292 => 1.2418, std. dev.: 0.0010) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.23% (1.8175 => 2.2579, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/mandel-2: 8.70% (1.2998 => 1.4129, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.92% (1.5824 => 1.6761, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: 3.86% (1.9144 => 1.9883, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.70% (1.7688 => 1.8343, std. dev.: 0.0053) SingleSource/Benchmarks/Misc/salsa20: 3.60% (7.4271 => 7.6946, std. dev.: 0.0044) MultiSource/Benchmarks/nbench/nbench: 3.14% (11.2619 => 11.6153, std. dev.: 0.0029) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 3.01% (8.8259 => 9.0912, std. dev.: 0.0085) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4545, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: 2.85% (1.9199 => 1.9747, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.76% (2.8606 => 2.9395, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.37% (7.9275 => 8.1157, std. dev.: 0.0134) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.60% (0.8273 => 0.8405, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.41% (1.4298 => 1.4500, std. dev.: 0.0017) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5080, std. dev.: 0.0099) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.30% (2.0200 => 2.0463, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0032) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.15% (1.9433 => 1.9657, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 1.10% (9.0760 => 9.1756, std. dev.: 0.0011) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.33% (0.2670 => 0.2501, std. dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.26% (22.5627 => 21.1507, std. dev.: 0.0068) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.30% (0.3511 => 0.3325, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-3: -2.95% (0.3623 => 0.3516, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -2.82% (0.3650 => 0.3547, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.29% (0.8818 => 0.8616, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: -1.94% (0.6250 => 0.6129, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.57% (0.6576 => 0.6473, std. dev.: 0.0011) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -9.88% (1.2308 => 1.1092, std. dev.: 0.0042) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.16% (1.0460 => 0.9502, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.56% (0.3139 => 0.2933, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.17% (1.3780 => 1.3067, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9474, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0009) SingleSource/Benchmarks/Dhrystone/dry: -4.03% (2.5089 => 2.4077, std. dev.: 0.0011) MultiSource/Benchmarks/Olden/bh/bh: -3.62% (1.9762 => 1.9046, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.59% (0.3458 => 0.3334, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -2.19% (6.3560 => 6.2168, std. dev.: 0.0170) SingleSource/Benchmarks/Misc/richards_benchmark: -2.13% (1.1560 => 1.1314, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: -1.97% (9.3358 => 9.1516, std. dev.: 0.0352) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.92% (6.6320 => 6.5047, std. dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.89% (20.3410 => 19.9566, std. dev.: 0.0170) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6913, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9954, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/heapsort: -1.59% (3.9173 => 3.8552, std. dev.: 0.0070) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) MultiSource/Applications/lua/lua: -1.28% (26.5159 => 26.1774, std. dev.: 0.0126) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.29s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu May 10 11:54:41 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 10 May 2012 13:54:41 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120510185441.AB1402A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/597?compare_to=596&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 597, Order: 156554, Start Time: 2012-05-10 17:58:18, End Time: 2012-05-10 18:55:22 To: 596, Order: 156548, Start Time: 2012-05-10 16:35:14, End Time: 2012-05-10 17:31:58 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (68 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 891 (783 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 1.81% (3.7642 => 3.8324, std. dev.: 0.0167) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.47% (2.0176 => 2.2893, std. dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.49% (0.3130 => 0.3333, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.70% (0.2721 => 0.2849, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.68% (3.9660 => 4.1121, std. dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/football/football: 3.16% (0.8310 => 0.8573, std. dev.: 0.0050) MultiSource/Applications/SPASS/SPASS: 3.11% (13.8202 => 14.2499, std. dev.: 0.0202) MultiSource/Benchmarks/nbench/nbench: 3.06% (1.0594 => 1.0918, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.97% (0.6959 => 0.7166, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.94% (0.5265 => 0.5420, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.87% (0.9199 => 0.9463, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.81% (1.1364 => 1.1683, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.75% (1.2193 => 1.2528, std. dev.: 0.0015) MultiSource/Applications/Burg/burg: 2.58% (1.1061 => 1.1346, std. dev.: 0.0027) MultiSource/Applications/lambda-0_1_3/lambda: 2.57% (0.7038 => 0.7219, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 2.52% (0.4328 => 0.4437, std. dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 2.51% (16.6129 => 17.0299, std. dev.: 0.0174) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.49% (1.4563 => 1.4926, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.48% (0.5637 => 0.5777, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.38% (0.5577 => 0.5710, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.34% (0.4791 => 0.4903, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.22% (0.7710 => 0.7881, std. dev.: 0.0027) MultiSource/Benchmarks/MallocBench/gs/gs: 2.18% (3.8646 => 3.9488, std. dev.: 0.0022) MultiSource/Applications/siod/siod: 2.12% (2.1791 => 2.2254, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.07% (3.6692 => 3.7450, std. dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.98% (1.3245 => 1.3507, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 1.92% (1.3693 => 1.3956, std. dev.: 0.0065) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.91% (3.2742 => 3.3368, std. dev.: 0.0152) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.87% (13.2842 => 13.5332, std. dev.: 0.0066) MultiSource/Applications/SIBsim4/SIBsim4: 1.83% (1.2749 => 1.2982, std. dev.: 0.0019) MultiSource/Applications/treecc/treecc: 1.81% (1.9270 => 1.9619, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.77% (0.7460 => 0.7592, std. dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.73% (0.6283 => 0.6392, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: 1.72% (0.6744 => 0.6860, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.72% (2.1007 => 2.1368, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.65% (1.3819 => 1.4047, std. dev.: 0.0024) MultiSource/Applications/sqlite3/sqlite3: 1.62% (16.2614 => 16.5244, std. dev.: 0.0062) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.61% (1.5188 => 1.5433, std. dev.: 0.0053) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.57% (1.3813 => 1.4030, std. dev.: 0.0013) MultiSource/Applications/JM/lencod/lencod: 1.56% (14.8535 => 15.0849, std. dev.: 0.0062) MultiSource/Applications/JM/ldecod/ldecod: 1.39% (6.5754 => 6.6666, std. dev.: 0.0050) MultiSource/Benchmarks/Bullet/bullet: 1.16% (33.2944 => 33.6815, std. dev.: 0.0167) MultiSource/Applications/d/make_dparser: 1.10% (3.1889 => 3.2241, std. dev.: 0.0015) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 23.99% (1.8175 => 2.2536, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/mandel-2: 7.32% (1.2998 => 1.3950, std. dev.: 0.0095) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7298, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.86% (1.5824 => 1.6752, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9877, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 3.66% (7.4271 => 7.6991, std. dev.: 0.0030) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.60% (1.7688 => 1.8324, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 3.19% (11.2619 => 11.6210, std. dev.: 0.0013) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4548, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-6: 2.94% (1.9199 => 1.9764, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.76% (2.8606 => 2.9396, std. dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.56% (8.8259 => 9.0516, std. dev.: 0.0190) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.30% (7.9275 => 8.1098, std. dev.: 0.0106) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/ffbench: 1.61% (0.8273 => 0.8406, std. dev.: 0.0016) MultiSource/Benchmarks/llubenchmark/llu: 1.57% (3.7731 => 3.8324, std. dev.: 0.0167) MultiSource/Applications/lemon/lemon: 1.48% (1.4298 => 1.4509, std. dev.: 0.0023) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5093, std. dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.28% (2.0200 => 2.0459, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.23% (1.9433 => 1.9672, std. dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 1.20% (5.0168 => 5.0770, std. dev.: 0.0062) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 1.14% (9.0760 => 9.1797, std. dev.: 0.0007) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.55% (0.2670 => 0.2495, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.92% (0.3511 => 0.3303, std. dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.70% (22.5627 => 21.2772, std. dev.: 0.0127) SingleSource/UnitTests/ObjC/exceptions-3: -3.31% (0.3623 => 0.3503, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -3.19% (0.3601 => 0.3486, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.12% (0.3650 => 0.3536, std. dev.: 0.0029) SingleSource/UnitTests/ObjC/synchronized: -3.11% (0.3663 => 0.3549, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-4: -3.10% (0.3646 => 0.3533, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: -3.02% (0.3578 => 0.3470, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/property: -2.87% (0.3940 => 0.3827, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -2.74% (0.3789 => 0.3685, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -2.58% (0.3914 => 0.3813, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.28% (0.8818 => 0.8617, std. dev.: 0.0050) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.67% (0.6576 => 0.6466, std. dev.: 0.0012) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -9.84% (1.2308 => 1.1097, std. dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.16% (1.0460 => 0.9502, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.53% (0.3139 => 0.2934, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.28% (1.3780 => 1.3052, std. dev.: 0.0135) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9475, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -4.01% (2.5089 => 2.4082, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.76% (0.3458 => 0.3328, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -3.64% (1.9762 => 1.9043, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout/lists: -2.26% (6.3560 => 6.2125, std. dev.: 0.0094) SingleSource/Benchmarks/Misc/richards_benchmark: -2.14% (1.1560 => 1.1313, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.05% (20.3410 => 19.9230, std. dev.: 0.0391) MultiSource/Applications/minisat/minisat: -2.02% (9.3358 => 9.1476, std. dev.: 0.0062) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6914, std. dev.: 0.0021) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.88% (6.6320 => 6.5073, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9954, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/heapsort: -1.44% (3.9173 => 3.8609, std. dev.: 0.0062) MultiSource/Applications/lua/lua: -1.16% (26.5159 => 26.2078, std. dev.: 0.0231) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.07% (3.8887 => 3.8470, std. dev.: 0.0086) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.46s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu May 10 13:17:42 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 10 May 2012 15:17:42 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120510201742.C36002A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/598?compare_to=597&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 598, Order: 156555, Start Time: 2012-05-10 19:21:45, End Time: 2012-05-10 20:18:24 To: 597, Order: 156554, Start Time: 2012-05-10 17:58:18, End Time: 2012-05-10 18:55:22 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (68 on baseline) Performance Improvements: 0 (38 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (782 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.50% (2.0176 => 2.2899, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.49% (0.3130 => 0.3333, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.52% (0.2721 => 0.2844, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.80% (3.9660 => 4.1168, std. dev.: 0.0017) MultiSource/Applications/SPASS/SPASS: 3.40% (13.8202 => 14.2902, std. dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.17% (0.5265 => 0.5432, std. dev.: 0.0049) MultiSource/Benchmarks/nbench/nbench: 3.16% (1.0594 => 1.0929, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/football/football: 3.14% (0.8310 => 0.8571, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.03% (0.6959 => 0.7170, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.85% (0.9199 => 0.9461, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.77% (1.1364 => 1.1679, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.76% (1.2193 => 1.2530, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.61% (0.5637 => 0.5784, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.58% (1.4563 => 1.4939, std. dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: 2.53% (16.6129 => 17.0338, std. dev.: 0.0265) MultiSource/Applications/lambda-0_1_3/lambda: 2.49% (0.7038 => 0.7213, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/hash2: 2.47% (0.4328 => 0.4435, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.30% (0.5577 => 0.5705, std. dev.: 0.0014) MultiSource/Applications/siod/siod: 2.27% (2.1791 => 2.2286, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 2.26% (3.8646 => 3.9520, std. dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.23% (0.4791 => 0.4898, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.15% (0.7710 => 0.7876, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.08% (1.3245 => 1.3520, std. dev.: 0.0013) MultiSource/Applications/hbd/hbd: 2.04% (1.3693 => 1.3972, std. dev.: 0.0081) MultiSource/Applications/Burg/burg: 1.99% (1.1061 => 1.1281, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.97% (3.2742 => 3.3388, std. dev.: 0.0156) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.94% (3.6692 => 3.7405, std. dev.: 0.0022) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.93% (0.7460 => 0.7604, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.90% (13.2842 => 13.5370, std. dev.: 0.0025) MultiSource/Applications/treecc/treecc: 1.90% (1.9270 => 1.9636, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.89% (0.6283 => 0.6402, std. dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 1.87% (1.2749 => 1.2987, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.69% (2.1007 => 2.1363, std. dev.: 0.0031) MultiSource/Applications/minisat/minisat: 1.68% (0.6744 => 0.6857, std. dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: 1.63% (16.2614 => 16.5267, std. dev.: 0.0085) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.63% (1.3819 => 1.4044, std. dev.: 0.0016) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.62% (1.3813 => 1.4037, std. dev.: 0.0015) MultiSource/Applications/JM/lencod/lencod: 1.61% (14.8535 => 15.0926, std. dev.: 0.0077) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.55% (1.5188 => 1.5424, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 1.42% (6.5754 => 6.6685, std. dev.: 0.0076) MultiSource/Benchmarks/Bullet/bullet: 1.17% (33.2944 => 33.6824, std. dev.: 0.0165) MultiSource/Applications/d/make_dparser: 1.14% (3.1889 => 3.2254, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.05% (4.3801 => 4.4263, std. dev.: 0.0082) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.34% (1.8175 => 2.2598, std. dev.: 0.0362) SingleSource/Benchmarks/Misc/mandel-2: 8.16% (1.2998 => 1.4059, std. dev.: 0.0051) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7298, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6755, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9882, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.73% (1.7688 => 1.8348, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: 3.58% (7.4271 => 7.6927, std. dev.: 0.0032) MultiSource/Benchmarks/nbench/nbench: 3.12% (11.2619 => 11.6135, std. dev.: 0.0024) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4546, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: 2.90% (1.9199 => 1.9756, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.74% (2.8606 => 2.9391, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.74% (8.8259 => 9.0674, std. dev.: 0.0080) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.27% (7.9275 => 8.1076, std. dev.: 0.0073) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.57% (0.8273 => 0.8403, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: 1.56% (1.9290 => 1.9591, std. dev.: 0.0005) MultiSource/Applications/lemon/lemon: 1.44% (1.4298 => 1.4504, std. dev.: 0.0043) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5092, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.26% (2.0200 => 2.0455, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/bisort/bisort: 1.25% (0.8239 => 0.8342, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.21% (1.9433 => 1.9669, std. dev.: 0.0047) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 1.11% (9.0760 => 9.1770, std. dev.: 0.0012) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -14.95% (0.4657 => 0.3961, std. dev.: 0.0179) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.70% (0.2670 => 0.2491, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.90% (0.3511 => 0.3304, std. dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.69% (22.5627 => 21.2792, std. dev.: 0.0203) SingleSource/UnitTests/ObjC/exceptions-3: -3.28% (0.3623 => 0.3504, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -3.22% (0.3601 => 0.3485, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: -3.16% (0.3578 => 0.3465, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -3.07% (0.3646 => 0.3534, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -2.99% (0.3650 => 0.3541, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/synchronized: -2.98% (0.3663 => 0.3554, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -2.79% (0.3940 => 0.3830, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -2.69% (0.3789 => 0.3687, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -2.55% (0.3914 => 0.3814, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.26% (0.8818 => 0.8619, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.82% (0.6576 => 0.6456, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/bigfib: -1.68% (0.6250 => 0.6145, std. dev.: 0.0005) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -9.87% (1.2308 => 1.1093, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.16% (1.0460 => 0.9502, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.53% (0.3139 => 0.2934, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.15% (1.3780 => 1.3071, std. dev.: 0.0115) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9475, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -4.08% (2.5089 => 2.4065, std. dev.: 0.0043) MultiSource/Benchmarks/Olden/bh/bh: -3.68% (1.9762 => 1.9034, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.59% (0.3458 => 0.3334, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -2.14% (1.1560 => 1.1313, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -2.07% (6.3560 => 6.2242, std. dev.: 0.0042) MultiSource/Applications/minisat/minisat: -1.93% (9.3358 => 9.1553, std. dev.: 0.0110) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6922, std. dev.: 0.0015) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.84% (6.6320 => 6.5102, std. dev.: 0.0030) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.82% (20.3410 => 19.9709, std. dev.: 0.0347) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9951, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.56% (3.9173 => 3.8560, std. dev.: 0.0161) MultiSource/Applications/lua/lua: -1.23% (26.5159 => 26.1889, std. dev.: 0.0291) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.53s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu May 10 14:40:34 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 10 May 2012 16:40:34 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120510214034.1140B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/599?compare_to=598&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 599, Order: 156565, Start Time: 2012-05-10 20:44:42, End Time: 2012-05-10 21:41:15 To: 598, Order: 156555, Start Time: 2012-05-10 19:21:45, End Time: 2012-05-10 20:18:24 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (63 on baseline) Performance Improvements: 0 (29 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (796 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.75% (2.0176 => 2.2748, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.07% (0.3130 => 0.3320, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.12% (0.2721 => 0.2833, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.49% (3.9660 => 4.1044, std. dev.: 0.0107) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.00% (0.5265 => 0.5423, std. dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 2.93% (13.8202 => 14.2249, std. dev.: 0.0115) MultiSource/Benchmarks/nbench/nbench: 2.84% (1.0594 => 1.0895, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/football/football: 2.72% (0.8310 => 0.8536, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 2.70% (0.4328 => 0.4445, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.69% (0.9199 => 0.9446, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.66% (0.6959 => 0.7144, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.52% (1.2193 => 1.2500, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.49% (1.1364 => 1.1647, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.43% (0.5637 => 0.5774, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 2.20% (0.7038 => 0.7193, std. dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 2.07% (16.6129 => 16.9571, std. dev.: 0.0226) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.06% (1.4563 => 1.4863, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.04% (0.5577 => 0.5691, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 1.94% (3.8646 => 3.9394, std. dev.: 0.0032) MultiSource/Applications/Burg/burg: 1.82% (1.1061 => 1.1262, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.79% (0.7710 => 0.7848, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.79% (1.3245 => 1.3482, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.78% (0.7460 => 0.7593, std. dev.: 0.0009) MultiSource/Applications/siod/siod: 1.77% (2.1791 => 2.2177, std. dev.: 0.0065) MultiSource/Applications/SIBsim4/SIBsim4: 1.76% (1.2749 => 1.2974, std. dev.: 0.0001) MultiSource/Applications/treecc/treecc: 1.69% (1.9270 => 1.9595, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.69% (13.2842 => 13.5082, std. dev.: 0.0075) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.66% (0.6283 => 0.6387, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 1.63% (1.3693 => 1.3916, std. dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 1.61% (16.2614 => 16.5232, std. dev.: 0.0055) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.59% (3.6692 => 3.7274, std. dev.: 0.0179) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.37% (1.3813 => 1.4002, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.33% (1.3819 => 1.4003, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.32% (2.1007 => 2.1285, std. dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 1.24% (14.8535 => 15.0383, std. dev.: 0.0074) MultiSource/Applications/hexxagon/hexxagon: 1.19% (1.2292 => 1.2438, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.13% (1.5188 => 1.5360, std. dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 1.07% (6.5754 => 6.6455, std. dev.: 0.0030) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 23.58% (1.8175 => 2.2461, std. dev.: 0.0092) SingleSource/Benchmarks/Misc/mandel-2: 8.75% (1.2998 => 1.4135, std. dev.: 0.0042) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.87% (1.5824 => 1.6753, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9878, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.71% (1.7688 => 1.8345, std. dev.: 0.0057) SingleSource/Benchmarks/Misc/salsa20: 3.68% (7.4271 => 7.7004, std. dev.: 0.0028) MultiSource/Benchmarks/nbench/nbench: 3.12% (11.2619 => 11.6128, std. dev.: 0.0033) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4535, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/flops-6: 2.91% (1.9199 => 1.9757, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9394, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.73% (8.8259 => 9.0670, std. dev.: 0.0181) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.68% (7.9275 => 8.1397, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9603, std. dev.: 0.0083) SingleSource/Benchmarks/Misc/ffbench: 1.62% (0.8273 => 0.8407, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.54% (1.4298 => 1.4518, std. dev.: 0.0011) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5097, std. dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.24% (2.0200 => 2.0451, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 1.17% (5.0168 => 5.0753, std. dev.: 0.0060) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.16% (1.9433 => 1.9658, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1772, std. dev.: 0.0014) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -19.48% (0.4657 => 0.3750, std. dev.: 0.0102) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.15% (0.2670 => 0.2479, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.44% (0.3511 => 0.3285, std. dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.10% (22.5627 => 21.1860, std. dev.: 0.0153) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.14% (0.8818 => 0.8541, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.14% (0.6576 => 0.6435, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: -1.63% (0.6250 => 0.6148, std. dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -9.92% (1.2308 => 1.1087, std. dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.16% (1.0460 => 0.9502, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.50% (0.3139 => 0.2935, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.85% (1.3780 => 1.3111, std. dev.: 0.0083) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9475, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.97% (2.5089 => 2.4092, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.67% (1.9762 => 1.9036, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: -2.16% (1.1560 => 1.1310, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout/lists: -2.15% (6.3560 => 6.2192, std. dev.: 0.0046) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.00% (20.3410 => 19.9343, std. dev.: 0.0388) MultiSource/Applications/minisat/minisat: -1.90% (9.3358 => 9.1583, std. dev.: 0.0125) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6910, std. dev.: 0.0029) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.85% (6.6320 => 6.5090, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9955, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.55% (3.9173 => 3.8564, std. dev.: 0.0030) MultiSource/Applications/lua/lua: -1.37% (26.5159 => 26.1519, std. dev.: 0.0102) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.28s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu May 10 16:03:32 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 10 May 2012 18:03:32 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120510230332.0BA282A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/600?compare_to=599&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 600, Order: 156576, Start Time: 2012-05-10 22:07:35, End Time: 2012-05-10 23:04:13 To: 599, Order: 156565, Start Time: 2012-05-10 20:44:42, End Time: 2012-05-10 21:41:15 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (69 on baseline) Performance Improvements: 0 (28 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (791 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.46% (2.0176 => 2.2891, std. dev.: 0.0152) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.52% (0.3130 => 0.3334, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.45% (0.2721 => 0.2842, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.77% (3.9660 => 4.1157, std. dev.: 0.0047) MultiSource/Applications/SPASS/SPASS: 3.26% (13.8202 => 14.2714, std. dev.: 0.0133) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.17% (0.5265 => 0.5432, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.00% (0.6959 => 0.7168, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/football/football: 2.94% (0.8310 => 0.8554, std. dev.: 0.0014) MultiSource/Benchmarks/nbench/nbench: 2.94% (1.0594 => 1.0905, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.85% (0.9199 => 0.9461, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 2.75% (0.4328 => 0.4447, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.70% (1.2193 => 1.2522, std. dev.: 0.0025) MultiSource/Applications/kimwitu++/kc: 2.69% (16.6129 => 17.0595, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.64% (0.5637 => 0.5786, std. dev.: 0.0017) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.62% (1.1364 => 1.1662, std. dev.: 0.0025) MultiSource/Applications/lambda-0_1_3/lambda: 2.39% (0.7038 => 0.7206, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.36% (1.4563 => 1.4907, std. dev.: 0.0014) MultiSource/Applications/hbd/hbd: 2.35% (1.3693 => 1.4015, std. dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.31% (0.5577 => 0.5706, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.17% (0.7710 => 0.7877, std. dev.: 0.0026) MultiSource/Benchmarks/MallocBench/gs/gs: 2.09% (3.8646 => 3.9455, std. dev.: 0.0033) MultiSource/Applications/siod/siod: 2.07% (2.1791 => 2.2243, std. dev.: 0.0045) MultiSource/Applications/Burg/burg: 2.04% (1.1061 => 1.1287, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.99% (3.6692 => 3.7421, std. dev.: 0.0046) MultiSource/Applications/treecc/treecc: 1.95% (1.9270 => 1.9645, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.93% (13.2842 => 13.5410, std. dev.: 0.0045) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.92% (0.7460 => 0.7603, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.90% (1.3245 => 1.3497, std. dev.: 0.0031) MultiSource/Applications/SIBsim4/SIBsim4: 1.76% (1.2749 => 1.2974, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.74% (1.3819 => 1.4060, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.74% (3.2742 => 3.3313, std. dev.: 0.0134) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.68% (1.3813 => 1.4045, std. dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: 1.62% (16.2614 => 16.5249, std. dev.: 0.0071) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.61% (0.6283 => 0.6384, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: 1.57% (0.6744 => 0.6850, std. dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.57% (2.1007 => 2.1336, std. dev.: 0.0015) SingleSource/UnitTests/ObjC++/property-reference: 1.56% (0.7061 => 0.7171, std. dev.: 0.0019) MultiSource/Applications/JM/lencod/lencod: 1.44% (14.8535 => 15.0671, std. dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.42% (1.5188 => 1.5404, std. dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: 1.34% (1.2292 => 1.2457, std. dev.: 0.0035) MultiSource/Applications/spiff/spiff: 1.33% (0.7506 => 0.7606, std. dev.: 0.0007) MultiSource/Applications/JM/ldecod/ldecod: 1.26% (6.5754 => 6.6583, std. dev.: 0.0095) MultiSource/Benchmarks/Bullet/bullet: 1.20% (33.2944 => 33.6948, std. dev.: 0.0064) MultiSource/Applications/d/make_dparser: 1.10% (3.1889 => 3.2240, std. dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.08% (7.2180 => 7.2958, std. dev.: 0.0025) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.13% (1.8175 => 2.2560, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/mandel-2: 7.52% (1.2998 => 1.3976, std. dev.: 0.0104) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6755, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8146, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9881, std. dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.58% (1.7688 => 1.8322, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/salsa20: 3.47% (7.4271 => 7.6846, std. dev.: 0.0112) MultiSource/Benchmarks/nbench/nbench: 3.13% (11.2619 => 11.6148, std. dev.: 0.0034) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4544, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-6: 2.94% (1.9199 => 1.9764, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9392, std. dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.74% (8.8259 => 9.0675, std. dev.: 0.0134) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.31% (7.9275 => 8.1107, std. dev.: 0.0144) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.61% (0.8273 => 0.8406, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: 1.57% (5.0168 => 5.0956, std. dev.: 0.0031) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5099, std. dev.: 0.0005) MultiSource/Applications/lemon/lemon: 1.41% (1.4298 => 1.4499, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.27% (2.0200 => 2.0457, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1772, std. dev.: 0.0012) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -19.54% (0.4657 => 0.3747, std. dev.: 0.0088) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.33% (0.2670 => 0.2501, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.04% (0.3511 => 0.3299, std. dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.84% (22.5627 => 21.2452, std. dev.: 0.0048) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.04% (0.8818 => 0.8550, std. dev.: 0.0035) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.95% (0.6576 => 0.6448, std. dev.: 0.0012) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -10.23% (1.2308 => 1.1049, std. dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.56% (0.3139 => 0.2933, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.10% (1.3780 => 1.3077, std. dev.: 0.0044) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9474, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -3.99% (2.5089 => 2.4089, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.67% (0.3458 => 0.3331, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.66% (1.9762 => 1.9039, std. dev.: 0.0033) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.22% (20.3410 => 19.8885, std. dev.: 0.0922) SingleSource/Benchmarks/Misc/richards_benchmark: -2.15% (1.1560 => 1.1311, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6907, std. dev.: 0.0024) MultiSource/Applications/minisat/minisat: -1.88% (9.3358 => 9.1600, std. dev.: 0.0021) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.79% (6.6320 => 6.5136, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout/lists: -1.74% (6.3560 => 6.2457, std. dev.: 0.0059) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9951, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) MultiSource/Applications/lua/lua: -1.31% (26.5159 => 26.1698, std. dev.: 0.0085) SingleSource/Benchmarks/Shootout/heapsort: -1.18% (3.9173 => 3.8712, std. dev.: 0.0171) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.27s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu May 10 17:26:40 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 10 May 2012 19:26:40 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120511002640.8FB7C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/601?compare_to=600&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 601, Order: 156582, Start Time: 2012-05-10 23:30:43, End Time: 2012-05-11 00:27:22 To: 600, Order: 156576, Start Time: 2012-05-10 22:07:35, End Time: 2012-05-10 23:04:13 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (58 on baseline) Performance Improvements: 2 (40 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 890 (790 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC++/property-reference: -1.39% (0.7171 => 0.7071, std. dev.: 0.0020) MultiSource/Applications/hbd/hbd: -1.02% (1.4015 => 1.3872, std. dev.: 0.0028) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.46% (2.0176 => 2.2892, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.33% (0.3130 => 0.3328, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.15% (0.2721 => 0.2834, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.67% (3.9660 => 4.1115, std. dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 3.01% (13.8202 => 14.2365, std. dev.: 0.0133) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.98% (0.5265 => 0.5422, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.83% (0.6959 => 0.7156, std. dev.: 0.0037) MultiSource/Benchmarks/nbench/nbench: 2.79% (1.0594 => 1.0890, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/football/football: 2.78% (0.8310 => 0.8541, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.63% (0.9199 => 0.9441, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.47% (1.2193 => 1.2494, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.47% (0.5637 => 0.5776, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.46% (1.1364 => 1.1644, std. dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: 2.45% (16.6129 => 17.0196, std. dev.: 0.0049) MultiSource/Applications/lambda-0_1_3/lambda: 2.27% (0.7038 => 0.7198, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.17% (0.5577 => 0.5698, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.06% (1.4563 => 1.4863, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: 2.04% (3.8646 => 3.9436, std. dev.: 0.0033) MultiSource/Applications/siod/siod: 1.98% (2.1791 => 2.2222, std. dev.: 0.0052) MultiSource/Applications/Burg/burg: 1.93% (1.1061 => 1.1275, std. dev.: 0.0023) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.92% (0.7710 => 0.7858, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.80% (1.3245 => 1.3483, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.73% (13.2842 => 13.5142, std. dev.: 0.0091) MultiSource/Applications/treecc/treecc: 1.70% (1.9270 => 1.9598, std. dev.: 0.0018) MultiSource/Applications/SIBsim4/SIBsim4: 1.69% (1.2749 => 1.2964, std. dev.: 0.0046) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.67% (3.6692 => 3.7306, std. dev.: 0.0022) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.63% (1.3813 => 1.4038, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.60% (1.3819 => 1.4040, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.50% (3.2742 => 3.3232, std. dev.: 0.0138) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.37% (2.1007 => 2.1294, std. dev.: 0.0011) MultiSource/Applications/hbd/hbd: 1.31% (1.3693 => 1.3872, std. dev.: 0.0028) MultiSource/Applications/JM/lencod/lencod: 1.26% (14.8535 => 15.0403, std. dev.: 0.0067) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.25% (1.5188 => 1.5378, std. dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 1.23% (16.2614 => 16.4622, std. dev.: 0.0109) MultiSource/Applications/JM/ldecod/ldecod: 1.04% (6.5754 => 6.6440, std. dev.: 0.0029) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.12% (1.8175 => 2.2559, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/flops-4: 6.52% (1.0640 => 1.1334, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.52% (2.5629 => 2.7299, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.10% (1.2998 => 1.3791, std. dev.: 0.0137) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.87% (1.5824 => 1.6753, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8146, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9877, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.65% (1.7688 => 1.8333, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/salsa20: 3.47% (7.4271 => 7.6850, std. dev.: 0.0104) MultiSource/Benchmarks/nbench/nbench: 3.12% (11.2619 => 11.6136, std. dev.: 0.0032) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4534, std. dev.: 0.0024) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.93% (8.8259 => 9.0842, std. dev.: 0.0126) SingleSource/Benchmarks/Misc/flops-6: 2.86% (1.9199 => 1.9748, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.76% (2.8606 => 2.9395, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.30% (7.9275 => 8.1097, std. dev.: 0.0191) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.63% (0.8273 => 0.8408, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5097, std. dev.: 0.0029) MultiSource/Applications/lemon/lemon: 1.36% (1.4298 => 1.4493, std. dev.: 0.0046) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.31% (2.0200 => 2.0464, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 1.10% (9.0760 => 9.1757, std. dev.: 0.0008) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -16.71% (0.4657 => 0.3879, std. dev.: 0.0054) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.55% (0.2670 => 0.2495, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.32% (0.3511 => 0.3289, std. dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.15% (22.5627 => 21.1748, std. dev.: 0.0159) SingleSource/UnitTests/ObjC/exceptions-3: -3.31% (0.3623 => 0.3503, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.21% (0.3650 => 0.3533, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-2: -3.17% (0.3601 => 0.3487, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -3.10% (0.3578 => 0.3467, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -3.07% (0.3646 => 0.3534, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.01% (0.8818 => 0.8553, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/synchronized: -2.95% (0.3663 => 0.3555, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -2.84% (0.3940 => 0.3828, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -2.72% (0.3789 => 0.3686, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -2.61% (0.3914 => 0.3812, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -2.52% (0.4003 => 0.3902, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: -1.97% (0.6250 => 0.6127, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.64% (0.6576 => 0.6468, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -11.07% (1.2308 => 1.0945, std. dev.: 0.0053) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.16% (1.0460 => 0.9502, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.53% (0.3139 => 0.2934, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9474, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.83% (1.3780 => 1.3114, std. dev.: 0.0114) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -4.00% (2.5089 => 2.4085, std. dev.: 0.0025) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.67% (0.3458 => 0.3331, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -3.64% (1.9762 => 1.9043, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/lists: -2.21% (6.3560 => 6.2154, std. dev.: 0.0087) SingleSource/Benchmarks/Misc/richards_benchmark: -2.14% (1.1560 => 1.1313, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: -2.11% (9.3358 => 9.1386, std. dev.: 0.0085) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6912, std. dev.: 0.0020) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.84% (6.6320 => 6.5103, std. dev.: 0.0029) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.82% (20.3410 => 19.9699, std. dev.: 0.0350) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3446, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9954, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) MultiSource/Applications/lua/lua: -1.30% (26.5159 => 26.1713, std. dev.: 0.0125) SingleSource/Benchmarks/Shootout/heapsort: -1.18% (3.9173 => 3.8709, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.03% (3.8887 => 3.8486, std. dev.: 0.0049) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.29s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu May 10 18:49:42 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 10 May 2012 20:49:42 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120511014942.731AC2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/602?compare_to=601&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 602, Order: 156592, Start Time: 2012-05-11 00:53:43, End Time: 2012-05-11 01:50:23 To: 601, Order: 156582, Start Time: 2012-05-10 23:30:43, End Time: 2012-05-11 00:27:22 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 5 (61 on baseline) Performance Improvements: 1 (29 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 886 (798 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 23.77% (0.3328 => 0.4119, std. dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.05% (0.5698 => 0.5815, std. dev.: 0.0011) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 2.41% (1.3791 => 1.4123, std. dev.: 0.0105) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.63% (0.8263 => 0.8398, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 1.44% (1.0945 => 1.1103, std. dev.: 0.0043) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/lemon/lemon: -1.08% (1.4493 => 1.4337, std. dev.: 0.0049) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 31.60% (0.3130 => 0.4119, std. dev.: 0.0044) MultiSource/Benchmarks/PAQ8p/paq8p: 13.51% (2.0176 => 2.2902, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.27% (0.5577 => 0.5815, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.19% (0.2721 => 0.2835, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.65% (3.9660 => 4.1106, std. dev.: 0.0032) MultiSource/Applications/SPASS/SPASS: 3.13% (13.8202 => 14.2532, std. dev.: 0.0168) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.11% (0.5265 => 0.5429, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.86% (0.6959 => 0.7158, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.67% (0.9199 => 0.9445, std. dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/hash2: 2.66% (0.4328 => 0.4443, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 2.65% (0.8310 => 0.8530, std. dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 2.64% (1.0594 => 1.0874, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.49% (1.2193 => 1.2496, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.47% (0.5637 => 0.5776, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.42% (1.1364 => 1.1639, std. dev.: 0.0011) MultiSource/Applications/kimwitu++/kc: 2.27% (16.6129 => 16.9899, std. dev.: 0.0183) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.24% (0.7460 => 0.7627, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.14% (1.4563 => 1.4875, std. dev.: 0.0022) MultiSource/Applications/lambda-0_1_3/lambda: 2.07% (0.7038 => 0.7184, std. dev.: 0.0020) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.95% (0.7710 => 0.7860, std. dev.: 0.0038) MultiSource/Benchmarks/MallocBench/gs/gs: 1.93% (3.8646 => 3.9392, std. dev.: 0.0024) MultiSource/Applications/siod/siod: 1.90% (2.1791 => 2.2206, std. dev.: 0.0040) MultiSource/Applications/Burg/burg: 1.85% (1.1061 => 1.1266, std. dev.: 0.0008) MultiSource/Applications/treecc/treecc: 1.83% (1.9270 => 1.9623, std. dev.: 0.0025) MultiSource/Applications/hbd/hbd: 1.76% (1.3693 => 1.3934, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.74% (1.3245 => 1.3475, std. dev.: 0.0028) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.66% (13.2842 => 13.5050, std. dev.: 0.0061) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.66% (1.3813 => 1.4042, std. dev.: 0.0032) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.60% (1.3819 => 1.4040, std. dev.: 0.0010) MultiSource/Applications/spiff/spiff: 1.59% (0.7506 => 0.7625, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.56% (3.6692 => 3.7263, std. dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.33% (2.1007 => 2.1286, std. dev.: 0.0069) MultiSource/Applications/sqlite3/sqlite3: 1.28% (16.2614 => 16.4700, std. dev.: 0.0049) MultiSource/Applications/JM/lencod/lencod: 1.19% (14.8535 => 15.0306, std. dev.: 0.0062) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.17% (1.1333 => 1.1466, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.15% (1.5188 => 1.5362, std. dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 1.04% (1.2292 => 1.2420, std. dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: 1.01% (6.5754 => 6.6419, std. dev.: 0.0031) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.24% (1.8175 => 2.2581, std. dev.: 0.0402) SingleSource/Benchmarks/Misc/mandel-2: 8.66% (1.2998 => 1.4123, std. dev.: 0.0105) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.84% (1.5824 => 1.6748, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8146, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9877, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.62% (1.7688 => 1.8328, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/salsa20: 3.53% (7.4271 => 7.6890, std. dev.: 0.0033) MultiSource/Benchmarks/nbench/nbench: 3.12% (11.2619 => 11.6131, std. dev.: 0.0034) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4548, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.96% (8.8259 => 9.0874, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-6: 2.87% (1.9199 => 1.9750, std. dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.76% (2.8606 => 2.9395, std. dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.51% (7.9275 => 8.1262, std. dev.: 0.0080) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.56% (0.8273 => 0.8402, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5098, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.27% (2.0200 => 2.0457, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.21% (1.9433 => 1.9669, std. dev.: 0.0084) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1780, std. dev.: 0.0006) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -19.91% (0.4657 => 0.3730, std. dev.: 0.0148) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.85% (0.2670 => 0.2487, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.41% (0.3511 => 0.3286, std. dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.11% (22.5627 => 21.1852, std. dev.: 0.0189) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.37% (0.8818 => 0.8521, std. dev.: 0.0069) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.98% (0.6576 => 0.6446, std. dev.: 0.0008) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -9.79% (1.2308 => 1.1103, std. dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.14% (1.0460 => 0.9504, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.53% (0.3139 => 0.2934, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2642, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9475, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.30% (1.3780 => 1.3187, std. dev.: 0.0020) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0010) SingleSource/Benchmarks/Dhrystone/dry: -4.03% (2.5089 => 2.4079, std. dev.: 0.0035) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.67% (1.9762 => 1.9036, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: -2.17% (1.1560 => 1.1309, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -2.07% (6.3560 => 6.2247, std. dev.: 0.0098) MultiSource/Applications/minisat/minisat: -2.01% (9.3358 => 9.1484, std. dev.: 0.0155) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.91% (6.6320 => 6.5054, std. dev.: 0.0020) MultiSource/Benchmarks/mafft/pairlocalalign: -1.89% (28.2225 => 27.6894, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9956, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.50% (20.3410 => 20.0366, std. dev.: 0.0226) SingleSource/Benchmarks/Shootout/heapsort: -1.43% (3.9173 => 3.8614, std. dev.: 0.0029) MultiSource/Applications/lua/lua: -1.33% (26.5159 => 26.1638, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.02% (3.8887 => 3.8491, std. dev.: 0.0015) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.43s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu May 10 20:12:39 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 10 May 2012 22:12:39 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120511031239.917AF2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/603?compare_to=602&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 603, Order: 156602, Start Time: 2012-05-11 02:16:43, End Time: 2012-05-11 03:13:21 To: 602, Order: 156592, Start Time: 2012-05-11 00:53:43, End Time: 2012-05-11 01:50:23 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (65 on baseline) Performance Improvements: 1 (34 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 891 (789 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.02% (1.3187 => 1.3052, std. dev.: 0.0017) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 31.79% (0.3130 => 0.4125, std. dev.: 0.0011) MultiSource/Benchmarks/PAQ8p/paq8p: 13.93% (2.0176 => 2.2986, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.78% (0.2721 => 0.2851, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.63% (0.5577 => 0.5835, std. dev.: 0.0030) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.77% (3.9660 => 4.1154, std. dev.: 0.0026) MultiSource/Applications/SPASS/SPASS: 3.41% (13.8202 => 14.2914, std. dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.13% (0.5265 => 0.5430, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.02% (0.6959 => 0.7169, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 2.93% (1.0594 => 1.0904, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: 2.91% (0.8310 => 0.8552, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.66% (0.9199 => 0.9444, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.63% (1.2193 => 1.2514, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.63% (1.1364 => 1.1663, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/hash2: 2.56% (0.4328 => 0.4439, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.52% (0.5637 => 0.5779, std. dev.: 0.0020) MultiSource/Applications/kimwitu++/kc: 2.46% (16.6129 => 17.0220, std. dev.: 0.0177) MultiSource/Applications/lambda-0_1_3/lambda: 2.39% (0.7038 => 0.7206, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 2.35% (3.8646 => 3.9555, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.31% (1.4563 => 1.4900, std. dev.: 0.0034) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.25% (0.7460 => 0.7628, std. dev.: 0.0009) MultiSource/Applications/siod/siod: 2.18% (2.1791 => 2.2266, std. dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.11% (0.4791 => 0.4892, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 2.00% (1.1061 => 1.1282, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.96% (1.3245 => 1.3504, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.93% (13.2842 => 13.5400, std. dev.: 0.0132) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.92% (0.7710 => 0.7858, std. dev.: 0.0029) MultiSource/Applications/treecc/treecc: 1.90% (1.9270 => 1.9637, std. dev.: 0.0053) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.85% (1.3813 => 1.4068, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.82% (1.3819 => 1.4070, std. dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: 1.79% (16.2614 => 16.5518, std. dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.77% (2.1007 => 2.1379, std. dev.: 0.0009) MultiSource/Applications/SIBsim4/SIBsim4: 1.76% (1.2749 => 1.2974, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.75% (3.2742 => 3.3315, std. dev.: 0.0010) MultiSource/Applications/hbd/hbd: 1.72% (1.3693 => 1.3928, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.71% (3.6692 => 3.7321, std. dev.: 0.0012) MultiSource/Applications/minisat/minisat: 1.63% (0.6744 => 0.6854, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.61% (0.6283 => 0.6384, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.56% (1.5188 => 1.5425, std. dev.: 0.0008) MultiSource/Applications/JM/lencod/lencod: 1.52% (14.8535 => 15.0790, std. dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.37% (1.1333 => 1.1488, std. dev.: 0.0014) MultiSource/Applications/spiff/spiff: 1.36% (0.7506 => 0.7608, std. dev.: 0.0007) MultiSource/Applications/JM/ldecod/ldecod: 1.35% (6.5754 => 6.6641, std. dev.: 0.0016) MultiSource/Benchmarks/Bullet/bullet: 1.04% (33.2944 => 33.6401, std. dev.: 0.0177) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.23% (1.8175 => 2.2578, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/mandel-2: 6.69% (1.2998 => 1.3867, std. dev.: 0.0138) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.89% (1.5824 => 1.6756, std. dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8143, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9877, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.64% (1.7688 => 1.8331, std. dev.: 0.0064) SingleSource/Benchmarks/Misc/salsa20: 3.54% (7.4271 => 7.6902, std. dev.: 0.0060) MultiSource/Benchmarks/nbench/nbench: 3.11% (11.2619 => 11.6125, std. dev.: 0.0020) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4535, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-6: 2.86% (1.9199 => 1.9749, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.74% (2.8606 => 2.9390, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.66% (8.8259 => 9.0611, std. dev.: 0.0204) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.10% (7.9275 => 8.0940, std. dev.: 0.0099) SingleSource/Benchmarks/Misc/ffbench: 1.55% (0.8273 => 0.8401, std. dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5102, std. dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.29% (2.0200 => 2.0460, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 1.10% (9.0760 => 9.1761, std. dev.: 0.0014) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.02% (1.5089 => 1.5243, std. dev.: 0.0024) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -14.64% (0.4657 => 0.3975, std. dev.: 0.0148) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.29% (0.2670 => 0.2502, std. dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.69% (22.5627 => 21.2791, std. dev.: 0.0090) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.58% (0.3511 => 0.3315, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -3.22% (0.3601 => 0.3485, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -3.15% (0.3623 => 0.3509, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -3.10% (0.3646 => 0.3533, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.10% (0.3650 => 0.3537, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/synchronized: -3.03% (0.3663 => 0.3552, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.95% (0.6576 => 0.6382, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/trivial-interface: -2.93% (0.3578 => 0.3473, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -2.79% (0.3940 => 0.3830, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.69% (0.8818 => 0.8581, std. dev.: 0.0008) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -10.32% (1.2308 => 1.1038, std. dev.: 0.0083) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.56% (0.3139 => 0.2933, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2642, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.28% (1.3780 => 1.3052, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9475, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.96% (2.5089 => 2.4096, std. dev.: 0.0024) MultiSource/Benchmarks/Olden/bh/bh: -3.65% (1.9762 => 1.9041, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.64% (0.3458 => 0.3332, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -2.25% (6.3560 => 6.2130, std. dev.: 0.0067) SingleSource/Benchmarks/Misc/richards_benchmark: -2.15% (1.1560 => 1.1312, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.02% (20.3410 => 19.9301, std. dev.: 0.0626) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6906, std. dev.: 0.0033) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.88% (6.6320 => 6.5071, std. dev.: 0.0043) MultiSource/Applications/minisat/minisat: -1.84% (9.3358 => 9.1641, std. dev.: 0.0071) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9952, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) MultiSource/Applications/lua/lua: -1.23% (26.5159 => 26.1903, std. dev.: 0.0119) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.66s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu May 10 21:35:33 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 10 May 2012 23:35:33 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120511043533.711062A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/604?compare_to=603&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 604, Order: 156604, Start Time: 2012-05-11 03:39:39, End Time: 2012-05-11 04:36:15 To: 603, Order: 156602, Start Time: 2012-05-11 02:16:43, End Time: 2012-05-11 03:13:21 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (65 on baseline) Performance Improvements: 0 (38 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (785 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 31.79% (0.3130 => 0.4125, std. dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: 13.94% (2.0176 => 2.2988, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.48% (0.2721 => 0.2843, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.38% (0.5577 => 0.5821, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.79% (3.9660 => 4.1165, std. dev.: 0.0042) MultiSource/Applications/SPASS/SPASS: 3.24% (13.8202 => 14.2677, std. dev.: 0.0166) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.99% (0.6959 => 0.7167, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 2.92% (1.0594 => 1.0903, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 2.91% (0.8310 => 0.8552, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.87% (0.5265 => 0.5416, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.65% (0.9199 => 0.9443, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.60% (1.1364 => 1.1659, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/hash2: 2.59% (0.4328 => 0.4440, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.58% (1.2193 => 1.2508, std. dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 2.53% (16.6129 => 17.0327, std. dev.: 0.0113) MultiSource/Applications/lambda-0_1_3/lambda: 2.40% (0.7038 => 0.7207, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.39% (1.4563 => 1.4911, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.34% (0.5637 => 0.5769, std. dev.: 0.0020) MultiSource/Applications/siod/siod: 2.15% (2.1791 => 2.2259, std. dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.11% (0.4791 => 0.4892, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 2.08% (3.8646 => 3.9451, std. dev.: 0.0031) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.05% (0.7460 => 0.7613, std. dev.: 0.0010) MultiSource/Applications/Burg/burg: 1.98% (1.1061 => 1.1280, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.91% (13.2842 => 13.5385, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.90% (1.3245 => 1.3497, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.81% (1.3819 => 1.4069, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.79% (3.6692 => 3.7350, std. dev.: 0.0087) MultiSource/Applications/SIBsim4/SIBsim4: 1.79% (1.2749 => 1.2977, std. dev.: 0.0080) MultiSource/Applications/sqlite3/sqlite3: 1.78% (16.2614 => 16.5507, std. dev.: 0.0083) MultiSource/Applications/hbd/hbd: 1.76% (1.3693 => 1.3934, std. dev.: 0.0083) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.75% (3.2742 => 3.3315, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.73% (0.7710 => 0.7843, std. dev.: 0.0019) MultiSource/Applications/treecc/treecc: 1.72% (1.9270 => 1.9602, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.72% (1.3813 => 1.4050, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.69% (2.1007 => 2.1362, std. dev.: 0.0007) MultiSource/Applications/minisat/minisat: 1.68% (0.6744 => 0.6857, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.60% (1.5188 => 1.5431, std. dev.: 0.0023) MultiSource/Applications/JM/lencod/lencod: 1.46% (14.8535 => 15.0707, std. dev.: 0.0055) MultiSource/Applications/JM/ldecod/ldecod: 1.33% (6.5754 => 6.6627, std. dev.: 0.0057) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.29% (1.1333 => 1.1479, std. dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: 1.06% (33.2944 => 33.6464, std. dev.: 0.0079) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.35% (1.8175 => 2.2601, std. dev.: 0.0302) SingleSource/Benchmarks/Misc/mandel-2: 7.05% (1.2998 => 1.3915, std. dev.: 0.0069) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6755, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9882, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.61% (1.7688 => 1.8327, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: 3.59% (7.4271 => 7.6940, std. dev.: 0.0067) MultiSource/Benchmarks/nbench/nbench: 3.14% (11.2619 => 11.6154, std. dev.: 0.0044) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4536, std. dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.91% (8.8259 => 9.0823, std. dev.: 0.0051) SingleSource/Benchmarks/Misc/flops-6: 2.82% (1.9199 => 1.9740, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.74% (2.8606 => 2.9391, std. dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.36% (7.9275 => 8.1144, std. dev.: 0.0094) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.49% (0.8273 => 0.8396, std. dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5096, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.28% (2.0200 => 2.0458, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1777, std. dev.: 0.0014) MultiSource/Benchmarks/sim/sim: 1.12% (5.0168 => 5.0730, std. dev.: 0.0150) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.03% (1.5089 => 1.5245, std. dev.: 0.0008) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -16.02% (0.4657 => 0.3911, std. dev.: 0.0060) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.14% (0.2670 => 0.2506, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.81% (22.5627 => 21.2524, std. dev.: 0.0159) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.58% (0.3511 => 0.3315, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.21% (0.3650 => 0.3533, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -3.17% (0.3601 => 0.3487, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -3.15% (0.3623 => 0.3509, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -3.08% (0.3663 => 0.3550, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -3.07% (0.3646 => 0.3534, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -3.02% (0.3578 => 0.3470, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.90% (0.6576 => 0.6385, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -2.82% (0.3940 => 0.3829, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.78% (0.8818 => 0.8573, std. dev.: 0.0037) SingleSource/UnitTests/ObjC/for-in: -2.72% (0.3789 => 0.3686, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -2.61% (0.3914 => 0.3812, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -2.50% (0.4003 => 0.3903, std. dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -10.79% (1.2308 => 1.0980, std. dev.: 0.0070) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.50% (0.3139 => 0.2935, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2642, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9473, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.69% (1.3780 => 1.3134, std. dev.: 0.0040) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -4.02% (2.5089 => 2.4081, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.76% (0.3458 => 0.3328, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -3.68% (1.9762 => 1.9034, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/lists: -2.26% (6.3560 => 6.2123, std. dev.: 0.0066) SingleSource/Benchmarks/Misc/richards_benchmark: -2.14% (1.1560 => 1.1313, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.13% (20.3410 => 19.9086, std. dev.: 0.0656) MultiSource/Applications/minisat/minisat: -1.94% (9.3358 => 9.1549, std. dev.: 0.0058) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6919, std. dev.: 0.0018) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.87% (6.6320 => 6.5083, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9956, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.56% (0.9692 => 0.9541, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.24% (3.9173 => 3.8687, std. dev.: 0.0039) MultiSource/Applications/lua/lua: -1.12% (26.5159 => 26.2202, std. dev.: 0.0079) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.40s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu May 10 22:58:46 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 11 May 2012 00:58:46 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120511055846.F23852A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/605?compare_to=604&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 605, Order: 156606, Start Time: 2012-05-11 05:02:50, End Time: 2012-05-11 05:59:28 To: 604, Order: 156604, Start Time: 2012-05-11 03:39:39, End Time: 2012-05-11 04:36:15 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (65 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 891 (786 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/McGill/chomp: 1.09% (1.0980 => 1.1100, std. dev.: 0.0011) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 31.82% (0.3130 => 0.4126, std. dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: 13.94% (2.0176 => 2.2988, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.59% (0.2721 => 0.2846, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.32% (0.5577 => 0.5818, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.75% (3.9660 => 4.1147, std. dev.: 0.0020) MultiSource/Applications/SPASS/SPASS: 3.31% (13.8202 => 14.2779, std. dev.: 0.0082) MultiSource/Benchmarks/nbench/nbench: 3.01% (1.0594 => 1.0913, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.96% (0.5265 => 0.5421, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.96% (0.6959 => 0.7165, std. dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/football/football: 2.95% (0.8310 => 0.8555, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.78% (0.9199 => 0.9455, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.75% (1.1364 => 1.1676, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.60% (1.2193 => 1.2510, std. dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: 2.54% (16.6129 => 17.0353, std. dev.: 0.0242) SingleSource/Benchmarks/Shootout-C++/hash2: 2.54% (0.4328 => 0.4438, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.42% (1.4563 => 1.4915, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.39% (0.5637 => 0.5772, std. dev.: 0.0006) MultiSource/Applications/siod/siod: 2.24% (2.1791 => 2.2279, std. dev.: 0.0035) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.18% (0.7460 => 0.7623, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 2.13% (3.8646 => 3.9471, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.13% (0.4791 => 0.4893, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 2.06% (1.1061 => 1.1289, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.03% (1.3245 => 1.3514, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.00% (0.7710 => 0.7864, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.94% (13.2842 => 13.5417, std. dev.: 0.0080) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.85% (1.3819 => 1.4074, std. dev.: 0.0008) MultiSource/Applications/treecc/treecc: 1.83% (1.9270 => 1.9623, std. dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 1.82% (16.2614 => 16.5571, std. dev.: 0.0086) MultiSource/Applications/SIBsim4/SIBsim4: 1.80% (1.2749 => 1.2978, std. dev.: 0.0073) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.77% (3.2742 => 3.3320, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.76% (3.6692 => 3.7337, std. dev.: 0.0027) MultiSource/Applications/minisat/minisat: 1.75% (0.6744 => 0.6862, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.74% (1.3813 => 1.4053, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.71% (2.1007 => 2.1367, std. dev.: 0.0017) MultiSource/Applications/hbd/hbd: 1.71% (1.3693 => 1.3927, std. dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.62% (0.6283 => 0.6385, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.57% (1.5188 => 1.5427, std. dev.: 0.0063) MultiSource/Applications/JM/lencod/lencod: 1.56% (14.8535 => 15.0845, std. dev.: 0.0054) MultiSource/Applications/JM/ldecod/ldecod: 1.32% (6.5754 => 6.6621, std. dev.: 0.0068) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.30% (1.1333 => 1.1480, std. dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: 1.08% (33.2944 => 33.6545, std. dev.: 0.0142) MultiSource/Applications/d/make_dparser: 1.05% (3.1889 => 3.2224, std. dev.: 0.0013) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.20% (1.8175 => 2.2573, std. dev.: 0.0128) SingleSource/Benchmarks/Misc/mandel-2: 7.57% (1.2998 => 1.3982, std. dev.: 0.0105) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.52% (2.5629 => 2.7299, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.89% (1.5824 => 1.6756, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9879, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 3.59% (7.4271 => 7.6939, std. dev.: 0.0055) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.57% (1.7688 => 1.8320, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 3.14% (11.2619 => 11.6153, std. dev.: 0.0033) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 3.12% (8.8259 => 9.1011, std. dev.: 0.0031) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4534, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-6: 2.93% (1.9199 => 1.9762, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9392, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.56% (7.9275 => 8.1302, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.60% (1.9290 => 1.9599, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 1.60% (0.8273 => 0.8405, std. dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5097, std. dev.: 0.0030) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.27% (2.0200 => 2.0457, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.14% (9.0760 => 9.1794, std. dev.: 0.0006) MultiSource/Benchmarks/sim/sim: 1.06% (5.0168 => 5.0702, std. dev.: 0.0078) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -18.68% (0.4657 => 0.3787, std. dev.: 0.0211) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.22% (0.2670 => 0.2504, std. dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.73% (22.5627 => 21.2702, std. dev.: 0.0129) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.53% (0.3511 => 0.3317, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: -3.23% (0.3623 => 0.3506, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.21% (0.3650 => 0.3533, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-2: -3.19% (0.3601 => 0.3486, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -3.08% (0.3663 => 0.3550, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -3.04% (0.3646 => 0.3535, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: -2.99% (0.3578 => 0.3471, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.83% (0.6576 => 0.6390, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/property: -2.79% (0.3940 => 0.3830, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.68% (0.8818 => 0.8582, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions: -2.58% (0.3914 => 0.3813, std. dev.: 0.0005) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -9.81% (1.2308 => 1.1100, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.16% (1.0460 => 0.9502, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.56% (0.3139 => 0.2933, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.97% (1.3780 => 1.3095, std. dev.: 0.0053) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9474, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.97% (2.5089 => 2.4093, std. dev.: 0.0039) MultiSource/Benchmarks/Olden/bh/bh: -3.74% (1.9762 => 1.9022, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: -2.12% (1.1560 => 1.1315, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -2.07% (6.3560 => 6.2244, std. dev.: 0.0100) MultiSource/Applications/minisat/minisat: -1.98% (9.3358 => 9.1508, std. dev.: 0.0145) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.94% (6.6320 => 6.5031, std. dev.: 0.0036) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6916, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.63% (20.3410 => 20.0103, std. dev.: 0.0426) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9955, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout/heapsort: -1.47% (3.9173 => 3.8596, std. dev.: 0.0081) MultiSource/Applications/lua/lua: -1.32% (26.5159 => 26.1670, std. dev.: 0.0280) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.06% (2.5254 => 2.4987, std. dev.: 0.0038) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.00s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri May 11 03:41:54 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 11 May 2012 05:41:54 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120511104154.EF3882A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/606?compare_to=605&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 606, Order: 156608, Start Time: 2012-05-11 09:45:43, End Time: 2012-05-11 10:42:35 To: 605, Order: 156606, Start Time: 2012-05-11 05:02:50, End Time: 2012-05-11 05:59:28 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (66 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (788 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 31.76% (0.3130 => 0.4124, std. dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: 13.06% (2.0176 => 2.2810, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.39% (0.5577 => 0.5822, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.34% (0.2721 => 0.2839, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.58% (3.9660 => 4.1080, std. dev.: 0.0020) MultiSource/Applications/SPASS/SPASS: 3.10% (13.8202 => 14.2487, std. dev.: 0.0185) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.99% (0.6959 => 0.7167, std. dev.: 0.0045) MultiSource/Benchmarks/nbench/nbench: 2.92% (1.0594 => 1.0903, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.85% (0.5265 => 0.5415, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 2.80% (0.8310 => 0.8543, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.74% (0.9199 => 0.9451, std. dev.: 0.0024) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.66% (1.1364 => 1.1666, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.52% (1.4563 => 1.4930, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.43% (1.2193 => 1.2489, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 2.38% (0.4328 => 0.4431, std. dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 2.36% (16.6129 => 17.0053, std. dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.34% (0.5637 => 0.5769, std. dev.: 0.0019) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.13% (0.7710 => 0.7874, std. dev.: 0.0022) MultiSource/Applications/siod/siod: 2.09% (2.1791 => 2.2247, std. dev.: 0.0016) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.94% (0.7460 => 0.7605, std. dev.: 0.0021) MultiSource/Benchmarks/MallocBench/gs/gs: 1.89% (3.8646 => 3.9378, std. dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.89% (1.3245 => 1.3495, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.86% (1.3819 => 1.4076, std. dev.: 0.0029) MultiSource/Applications/Burg/burg: 1.81% (1.1061 => 1.1261, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.73% (13.2842 => 13.5142, std. dev.: 0.0064) MultiSource/Applications/hbd/hbd: 1.68% (1.3693 => 1.3923, std. dev.: 0.0031) MultiSource/Applications/treecc/treecc: 1.65% (1.9270 => 1.9588, std. dev.: 0.0024) MultiSource/Applications/sqlite3/sqlite3: 1.63% (16.2614 => 16.5265, std. dev.: 0.0056) MultiSource/Applications/SIBsim4/SIBsim4: 1.62% (1.2749 => 1.2955, std. dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.59% (2.1007 => 2.1342, std. dev.: 0.0062) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.59% (1.3813 => 1.4033, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.59% (3.6692 => 3.7276, std. dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.53% (3.2742 => 3.3244, std. dev.: 0.0013) MultiSource/Applications/minisat/minisat: 1.51% (0.6744 => 0.6846, std. dev.: 0.0010) MultiSource/Applications/JM/lencod/lencod: 1.34% (14.8535 => 15.0522, std. dev.: 0.0155) MultiSource/Benchmarks/Bullet/bullet: 1.32% (33.2944 => 33.7347, std. dev.: 0.0300) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.30% (1.5188 => 1.5385, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.24% (1.1333 => 1.1474, std. dev.: 0.0021) MultiSource/Applications/JM/ldecod/ldecod: 1.21% (6.5754 => 6.6551, std. dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 23.88% (1.8175 => 2.2515, std. dev.: 0.0051) SingleSource/Benchmarks/Misc/mandel-2: 8.42% (1.2998 => 1.4093, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6754, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8146, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9876, std. dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.71% (1.7688 => 1.8344, std. dev.: 0.0058) SingleSource/Benchmarks/Misc/salsa20: 3.64% (7.4271 => 7.6977, std. dev.: 0.0054) MultiSource/Benchmarks/nbench/nbench: 3.16% (11.2619 => 11.6180, std. dev.: 0.0019) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4538, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: 2.95% (1.9199 => 1.9766, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.85% (8.8259 => 9.0774, std. dev.: 0.0110) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9392, std. dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.38% (7.9275 => 8.1163, std. dev.: 0.0160) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/ffbench: 1.56% (0.8273 => 0.8402, std. dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 1.47% (5.0168 => 5.0903, std. dev.: 0.0019) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5092, std. dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.30% (2.0200 => 2.0462, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bisort/bisort: 1.29% (0.8239 => 0.8345, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 1.11% (9.0760 => 9.1769, std. dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.10% (1.9433 => 1.9647, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.10% (1.5089 => 1.5255, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 1.01% (13.3668 => 13.5013, std. dev.: 0.0110) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.82% (0.2670 => 0.2488, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.05% (22.5627 => 21.1966, std. dev.: 0.0109) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.21% (0.3511 => 0.3328, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: -3.01% (0.3623 => 0.3514, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -2.86% (0.3601 => 0.3498, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -2.82% (0.3650 => 0.3547, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-4: -2.80% (0.3646 => 0.3544, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -2.78% (0.3663 => 0.3561, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -2.59% (0.3940 => 0.3838, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.59% (0.6576 => 0.6406, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.57% (0.8818 => 0.8591, std. dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/bigfib: -1.78% (0.6250 => 0.6139, std. dev.: 0.0006) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -10.52% (1.2308 => 1.1013, std. dev.: 0.0091) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.53% (0.3139 => 0.2934, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.35% (1.3780 => 1.3043, std. dev.: 0.0279) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9474, std. dev.: 0.0004) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -4.04% (2.5089 => 2.4075, std. dev.: 0.0016) MultiSource/Benchmarks/Olden/bh/bh: -3.63% (1.9762 => 1.9045, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.59% (0.3458 => 0.3334, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -2.36% (6.3560 => 6.2058, std. dev.: 0.0211) SingleSource/Benchmarks/Misc/richards_benchmark: -2.16% (1.1560 => 1.1310, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: -1.99% (9.3358 => 9.1501, std. dev.: 0.0131) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6914, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.87% (6.6320 => 6.5080, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9958, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.56% (20.3410 => 20.0230, std. dev.: 0.0196) SingleSource/Benchmarks/Shootout/heapsort: -1.43% (3.9173 => 3.8614, std. dev.: 0.0080) MultiSource/Applications/lua/lua: -1.13% (26.5159 => 26.2155, std. dev.: 0.0086) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.15s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri May 11 05:05:39 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 11 May 2012 07:05:39 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120511120539.E080B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/607?compare_to=606&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 607, Order: 156613, Start Time: 2012-05-11 11:09:16, End Time: 2012-05-11 12:06:22 To: 606, Order: 156608, Start Time: 2012-05-11 09:45:43, End Time: 2012-05-11 10:42:35 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (61 on baseline) Performance Improvements: 1 (34 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 891 (793 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -14.12% (0.4399 => 0.3778, std. dev.: 0.0183) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 31.53% (0.3130 => 0.4117, std. dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: 12.73% (2.0176 => 2.2745, std. dev.: 0.0044) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.19% (0.2721 => 0.2835, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.16% (0.5577 => 0.5809, std. dev.: 0.0022) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.42% (3.9660 => 4.1016, std. dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.83% (0.6959 => 0.7156, std. dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 2.81% (13.8202 => 14.2090, std. dev.: 0.0150) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.79% (0.5265 => 0.5412, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.52% (0.9199 => 0.9431, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 2.45% (0.8310 => 0.8514, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 2.45% (1.0594 => 1.0854, std. dev.: 0.0020) MultiSource/Applications/kimwitu++/kc: 2.39% (16.6129 => 17.0096, std. dev.: 0.0030) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.35% (1.1364 => 1.1631, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.27% (0.5637 => 0.5765, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.21% (1.2193 => 1.2462, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.16% (1.4563 => 1.4878, std. dev.: 0.0013) MultiSource/Applications/lambda-0_1_3/lambda: 1.99% (0.7038 => 0.7178, std. dev.: 0.0028) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.89% (0.7460 => 0.7601, std. dev.: 0.0010) MultiSource/Applications/siod/siod: 1.86% (2.1791 => 2.2197, std. dev.: 0.0027) MultiSource/Benchmarks/MallocBench/gs/gs: 1.76% (3.8646 => 3.9328, std. dev.: 0.0042) MultiSource/Applications/Burg/burg: 1.73% (1.1061 => 1.1252, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.66% (1.3819 => 1.4049, std. dev.: 0.0020) MultiSource/Applications/treecc/treecc: 1.61% (1.9270 => 1.9581, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.61% (1.3245 => 1.3458, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.59% (1.3813 => 1.4033, std. dev.: 0.0017) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.54% (0.7710 => 0.7829, std. dev.: 0.0021) MultiSource/Applications/hbd/hbd: 1.53% (1.3693 => 1.3902, std. dev.: 0.0043) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.52% (13.2842 => 13.4867, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.47% (3.6692 => 3.7232, std. dev.: 0.0125) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.34% (3.2742 => 3.3182, std. dev.: 0.0053) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.26% (2.1007 => 2.1271, std. dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: 1.24% (16.2614 => 16.4635, std. dev.: 0.0054) MultiSource/Applications/SIBsim4/SIBsim4: 1.23% (1.2749 => 1.2906, std. dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: 1.17% (33.2944 => 33.6825, std. dev.: 0.0303) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.15% (1.5188 => 1.5363, std. dev.: 0.0008) MultiSource/Applications/JM/lencod/lencod: 1.02% (14.8535 => 15.0043, std. dev.: 0.0058) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.34% (1.8175 => 2.2598, std. dev.: 0.0076) SingleSource/Benchmarks/Misc/mandel-2: 8.66% (1.2998 => 1.4123, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.86% (1.5824 => 1.6751, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8146, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9882, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 3.67% (7.4271 => 7.6999, std. dev.: 0.0070) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.63% (1.7688 => 1.8330, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 3.16% (11.2619 => 11.6173, std. dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4543, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.97% (8.8259 => 9.0879, std. dev.: 0.0073) SingleSource/Benchmarks/Misc/flops-6: 2.90% (1.9199 => 1.9756, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9393, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.35% (7.9275 => 8.1141, std. dev.: 0.0088) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9603, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.55% (0.8273 => 0.8401, std. dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.39% (8.3908 => 8.5074, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.26% (2.0200 => 2.0455, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.15% (1.9433 => 1.9657, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 1.11% (9.0760 => 9.1768, std. dev.: 0.0019) MultiSource/Benchmarks/sim/sim: 1.01% (5.0168 => 5.0674, std. dev.: 0.0035) MultiSource/Applications/sqlite3/sqlite3: 1.01% (4.5928 => 4.6390, std. dev.: 0.0043) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -18.87% (0.4657 => 0.3778, std. dev.: 0.0183) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.85% (0.2670 => 0.2487, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.35% (0.3511 => 0.3288, std. dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.20% (22.5627 => 21.1629, std. dev.: 0.0181) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.28% (0.6576 => 0.6360, std. dev.: 0.0018) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.01% (0.3650 => 0.3540, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-3: -3.01% (0.3623 => 0.3514, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.95% (0.8818 => 0.8558, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-2: -2.89% (0.3601 => 0.3497, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -2.87% (0.3663 => 0.3558, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -2.85% (0.3578 => 0.3476, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: -1.81% (0.6250 => 0.6137, std. dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -10.27% (1.2308 => 1.1044, std. dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.16% (1.0460 => 0.9502, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.59% (0.3139 => 0.2932, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.95% (1.3780 => 1.3098, std. dev.: 0.0110) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9474, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.92% (2.5089 => 2.4105, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.73% (0.3458 => 0.3329, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.65% (1.9762 => 1.9040, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/lists: -2.15% (6.3560 => 6.2192, std. dev.: 0.0113) SingleSource/Benchmarks/Misc/richards_benchmark: -2.14% (1.1560 => 1.1313, std. dev.: 0.0000) MultiSource/Applications/minisat/minisat: -2.00% (9.3358 => 9.1492, std. dev.: 0.0117) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6914, std. dev.: 0.0018) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.80% (6.6320 => 6.5125, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.78% (20.3410 => 19.9793, std. dev.: 0.0262) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9955, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) MultiSource/Applications/lua/lua: -1.38% (26.5159 => 26.1488, std. dev.: 0.0311) SingleSource/Benchmarks/Shootout/heapsort: -1.35% (3.9173 => 3.8643, std. dev.: 0.0038) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.29s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri May 11 08:55:06 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 11 May 2012 10:55:06 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120511155506.C41022A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/608?compare_to=607&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 608, Order: 156615, Start Time: 2012-05-11 14:59:16, End Time: 2012-05-11 15:55:49 To: 607, Order: 156613, Start Time: 2012-05-11 11:09:16, End Time: 2012-05-11 12:06:22 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (54 on baseline) Performance Improvements: 0 (30 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (804 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 31.25% (0.3130 => 0.4108, std. dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: 12.25% (2.0176 => 2.2647, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.07% (0.5577 => 0.5804, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.93% (0.2721 => 0.2828, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.35% (3.9660 => 4.0987, std. dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 2.59% (13.8202 => 14.1784, std. dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.57% (0.6959 => 0.7138, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.36% (0.9199 => 0.9416, std. dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 2.27% (1.0594 => 1.0835, std. dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.22% (0.5637 => 0.5762, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 2.21% (0.8310 => 0.8494, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.11% (1.1364 => 1.1604, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.06% (0.7710 => 0.7869, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.03% (1.2193 => 1.2441, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.85% (1.4563 => 1.4833, std. dev.: 0.0033) MultiSource/Applications/kimwitu++/kc: 1.84% (16.6129 => 16.9185, std. dev.: 0.0105) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.82% (0.7460 => 0.7596, std. dev.: 0.0015) MultiSource/Applications/lambda-0_1_3/lambda: 1.79% (0.7038 => 0.7164, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 1.63% (3.8646 => 3.9277, std. dev.: 0.0156) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.59% (1.3813 => 1.4033, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.59% (1.3819 => 1.4039, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.54% (13.2842 => 13.4891, std. dev.: 0.0102) MultiSource/Applications/hbd/hbd: 1.52% (1.3693 => 1.3901, std. dev.: 0.0024) MultiSource/Applications/siod/siod: 1.50% (2.1791 => 2.2118, std. dev.: 0.0068) MultiSource/Applications/treecc/treecc: 1.38% (1.9270 => 1.9535, std. dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.37% (1.3245 => 1.3426, std. dev.: 0.0022) MultiSource/Applications/sqlite3/sqlite3: 1.24% (16.2614 => 16.4623, std. dev.: 0.0106) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.15% (3.6692 => 3.7114, std. dev.: 0.0036) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.49% (1.8175 => 2.2626, std. dev.: 0.0480) SingleSource/Benchmarks/Misc/mandel-2: 8.32% (1.2998 => 1.4079, std. dev.: 0.0152) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.86% (1.5824 => 1.6752, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8146, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.87% (1.9144 => 1.9885, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/salsa20: 3.65% (7.4271 => 7.6982, std. dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.61% (1.7688 => 1.8327, std. dev.: 0.0158) MultiSource/Benchmarks/nbench/nbench: 3.14% (11.2619 => 11.6154, std. dev.: 0.0024) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4546, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.97% (8.8259 => 9.0880, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/flops-6: 2.89% (1.9199 => 1.9754, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.76% (2.8606 => 2.9395, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.18% (7.9275 => 8.1001, std. dev.: 0.0166) MultiSource/Benchmarks/llubenchmark/llu: 2.11% (3.7731 => 3.8527, std. dev.: 0.0239) SingleSource/Benchmarks/Misc/ffbench: 1.62% (0.8273 => 0.8407, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5097, std. dev.: 0.0093) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.29% (2.0200 => 2.0461, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 1.20% (5.0168 => 5.0772, std. dev.: 0.0066) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: 1.14% (9.0760 => 9.1792, std. dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.10% (1.9433 => 1.9647, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.05% (1.5089 => 1.5248, std. dev.: 0.0027) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -20.38% (0.4657 => 0.3708, std. dev.: 0.0212) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.74% (0.2670 => 0.2490, std. dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.35% (22.5627 => 21.1299, std. dev.: 0.0028) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.24% (0.3511 => 0.3292, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.41% (0.6576 => 0.6352, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.31% (0.8818 => 0.8526, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: -1.98% (0.6250 => 0.6126, std. dev.: 0.0002) MultiSource/Applications/lua/lua: -1.10% (3.7467 => 3.7056, std. dev.: 0.0103) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -9.69% (1.2308 => 1.1115, std. dev.: 0.0049) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.16% (1.0460 => 0.9502, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.59% (0.3139 => 0.2932, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9472, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.64% (1.3780 => 1.3140, std. dev.: 0.0113) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -4.01% (2.5089 => 2.4082, std. dev.: 0.0014) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: -3.66% (1.9762 => 1.9038, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/richards_benchmark: -2.12% (1.1560 => 1.1315, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -2.08% (6.3560 => 6.2241, std. dev.: 0.0033) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.98% (20.3410 => 19.9391, std. dev.: 0.0307) MultiSource/Applications/minisat/minisat: -1.92% (9.3358 => 9.1565, std. dev.: 0.0415) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6914, std. dev.: 0.0018) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.87% (6.6320 => 6.5082, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3446, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9953, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.38% (3.9173 => 3.8634, std. dev.: 0.0045) MultiSource/Applications/lua/lua: -1.31% (26.5159 => 26.1688, std. dev.: 0.0236) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.42s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri May 11 10:17:55 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 11 May 2012 12:17:55 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120511171755.1018E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/609?compare_to=608&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 609, Order: 156620, Start Time: 2012-05-11 16:22:07, End Time: 2012-05-11 17:18:38 To: 608, Order: 156615, Start Time: 2012-05-11 14:59:16, End Time: 2012-05-11 15:55:49 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (56 on baseline) Performance Improvements: 0 (30 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (802 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 31.37% (0.3130 => 0.4112, std. dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: 12.28% (2.0176 => 2.2654, std. dev.: 0.0053) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.01% (0.2721 => 0.2830, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.98% (0.5577 => 0.5799, std. dev.: 0.0016) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.23% (3.9660 => 4.0941, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.79% (0.5265 => 0.5412, std. dev.: 0.0050) MultiSource/Applications/SPASS/SPASS: 2.61% (13.8202 => 14.1804, std. dev.: 0.0079) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.51% (0.6959 => 0.7134, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.38% (0.5637 => 0.5771, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.34% (0.9199 => 0.9414, std. dev.: 0.0065) MultiSource/Benchmarks/nbench/nbench: 2.25% (1.0594 => 1.0832, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.15% (0.7710 => 0.7876, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/football/football: 2.14% (0.8310 => 0.8488, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.13% (1.1364 => 1.1606, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.10% (1.2193 => 1.2449, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.05% (1.4563 => 1.4862, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.02% (0.7460 => 0.7611, std. dev.: 0.0008) MultiSource/Applications/kimwitu++/kc: 1.86% (16.6129 => 16.9224, std. dev.: 0.0016) MultiSource/Applications/lambda-0_1_3/lambda: 1.79% (0.7038 => 0.7164, std. dev.: 0.0038) MultiSource/Applications/siod/siod: 1.79% (2.1791 => 2.2181, std. dev.: 0.0018) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.70% (1.3813 => 1.4048, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 1.60% (3.8646 => 3.9264, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.54% (1.3245 => 1.3449, std. dev.: 0.0036) MultiSource/Applications/hbd/hbd: 1.53% (1.3693 => 1.3902, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.51% (1.3819 => 1.4028, std. dev.: 0.0024) MultiSource/Applications/Burg/burg: 1.48% (1.1061 => 1.1225, std. dev.: 0.0006) MultiSource/Applications/treecc/treecc: 1.47% (1.9270 => 1.9554, std. dev.: 0.0090) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.42% (13.2842 => 13.4724, std. dev.: 0.0196) MultiSource/Applications/sqlite3/sqlite3: 1.28% (16.2614 => 16.4689, std. dev.: 0.0179) MultiSource/Applications/SIBsim4/SIBsim4: 1.26% (1.2749 => 1.2910, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.21% (3.6692 => 3.7137, std. dev.: 0.0030) MultiSource/Applications/JM/lencod/lencod: 1.02% (14.8535 => 15.0057, std. dev.: 0.0091) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.53% (1.8175 => 2.2634, std. dev.: 0.0506) SingleSource/Benchmarks/Misc/mandel-2: 6.85% (1.2998 => 1.3888, std. dev.: 0.0130) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6755, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9879, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.66% (1.7688 => 1.8336, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/salsa20: 3.61% (7.4271 => 7.6955, std. dev.: 0.0041) MultiSource/Benchmarks/nbench/nbench: 3.16% (11.2619 => 11.6178, std. dev.: 0.0052) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4546, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: 2.81% (1.9199 => 1.9738, std. dev.: 0.0027) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.76% (8.8259 => 9.0693, std. dev.: 0.0103) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9392, std. dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.52% (7.9275 => 8.1271, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.57% (0.8273 => 0.8403, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5086, std. dev.: 0.0005) MultiSource/Benchmarks/sim/sim: 1.34% (5.0168 => 5.0840, std. dev.: 0.0049) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.30% (2.0200 => 2.0463, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.20% (1.9433 => 1.9667, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 1.15% (9.0760 => 9.1804, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -20.91% (0.4657 => 0.3683, std. dev.: 0.0124) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.82% (0.2670 => 0.2488, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.44% (0.3511 => 0.3285, std. dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.39% (22.5627 => 21.1207, std. dev.: 0.0181) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.39% (0.6576 => 0.6353, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.37% (0.8818 => 0.8521, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/bigfib: -2.13% (0.6250 => 0.6117, std. dev.: 0.0004) MultiSource/Applications/lua/lua: -1.09% (3.7467 => 3.7058, std. dev.: 0.0096) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -10.03% (1.2308 => 1.1073, std. dev.: 0.0081) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.53% (0.3139 => 0.2934, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2650, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.05% (1.3780 => 1.3084, std. dev.: 0.0095) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9475, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -4.00% (2.5089 => 2.4085, std. dev.: 0.0015) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.66% (1.9762 => 1.9039, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -2.30% (6.3560 => 6.2098, std. dev.: 0.0053) SingleSource/Benchmarks/Misc/richards_benchmark: -2.15% (1.1560 => 1.1311, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: -2.00% (9.3358 => 9.1495, std. dev.: 0.0148) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.96% (20.3410 => 19.9418, std. dev.: 0.0621) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.96% (6.6320 => 6.5023, std. dev.: 0.0020) MultiSource/Benchmarks/mafft/pairlocalalign: -1.89% (28.2225 => 27.6898, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9953, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.35% (3.9173 => 3.8645, std. dev.: 0.0019) MultiSource/Applications/lua/lua: -1.19% (26.5159 => 26.2011, std. dev.: 0.0305) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.53s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri May 11 11:40:53 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 11 May 2012 13:40:53 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120511184053.F0B162A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/610?compare_to=609&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 610, Order: 156621, Start Time: 2012-05-11 17:44:58, End Time: 2012-05-11 18:41:35 To: 609, Order: 156620, Start Time: 2012-05-11 16:22:07, End Time: 2012-05-11 17:18:38 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (53 on baseline) Performance Improvements: 0 (30 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (805 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 31.37% (0.3130 => 0.4112, std. dev.: 0.0009) MultiSource/Benchmarks/PAQ8p/paq8p: 12.26% (2.0176 => 2.2650, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.00% (0.5577 => 0.5800, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.97% (0.2721 => 0.2829, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.22% (3.9660 => 4.0939, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.85% (0.5265 => 0.5415, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 2.71% (1.0594 => 1.0881, std. dev.: 0.0051) MultiSource/Applications/SPASS/SPASS: 2.57% (13.8202 => 14.1753, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.45% (0.9199 => 0.9424, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.43% (0.6959 => 0.7128, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.29% (0.5637 => 0.5766, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.10% (0.7710 => 0.7872, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/football/football: 2.09% (0.8310 => 0.8484, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.06% (0.7460 => 0.7614, std. dev.: 0.0019) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.05% (1.1364 => 1.1597, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.03% (1.2193 => 1.2440, std. dev.: 0.0078) MultiSource/Applications/lambda-0_1_3/lambda: 1.82% (0.7038 => 0.7166, std. dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 1.81% (16.6129 => 16.9130, std. dev.: 0.0092) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.68% (1.3819 => 1.4051, std. dev.: 0.0048) MultiSource/Benchmarks/MallocBench/gs/gs: 1.63% (3.8646 => 3.9277, std. dev.: 0.0074) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.60% (1.3813 => 1.4034, std. dev.: 0.0018) MultiSource/Applications/siod/siod: 1.55% (2.1791 => 2.2128, std. dev.: 0.0053) MultiSource/Applications/Burg/burg: 1.52% (1.1061 => 1.1229, std. dev.: 0.0045) MultiSource/Applications/hbd/hbd: 1.50% (1.3693 => 1.3898, std. dev.: 0.0019) MultiSource/Applications/treecc/treecc: 1.46% (1.9270 => 1.9552, std. dev.: 0.0081) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.40% (13.2842 => 13.4707, std. dev.: 0.0089) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.37% (1.3245 => 1.3427, std. dev.: 0.0018) MultiSource/Applications/sqlite3/sqlite3: 1.12% (16.2614 => 16.4433, std. dev.: 0.0294) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.08% (3.6692 => 3.7090, std. dev.: 0.0052) MultiSource/Applications/SIBsim4/SIBsim4: 1.05% (1.2749 => 1.2883, std. dev.: 0.0016) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.13% (1.8175 => 2.2561, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/mandel-2: 7.70% (1.2998 => 1.3999, std. dev.: 0.0126) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.86% (1.5824 => 1.6752, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9877, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.63% (1.7688 => 1.8330, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: 3.50% (7.4271 => 7.6871, std. dev.: 0.0045) MultiSource/Benchmarks/nbench/nbench: 3.17% (11.2619 => 11.6184, std. dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4541, std. dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.91% (8.8259 => 9.0827, std. dev.: 0.0079) SingleSource/Benchmarks/Misc/flops-6: 2.88% (1.9199 => 1.9751, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9393, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.27% (7.9275 => 8.1071, std. dev.: 0.0143) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.55% (0.8273 => 0.8401, std. dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5084, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.29% (2.0200 => 2.0460, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.13% (1.9433 => 1.9653, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1777, std. dev.: 0.0009) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -15.37% (0.4657 => 0.3941, std. dev.: 0.0173) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.78% (0.2670 => 0.2489, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.49% (0.3511 => 0.3283, std. dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.32% (22.5627 => 21.1367, std. dev.: 0.0074) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.36% (0.6576 => 0.6355, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.35% (0.8818 => 0.8523, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/bigfib: -1.87% (0.6250 => 0.6133, std. dev.: 0.0008) MultiSource/Applications/lua/lua: -1.17% (3.7467 => 3.7027, std. dev.: 0.0012) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -10.25% (1.2308 => 1.1047, std. dev.: 0.0048) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.56% (0.3139 => 0.2933, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.91% (1.3780 => 1.3104, std. dev.: 0.0059) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9473, std. dev.: 0.0004) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -4.00% (2.5089 => 2.4086, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.67% (0.3458 => 0.3331, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.66% (1.9762 => 1.9039, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/lists: -2.19% (6.3560 => 6.2170, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/richards_benchmark: -2.14% (1.1560 => 1.1313, std. dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6920, std. dev.: 0.0016) MultiSource/Applications/minisat/minisat: -1.86% (9.3358 => 9.1623, std. dev.: 0.0058) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.82% (6.6320 => 6.5114, std. dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.74% (20.3410 => 19.9863, std. dev.: 0.0413) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3444, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9957, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.55% (3.9173 => 3.8567, std. dev.: 0.0190) MultiSource/Applications/lua/lua: -1.20% (26.5159 => 26.1988, std. dev.: 0.0231) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.66s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri May 11 13:03:50 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 11 May 2012 15:03:50 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120511200350.915C12A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/611?compare_to=610&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 611, Order: 156625, Start Time: 2012-05-11 19:07:57, End Time: 2012-05-11 20:04:33 To: 610, Order: 156621, Start Time: 2012-05-11 17:44:58, End Time: 2012-05-11 18:41:35 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (55 on baseline) Performance Improvements: 3 (31 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 888 (802 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lemon/lemon: 1.07% (1.4349 => 1.4503, std. dev.: 0.0013) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -19.31% (0.4112 => 0.3318, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -1.83% (0.5800 => 0.5694, std. dev.: 0.0006) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/bc/bc: -1.61% (0.8398 => 0.8263, std. dev.: 0.0022) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.22% (2.0176 => 2.2641, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.01% (0.3130 => 0.3318, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.79% (0.2721 => 0.2824, std. dev.: 0.0035) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.27% (3.9660 => 4.0958, std. dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.64% (0.5265 => 0.5404, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 2.57% (13.8202 => 14.1747, std. dev.: 0.0219) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.50% (0.6959 => 0.7133, std. dev.: 0.0016) MultiSource/Benchmarks/nbench/nbench: 2.36% (1.0594 => 1.0844, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.35% (0.9199 => 0.9415, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: 2.35% (0.8310 => 0.8505, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.27% (1.1364 => 1.1622, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.25% (0.5637 => 0.5764, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.20% (1.2193 => 1.2461, std. dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.10% (0.5577 => 0.5694, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.04% (1.4563 => 1.4860, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.93% (0.7710 => 0.7859, std. dev.: 0.0022) MultiSource/Applications/kimwitu++/kc: 1.87% (16.6129 => 16.9243, std. dev.: 0.0029) MultiSource/Applications/lambda-0_1_3/lambda: 1.82% (0.7038 => 0.7166, std. dev.: 0.0027) MultiSource/Applications/Burg/burg: 1.68% (1.1061 => 1.1247, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/gs/gs: 1.67% (3.8646 => 3.9290, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.64% (0.7460 => 0.7582, std. dev.: 0.0008) MultiSource/Applications/siod/siod: 1.55% (2.1791 => 2.2128, std. dev.: 0.0024) MultiSource/Applications/treecc/treecc: 1.50% (1.9270 => 1.9560, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.50% (1.3245 => 1.3444, std. dev.: 0.0008) MultiSource/Applications/hbd/hbd: 1.48% (1.3693 => 1.3895, std. dev.: 0.0025) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.43% (1.3813 => 1.4011, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.43% (1.3819 => 1.4016, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.41% (3.6692 => 3.7209, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.36% (13.2842 => 13.4648, std. dev.: 0.0053) MultiSource/Applications/SIBsim4/SIBsim4: 1.27% (1.2749 => 1.2911, std. dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: 1.26% (16.2614 => 16.4656, std. dev.: 0.0163) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.08% (3.2742 => 3.3094, std. dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.03% (1.8175 => 2.2543, std. dev.: 0.0232) SingleSource/Benchmarks/Misc/mandel-2: 7.56% (1.2998 => 1.3981, std. dev.: 0.0089) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.86% (1.5824 => 1.6751, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.79% (1.9144 => 1.9870, std. dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.74% (1.7688 => 1.8350, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: 3.62% (7.4271 => 7.6961, std. dev.: 0.0065) MultiSource/Benchmarks/nbench/nbench: 3.14% (11.2619 => 11.6156, std. dev.: 0.0026) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4537, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.93% (8.8259 => 9.0847, std. dev.: 0.0066) SingleSource/Benchmarks/Misc/flops-6: 2.91% (1.9199 => 1.9757, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9393, std. dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.28% (7.9275 => 8.1083, std. dev.: 0.0050) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/ffbench: 1.60% (0.8273 => 0.8405, std. dev.: 0.0011) MultiSource/Applications/lemon/lemon: 1.43% (1.4298 => 1.4503, std. dev.: 0.0013) MultiSource/Benchmarks/NPB-serial/is/is: 1.43% (8.3908 => 8.5108, std. dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.26% (2.0200 => 2.0455, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 1.13% (9.0760 => 9.1786, std. dev.: 0.0005) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -18.98% (0.4657 => 0.3773, std. dev.: 0.0205) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.12% (0.2670 => 0.2480, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.84% (0.3511 => 0.3271, std. dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.40% (22.5627 => 21.1187, std. dev.: 0.1758) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.25% (0.8818 => 0.8531, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.13% (0.6576 => 0.6370, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: -2.19% (0.6250 => 0.6113, std. dev.: 0.0009) MultiSource/Applications/lua/lua: -1.12% (3.7467 => 3.7047, std. dev.: 0.0038) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -10.08% (1.2308 => 1.1067, std. dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.16% (1.0460 => 0.9502, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.63% (0.3139 => 0.2931, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.90% (1.3780 => 1.3105, std. dev.: 0.0058) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9474, std. dev.: 0.0003) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -3.97% (2.5089 => 2.4093, std. dev.: 0.0030) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -3.57% (1.9762 => 1.9056, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/richards_benchmark: -2.19% (1.1560 => 1.1307, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -2.12% (6.3560 => 6.2210, std. dev.: 0.0025) MultiSource/Applications/minisat/minisat: -1.99% (9.3358 => 9.1502, std. dev.: 0.0076) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.90% (6.6320 => 6.5061, std. dev.: 0.0043) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6921, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3444, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.67% (20.3410 => 20.0022, std. dev.: 0.0605) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9956, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.30% (3.9173 => 3.8662, std. dev.: 0.0064) MultiSource/Applications/lua/lua: -1.10% (26.5159 => 26.2238, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.04% (3.8887 => 3.8482, std. dev.: 0.0048) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.89s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri May 11 14:27:17 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 11 May 2012 16:27:17 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120511212717.9212E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/612?compare_to=611&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 612, Order: 156634, Start Time: 2012-05-11 20:31:20, End Time: 2012-05-11 21:27:59 To: 611, Order: 156625, Start Time: 2012-05-11 19:07:57, End Time: 2012-05-11 20:04:33 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (65 on baseline) Performance Improvements: 0 (29 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 891 (794 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 1.32% (3.7696 => 3.8195, std. dev.: 0.0150) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.25% (2.0176 => 2.2850, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.39% (0.3130 => 0.3330, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.34% (0.2721 => 0.2839, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.82% (3.9660 => 4.1175, std. dev.: 0.0097) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.11% (0.5265 => 0.5429, std. dev.: 0.0031) MultiSource/Applications/SPASS/SPASS: 2.97% (13.8202 => 14.2311, std. dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.95% (0.6959 => 0.7164, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.82% (0.9199 => 0.9458, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 2.74% (1.0594 => 1.0884, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 2.66% (0.4328 => 0.4443, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.61% (1.2193 => 1.2511, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: 2.59% (0.8310 => 0.8525, std. dev.: 0.0072) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.51% (1.1364 => 1.1649, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.47% (0.5637 => 0.5776, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.27% (1.4563 => 1.4894, std. dev.: 0.0011) MultiSource/Applications/hbd/hbd: 2.23% (1.3693 => 1.3999, std. dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.22% (0.5577 => 0.5701, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.19% (0.7710 => 0.7879, std. dev.: 0.0018) MultiSource/Applications/kimwitu++/kc: 2.12% (16.6129 => 16.9644, std. dev.: 0.0147) MultiSource/Applications/lambda-0_1_3/lambda: 2.05% (0.7038 => 0.7182, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/gs/gs: 1.96% (3.8646 => 3.9404, std. dev.: 0.0075) MultiSource/Applications/Burg/burg: 1.93% (1.1061 => 1.1275, std. dev.: 0.0057) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.92% (0.7460 => 0.7603, std. dev.: 0.0014) MultiSource/Applications/siod/siod: 1.88% (2.1791 => 2.2200, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.83% (3.6692 => 3.7364, std. dev.: 0.0089) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.83% (1.3245 => 1.3487, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.64% (1.3819 => 1.4045, std. dev.: 0.0005) MultiSource/Applications/treecc/treecc: 1.62% (1.9270 => 1.9582, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.57% (13.2842 => 13.4930, std. dev.: 0.0199) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.54% (1.3813 => 1.4026, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.52% (2.1007 => 2.1327, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.48% (3.2742 => 3.3226, std. dev.: 0.0009) MultiSource/Applications/SIBsim4/SIBsim4: 1.41% (1.2749 => 1.2929, std. dev.: 0.0013) MultiSource/Applications/sqlite3/sqlite3: 1.27% (16.2614 => 16.4672, std. dev.: 0.0189) MultiSource/Applications/JM/lencod/lencod: 1.26% (14.8535 => 15.0409, std. dev.: 0.0105) MultiSource/Benchmarks/Bullet/bullet: 1.18% (33.2944 => 33.6884, std. dev.: 0.0179) MultiSource/Applications/JM/ldecod/ldecod: 1.05% (6.5754 => 6.6443, std. dev.: 0.0101) MultiSource/Applications/hexxagon/hexxagon: 1.02% (1.2292 => 1.2417, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.00% (7.2180 => 7.2903, std. dev.: 0.0068) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 23.97% (1.8175 => 2.2531, std. dev.: 0.0087) SingleSource/Benchmarks/Misc/mandel-2: 8.46% (1.2998 => 1.4098, std. dev.: 0.0047) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.86% (1.5824 => 1.6751, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9880, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 3.78% (7.4271 => 7.7082, std. dev.: 0.0026) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.66% (1.7688 => 1.8335, std. dev.: 0.0192) MultiSource/Benchmarks/nbench/nbench: 3.14% (11.2619 => 11.6157, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4544, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.93% (8.8259 => 9.0843, std. dev.: 0.0040) SingleSource/Benchmarks/Misc/flops-6: 2.92% (1.9199 => 1.9759, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.77% (2.8606 => 2.9398, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.22% (7.9275 => 8.1036, std. dev.: 0.0161) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.55% (0.8273 => 0.8401, std. dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.45% (8.3908 => 8.5128, std. dev.: 0.0067) MultiSource/Applications/lemon/lemon: 1.36% (1.4298 => 1.4492, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.29% (2.0200 => 2.0461, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.25% (1.9433 => 1.9676, std. dev.: 0.0005) MultiSource/Benchmarks/llubenchmark/llu: 1.23% (3.7731 => 3.8195, std. dev.: 0.0150) MultiSource/Benchmarks/sim/sim: 1.18% (5.0168 => 5.0759, std. dev.: 0.0044) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 1.10% (9.0760 => 9.1759, std. dev.: 0.0016) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -12.60% (0.4657 => 0.4070, std. dev.: 0.0215) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.44% (0.2670 => 0.2498, std. dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.27% (0.3511 => 0.3291, std. dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.10% (22.5627 => 21.1859, std. dev.: 0.0113) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.98% (0.8818 => 0.8555, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.86% (0.6576 => 0.6388, std. dev.: 0.0007) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -10.37% (1.2308 => 1.1032, std. dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.59% (0.3139 => 0.2932, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9472, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.94% (2.5089 => 2.4101, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.73% (0.3458 => 0.3329, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.64% (1.9762 => 1.9043, std. dev.: 0.0048) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.63% (1.3780 => 1.3280, std. dev.: 0.0071) SingleSource/Benchmarks/Shootout/lists: -2.18% (6.3560 => 6.2172, std. dev.: 0.0076) SingleSource/Benchmarks/Misc/richards_benchmark: -2.14% (1.1560 => 1.1313, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.94% (6.6320 => 6.5032, std. dev.: 0.0014) MultiSource/Benchmarks/mafft/pairlocalalign: -1.87% (28.2225 => 27.6936, std. dev.: 0.0028) MultiSource/Applications/minisat/minisat: -1.84% (9.3358 => 9.1639, std. dev.: 0.0293) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.81% (20.3410 => 19.9732, std. dev.: 0.0091) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3446, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9951, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.57% (3.9173 => 3.8559, std. dev.: 0.0024) MultiSource/Applications/lua/lua: -1.21% (26.5159 => 26.1939, std. dev.: 0.0193) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.05% (3.8887 => 3.8479, std. dev.: 0.0055) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.80s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri May 11 15:50:50 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 11 May 2012 17:50:50 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120511225050.ADAD52A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/613?compare_to=612&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 613, Order: 156644, Start Time: 2012-05-11 21:54:42, End Time: 2012-05-11 22:51:32 To: 612, Order: 156634, Start Time: 2012-05-11 20:31:20, End Time: 2012-05-11 21:27:59 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (53 on baseline) Performance Improvements: 1 (39 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 891 (796 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -10.12% (0.4070 => 0.3658, std. dev.: 0.0103) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.26% (2.0176 => 2.2649, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.07% (0.3130 => 0.3320, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.12% (0.2721 => 0.2833, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.19% (3.9660 => 4.0927, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.74% (0.5265 => 0.5409, std. dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 2.53% (13.8202 => 14.1698, std. dev.: 0.0096) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.41% (0.6959 => 0.7127, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.38% (0.9199 => 0.9418, std. dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/football/football: 2.36% (0.8310 => 0.8506, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 2.36% (0.4328 => 0.4430, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 2.33% (1.0594 => 1.0841, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.25% (0.5637 => 0.5764, std. dev.: 0.0022) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.21% (1.1364 => 1.1615, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.20% (1.2193 => 1.2461, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.01% (1.4563 => 1.4856, std. dev.: 0.0027) MultiSource/Applications/kimwitu++/kc: 1.70% (16.6129 => 16.8947, std. dev.: 0.0059) MultiSource/Applications/lambda-0_1_3/lambda: 1.69% (0.7038 => 0.7157, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.66% (0.7710 => 0.7838, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/gs/gs: 1.61% (3.8646 => 3.9267, std. dev.: 0.0021) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.54% (0.7460 => 0.7575, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.54% (1.3819 => 1.4032, std. dev.: 0.0013) MultiSource/Applications/hbd/hbd: 1.54% (1.3693 => 1.3904, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.50% (1.3245 => 1.3444, std. dev.: 0.0025) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.48% (1.3813 => 1.4017, std. dev.: 0.0018) MultiSource/Applications/siod/siod: 1.44% (2.1791 => 2.2105, std. dev.: 0.0007) MultiSource/Applications/Burg/burg: 1.40% (1.1061 => 1.1216, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.38% (13.2842 => 13.4680, std. dev.: 0.0055) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.31% (3.6692 => 3.7173, std. dev.: 0.0024) MultiSource/Applications/sqlite3/sqlite3: 1.10% (16.2614 => 16.4397, std. dev.: 0.0055) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.51% (1.8175 => 2.2629, std. dev.: 0.0368) SingleSource/Benchmarks/Misc/mandel-2: 8.49% (1.2998 => 1.4101, std. dev.: 0.0052) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.85% (1.5824 => 1.6750, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9877, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.71% (1.7688 => 1.8345, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: 3.55% (7.4271 => 7.6908, std. dev.: 0.0059) MultiSource/Benchmarks/nbench/nbench: 3.13% (11.2619 => 11.6141, std. dev.: 0.0051) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4546, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-6: 2.94% (1.9199 => 1.9763, std. dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.90% (8.8259 => 9.0820, std. dev.: 0.0090) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9393, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.32% (7.9275 => 8.1111, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9603, std. dev.: 0.0075) SingleSource/Benchmarks/Misc/ffbench: 1.58% (0.8273 => 0.8404, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.45% (1.4298 => 1.4505, std. dev.: 0.0011) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5094, std. dev.: 0.0092) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.25% (2.0200 => 2.0453, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1781, std. dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.11% (1.9433 => 1.9648, std. dev.: 0.0011) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -21.45% (0.4657 => 0.3658, std. dev.: 0.0103) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.67% (0.2670 => 0.2492, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.49% (0.3511 => 0.3283, std. dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.36% (22.5627 => 21.1267, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.33% (0.8818 => 0.8524, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -3.15% (0.3623 => 0.3509, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.12% (0.3650 => 0.3536, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: -3.03% (0.3601 => 0.3492, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -2.99% (0.3578 => 0.3471, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -2.97% (0.3940 => 0.3823, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-4: -2.93% (0.3646 => 0.3539, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -2.92% (0.3663 => 0.3556, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.83% (0.6576 => 0.6390, std. dev.: 0.0033) SingleSource/UnitTests/ObjC/exceptions: -2.61% (0.3914 => 0.3812, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: -2.52% (0.4003 => 0.3902, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: -1.81% (0.6250 => 0.6137, std. dev.: 0.0002) MultiSource/Applications/lua/lua: -1.23% (3.7467 => 3.7007, std. dev.: 0.0009) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -9.81% (1.2308 => 1.1101, std. dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.53% (0.3139 => 0.2934, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9475, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.83% (1.3780 => 1.3115, std. dev.: 0.0079) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -4.00% (2.5089 => 2.4085, std. dev.: 0.0025) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.68% (1.9762 => 1.9034, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout/lists: -2.24% (6.3560 => 6.2138, std. dev.: 0.0142) SingleSource/Benchmarks/Misc/richards_benchmark: -2.10% (1.1560 => 1.1317, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.94% (6.6320 => 6.5032, std. dev.: 0.0063) MultiSource/Applications/minisat/minisat: -1.94% (9.3358 => 9.1547, std. dev.: 0.0134) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6911, std. dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.73% (20.3410 => 19.9888, std. dev.: 0.0082) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3446, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9959, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.45% (3.9173 => 3.8604, std. dev.: 0.0114) MultiSource/Applications/lua/lua: -1.31% (26.5159 => 26.1695, std. dev.: 0.0204) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.45s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri May 11 17:14:06 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 11 May 2012 19:14:06 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120512001406.8CB5F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/614?compare_to=613&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 614, Order: 156655, Start Time: 2012-05-11 23:18:18, End Time: 2012-05-12 00:14:49 To: 613, Order: 156644, Start Time: 2012-05-11 21:54:42, End Time: 2012-05-11 22:51:32 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (62 on baseline) Performance Improvements: 0 (30 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (796 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.51% (2.0176 => 2.2700, std. dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.36% (0.3130 => 0.3329, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.04% (0.2721 => 0.2831, std. dev.: 0.0021) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.38% (3.9660 => 4.1002, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash2: 3.07% (0.4328 => 0.4461, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.91% (0.5265 => 0.5418, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 2.73% (13.8202 => 14.1978, std. dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.67% (0.6959 => 0.7145, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 2.52% (0.8310 => 0.8519, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 2.42% (1.0594 => 1.0850, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.41% (0.9199 => 0.9421, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.36% (1.2193 => 1.2481, std. dev.: 0.0080) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.28% (1.1364 => 1.1623, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.18% (0.5637 => 0.5760, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.14% (1.4563 => 1.4874, std. dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: 1.95% (0.7038 => 0.7175, std. dev.: 0.0007) MultiSource/Applications/kimwitu++/kc: 1.94% (16.6129 => 16.9346, std. dev.: 0.0114) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.92% (0.5577 => 0.5684, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.80% (0.7460 => 0.7594, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.73% (0.7710 => 0.7843, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 1.69% (2.1791 => 2.2159, std. dev.: 0.0067) MultiSource/Applications/hbd/hbd: 1.67% (1.3693 => 1.3921, std. dev.: 0.0027) MultiSource/Benchmarks/MallocBench/gs/gs: 1.62% (3.8646 => 3.9271, std. dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.56% (1.3245 => 1.3451, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: 1.52% (0.7061 => 0.7168, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.50% (13.2842 => 13.4837, std. dev.: 0.0144) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.44% (3.6692 => 3.7220, std. dev.: 0.0055) MultiSource/Applications/treecc/treecc: 1.41% (1.9270 => 1.9542, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.37% (1.3813 => 1.4002, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.37% (1.3819 => 1.4008, std. dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: 1.28% (1.2292 => 1.2449, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 1.27% (16.2614 => 16.4675, std. dev.: 0.0146) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.19% (3.2742 => 3.3132, std. dev.: 0.0063) MultiSource/Applications/SIBsim4/SIBsim4: 1.18% (1.2749 => 1.2900, std. dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: 1.12% (14.8535 => 15.0196, std. dev.: 0.0126) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.07% (2.1007 => 2.1232, std. dev.: 0.0071) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.00% (1.5188 => 1.5340, std. dev.: 0.0014) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 23.80% (1.8175 => 2.2500, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/mandel-2: 7.90% (1.2998 => 1.4025, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.85% (1.5824 => 1.6749, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.80% (1.9144 => 1.9872, std. dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.73% (1.7688 => 1.8347, std. dev.: 0.0173) SingleSource/Benchmarks/Misc/salsa20: 3.57% (7.4271 => 7.6922, std. dev.: 0.0037) MultiSource/Benchmarks/nbench/nbench: 3.14% (11.2619 => 11.6154, std. dev.: 0.0041) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4537, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-6: 2.90% (1.9199 => 1.9756, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9393, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.67% (8.8259 => 9.0612, std. dev.: 0.0159) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.37% (7.9275 => 8.1153, std. dev.: 0.0126) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9603, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.55% (0.8273 => 0.8401, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.48% (1.4298 => 1.4509, std. dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5097, std. dev.: 0.0081) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.28% (2.0200 => 2.0458, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.22% (1.9433 => 1.9671, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1780, std. dev.: 0.0008) MultiSource/Benchmarks/sim/sim: 1.10% (5.0168 => 5.0718, std. dev.: 0.0134) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -20.70% (0.4657 => 0.3693, std. dev.: 0.0115) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.70% (0.2670 => 0.2491, std. dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.50% (22.5627 => 21.0972, std. dev.: 0.0120) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.35% (0.3511 => 0.3288, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.28% (0.8818 => 0.8529, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.30% (0.6576 => 0.6425, std. dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/bigfib: -1.74% (0.6250 => 0.6141, std. dev.: 0.0004) MultiSource/Applications/lua/lua: -1.08% (3.7467 => 3.7061, std. dev.: 0.0104) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -10.98% (1.2308 => 1.0956, std. dev.: 0.0065) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.56% (0.3139 => 0.2933, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2642, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.16% (1.3780 => 1.3069, std. dev.: 0.0056) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9475, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -4.01% (2.5089 => 2.4083, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.76% (0.3458 => 0.3328, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: -3.60% (1.9762 => 1.9051, std. dev.: 0.0089) SingleSource/Benchmarks/Shootout/lists: -2.29% (6.3560 => 6.2107, std. dev.: 0.0086) SingleSource/Benchmarks/Misc/richards_benchmark: -2.15% (1.1560 => 1.1312, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.98% (20.3410 => 19.9380, std. dev.: 0.0272) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.92% (6.6320 => 6.5047, std. dev.: 0.0042) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6912, std. dev.: 0.0019) MultiSource/Applications/minisat/minisat: -1.85% (9.3358 => 9.1631, std. dev.: 0.0267) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3446, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9955, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.46% (3.9173 => 3.8601, std. dev.: 0.0071) MultiSource/Applications/lua/lua: -1.30% (26.5159 => 26.1700, std. dev.: 0.0280) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.57s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri May 11 18:37:26 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 11 May 2012 20:37:26 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120512013726.E58BA2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/615?compare_to=614&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 615, Order: 156666, Start Time: 2012-05-12 00:41:34, End Time: 2012-05-12 01:38:09 To: 614, Order: 156655, Start Time: 2012-05-11 23:18:18, End Time: 2012-05-12 00:14:49 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (62 on baseline) Performance Improvements: 0 (30 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (796 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.39% (2.0176 => 2.2676, std. dev.: 0.0153) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.13% (0.3130 => 0.3322, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.23% (0.2721 => 0.2836, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.45% (3.9660 => 4.1028, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.96% (0.5265 => 0.5421, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.89% (0.6959 => 0.7160, std. dev.: 0.0030) MultiSource/Applications/SPASS/SPASS: 2.77% (13.8202 => 14.2024, std. dev.: 0.0125) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.59% (0.9199 => 0.9437, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.45% (0.7710 => 0.7899, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.44% (1.2193 => 1.2490, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 2.41% (0.8310 => 0.8510, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.40% (1.1364 => 1.1637, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 2.38% (1.0594 => 1.0846, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.34% (0.5637 => 0.5769, std. dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 2.18% (16.6129 => 16.9751, std. dev.: 0.0127) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.99% (0.5577 => 0.5688, std. dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 1.99% (0.7038 => 0.7178, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.98% (1.4563 => 1.4852, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/gs/gs: 1.90% (3.8646 => 3.9381, std. dev.: 0.0068) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.81% (0.7460 => 0.7595, std. dev.: 0.0010) MultiSource/Applications/siod/siod: 1.79% (2.1791 => 2.2180, std. dev.: 0.0013) MultiSource/Applications/Burg/burg: 1.75% (1.1061 => 1.1255, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.72% (1.3245 => 1.3473, std. dev.: 0.0015) MultiSource/Applications/hbd/hbd: 1.70% (1.3693 => 1.3926, std. dev.: 0.0055) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.61% (1.3819 => 1.4042, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.59% (13.2842 => 13.4952, std. dev.: 0.0086) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.59% (3.6692 => 3.7274, std. dev.: 0.0023) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.58% (1.3813 => 1.4031, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 1.50% (1.9270 => 1.9560, std. dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: 1.25% (16.2614 => 16.4649, std. dev.: 0.0103) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.22% (1.5188 => 1.5374, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 1.22% (1.2292 => 1.2442, std. dev.: 0.0006) MultiSource/Applications/JM/lencod/lencod: 1.16% (14.8535 => 15.0258, std. dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.15% (3.2742 => 3.3120, std. dev.: 0.0023) MultiSource/Applications/SIBsim4/SIBsim4: 1.07% (1.2749 => 1.2885, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.00% (7.2180 => 7.2905, std. dev.: 0.0029) MultiSource/Benchmarks/Bullet/bullet: 1.00% (33.2944 => 33.6287, std. dev.: 0.0157) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.26% (1.8175 => 2.2584, std. dev.: 0.0562) SingleSource/Benchmarks/Misc/mandel-2: 8.34% (1.2998 => 1.4082, std. dev.: 0.0077) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.87% (1.5824 => 1.6753, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9881, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.69% (1.7688 => 1.8341, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: 3.55% (7.4271 => 7.6911, std. dev.: 0.0032) MultiSource/Benchmarks/nbench/nbench: 3.14% (11.2619 => 11.6155, std. dev.: 0.0023) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4553, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: 2.84% (1.9199 => 1.9744, std. dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.80% (8.8259 => 9.0727, std. dev.: 0.0173) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9394, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.44% (7.9275 => 8.1209, std. dev.: 0.0184) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.60% (0.8273 => 0.8405, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.45% (1.4298 => 1.4506, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5098, std. dev.: 0.0080) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.28% (2.0200 => 2.0459, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.17% (1.9433 => 1.9660, std. dev.: 0.0014) MultiSource/Benchmarks/sim/sim: 1.15% (5.0168 => 5.0743, std. dev.: 0.0097) SingleSource/Benchmarks/Misc/flops: 1.11% (9.0760 => 9.1765, std. dev.: 0.0010) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -20.08% (0.4657 => 0.3722, std. dev.: 0.0044) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.38% (0.3511 => 0.3287, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.33% (0.2670 => 0.2501, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.31% (22.5627 => 21.1396, std. dev.: 0.0189) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.27% (0.8818 => 0.8530, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.20% (0.6576 => 0.6431, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: -1.74% (0.6250 => 0.6141, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -10.41% (1.2308 => 1.1027, std. dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.16% (1.0460 => 0.9502, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.53% (0.3139 => 0.2934, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9474, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.64% (1.3780 => 1.3140, std. dev.: 0.0047) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -4.03% (2.5089 => 2.4078, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.66% (1.9762 => 1.9038, std. dev.: 0.0042) SingleSource/Benchmarks/Shootout/lists: -2.31% (6.3560 => 6.2094, std. dev.: 0.0054) SingleSource/Benchmarks/Misc/richards_benchmark: -2.14% (1.1560 => 1.1313, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.04% (20.3410 => 19.9256, std. dev.: 0.0410) MultiSource/Applications/minisat/minisat: -1.95% (9.3358 => 9.1542, std. dev.: 0.0187) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.93% (6.6320 => 6.5039, std. dev.: 0.0043) MultiSource/Benchmarks/mafft/pairlocalalign: -1.87% (28.2225 => 27.6954, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9955, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.56% (0.9692 => 0.9541, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.45% (3.9173 => 3.8605, std. dev.: 0.0078) MultiSource/Applications/lua/lua: -1.28% (26.5159 => 26.1752, std. dev.: 0.0268) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.00% (3.8887 => 3.8498, std. dev.: 0.0004) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.08s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri May 11 20:00:47 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 11 May 2012 22:00:47 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120512030047.869D92A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/616?compare_to=615&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 616, Order: 156689, Start Time: 2012-05-12 02:04:57, End Time: 2012-05-12 03:01:29 To: 615, Order: 156666, Start Time: 2012-05-12 00:41:34, End Time: 2012-05-12 01:38:09 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (64 on baseline) Performance Improvements: 0 (28 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (796 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.97% (2.0176 => 2.2793, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.20% (0.3130 => 0.3324, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.48% (0.2721 => 0.2843, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.52% (3.9660 => 4.1058, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.19% (0.5265 => 0.5433, std. dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.13% (0.6959 => 0.7177, std. dev.: 0.0044) MultiSource/Applications/SPASS/SPASS: 2.92% (13.8202 => 14.2240, std. dev.: 0.0159) SingleSource/Benchmarks/Shootout-C++/hash2: 2.91% (0.4328 => 0.4454, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 2.48% (0.8310 => 0.8516, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.47% (0.9199 => 0.9426, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.41% (1.2193 => 1.2487, std. dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 2.39% (1.0594 => 1.0847, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.38% (0.5637 => 0.5771, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.35% (1.1364 => 1.1631, std. dev.: 0.0028) MultiSource/Applications/kimwitu++/kc: 2.13% (16.6129 => 16.9663, std. dev.: 0.0134) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.09% (1.4563 => 1.4868, std. dev.: 0.0043) MultiSource/Applications/lambda-0_1_3/lambda: 2.07% (0.7038 => 0.7184, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.04% (0.7710 => 0.7867, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.03% (0.5577 => 0.5690, std. dev.: 0.0031) MultiSource/Benchmarks/MallocBench/gs/gs: 1.88% (3.8646 => 3.9374, std. dev.: 0.0050) MultiSource/Applications/siod/siod: 1.85% (2.1791 => 2.2194, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.77% (0.7460 => 0.7592, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.77% (1.3245 => 1.3479, std. dev.: 0.0015) MultiSource/Applications/Burg/burg: 1.72% (1.1061 => 1.1251, std. dev.: 0.0016) MultiSource/Applications/hbd/hbd: 1.66% (1.3693 => 1.3920, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.62% (13.2842 => 13.4998, std. dev.: 0.0095) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.60% (1.3819 => 1.4040, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.56% (3.6692 => 3.7265, std. dev.: 0.0032) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.54% (1.3813 => 1.4026, std. dev.: 0.0000) MultiSource/Applications/treecc/treecc: 1.54% (1.9270 => 1.9567, std. dev.: 0.0036) MultiSource/Applications/sqlite3/sqlite3: 1.39% (16.2614 => 16.4879, std. dev.: 0.0098) MultiSource/Applications/SIBsim4/SIBsim4: 1.22% (1.2749 => 1.2905, std. dev.: 0.0018) MultiSource/Applications/JM/lencod/lencod: 1.20% (14.8535 => 15.0323, std. dev.: 0.0147) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.19% (2.1007 => 2.1258, std. dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 1.19% (1.2292 => 1.2438, std. dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.13% (3.2742 => 3.3113, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.07% (7.2180 => 7.2949, std. dev.: 0.0098) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.05% (1.5188 => 1.5347, std. dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 1.03% (6.5754 => 6.6434, std. dev.: 0.0008) MultiSource/Benchmarks/Bullet/bullet: 1.01% (33.2944 => 33.6291, std. dev.: 0.0062) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 23.93% (1.8175 => 2.2525, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/mandel-2: 6.81% (1.2998 => 1.3883, std. dev.: 0.0115) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.91% (1.5824 => 1.6759, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 3.81% (1.9144 => 1.9874, std. dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.72% (1.7688 => 1.8346, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: 3.59% (7.4271 => 7.6939, std. dev.: 0.0106) MultiSource/Benchmarks/nbench/nbench: 3.12% (11.2619 => 11.6131, std. dev.: 0.0065) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4542, std. dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.90% (8.8259 => 9.0822, std. dev.: 0.0175) SingleSource/Benchmarks/Misc/flops-6: 2.85% (1.9199 => 1.9747, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9393, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.60% (7.9275 => 8.1335, std. dev.: 0.0091) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.56% (0.8273 => 0.8402, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.48% (1.4298 => 1.4510, std. dev.: 0.0035) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5088, std. dev.: 0.0078) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.27% (2.0200 => 2.0457, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: 1.16% (5.0168 => 5.0749, std. dev.: 0.0110) SingleSource/Benchmarks/Misc/flops: 1.13% (9.0760 => 9.1783, std. dev.: 0.0012) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -20.21% (0.4657 => 0.3716, std. dev.: 0.0086) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.48% (0.2670 => 0.2497, std. dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.17% (22.5627 => 21.1717, std. dev.: 0.0076) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.67% (0.3511 => 0.3312, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.31% (0.8818 => 0.8526, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: -1.73% (0.6250 => 0.6142, std. dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -10.80% (1.2308 => 1.0979, std. dev.: 0.0080) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.56% (0.3139 => 0.2933, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9473, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.61% (1.3780 => 1.3145, std. dev.: 0.0036) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -3.95% (2.5089 => 2.4098, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: -3.66% (1.9762 => 1.9038, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.64% (0.3458 => 0.3332, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: -2.14% (1.1560 => 1.1313, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: -2.12% (9.3358 => 9.1377, std. dev.: 0.0170) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.98% (6.6320 => 6.5006, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout/lists: -1.91% (6.3560 => 6.2348, std. dev.: 0.0092) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.91% (20.3410 => 19.9533, std. dev.: 0.0500) MultiSource/Benchmarks/mafft/pairlocalalign: -1.89% (28.2225 => 27.6904, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3444, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9954, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.56% (0.9692 => 0.9541, std. dev.: 0.0006) MultiSource/Applications/lua/lua: -1.21% (26.5159 => 26.1952, std. dev.: 0.0395) SingleSource/Benchmarks/Shootout/heapsort: -1.13% (3.9173 => 3.8732, std. dev.: 0.0050) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.59s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri May 11 21:24:13 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 11 May 2012 23:24:13 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120512042413.0917E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/617?compare_to=616&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 617, Order: 156690, Start Time: 2012-05-12 03:28:18, End Time: 2012-05-12 04:24:55 To: 616, Order: 156689, Start Time: 2012-05-12 02:04:57, End Time: 2012-05-12 03:01:29 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (64 on baseline) Performance Improvements: 0 (29 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (795 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.91% (2.0176 => 2.2780, std. dev.: 0.0178) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.23% (0.3130 => 0.3325, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.37% (0.2721 => 0.2840, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.52% (3.9660 => 4.1056, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.10% (0.5265 => 0.5428, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 2.93% (0.4328 => 0.4455, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 2.88% (13.8202 => 14.2183, std. dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.86% (0.6959 => 0.7158, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.65% (0.5577 => 0.5725, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/football/football: 2.60% (0.8310 => 0.8526, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.57% (0.9199 => 0.9435, std. dev.: 0.0021) MultiSource/Benchmarks/nbench/nbench: 2.55% (1.0594 => 1.0864, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.49% (1.1364 => 1.1647, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.47% (0.5637 => 0.5776, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.39% (1.2193 => 1.2485, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.20% (1.4563 => 1.4883, std. dev.: 0.0048) MultiSource/Applications/kimwitu++/kc: 2.20% (16.6129 => 16.9779, std. dev.: 0.0128) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.08% (0.7710 => 0.7870, std. dev.: 0.0014) MultiSource/Applications/lambda-0_1_3/lambda: 2.07% (0.7038 => 0.7184, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/gs/gs: 1.89% (3.8646 => 3.9376, std. dev.: 0.0089) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.88% (0.7460 => 0.7600, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.80% (1.3245 => 1.3483, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.78% (13.2842 => 13.5205, std. dev.: 0.0097) MultiSource/Applications/Burg/burg: 1.70% (1.1061 => 1.1249, std. dev.: 0.0031) MultiSource/Applications/hbd/hbd: 1.59% (1.3693 => 1.3911, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.58% (1.3819 => 1.4038, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.56% (3.6692 => 3.7266, std. dev.: 0.0127) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.54% (1.3813 => 1.4026, std. dev.: 0.0036) MultiSource/Applications/treecc/treecc: 1.45% (1.9270 => 1.9550, std. dev.: 0.0015) MultiSource/Applications/SIBsim4/SIBsim4: 1.35% (1.2749 => 1.2921, std. dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: 1.34% (16.2614 => 16.4795, std. dev.: 0.0203) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.26% (2.1007 => 2.1271, std. dev.: 0.0012) MultiSource/Applications/JM/lencod/lencod: 1.22% (14.8535 => 15.0345, std. dev.: 0.0208) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.18% (3.2742 => 3.3128, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.14% (1.5188 => 1.5361, std. dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: 1.13% (6.5754 => 6.6496, std. dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.13% (7.2180 => 7.2994, std. dev.: 0.0053) MultiSource/Applications/hexxagon/hexxagon: 1.07% (1.2292 => 1.2423, std. dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: 1.05% (33.2944 => 33.6441, std. dev.: 0.0100) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 23.88% (1.8175 => 2.2515, std. dev.: 0.0040) SingleSource/Benchmarks/Misc/mandel-2: 7.48% (1.2998 => 1.3970, std. dev.: 0.0122) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.86% (1.5824 => 1.6752, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8146, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.80% (1.9144 => 1.9872, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.69% (1.7688 => 1.8341, std. dev.: 0.0056) SingleSource/Benchmarks/Misc/salsa20: 3.67% (7.4271 => 7.6994, std. dev.: 0.0034) MultiSource/Benchmarks/nbench/nbench: 3.13% (11.2619 => 11.6142, std. dev.: 0.0042) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4536, std. dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.87% (8.8259 => 9.0788, std. dev.: 0.0086) SingleSource/Benchmarks/Misc/flops-6: 2.85% (1.9199 => 1.9747, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9393, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.26% (7.9275 => 8.1067, std. dev.: 0.0140) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.57% (0.8273 => 0.8403, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: 1.54% (1.9290 => 1.9587, std. dev.: 0.0008) MultiSource/Applications/lemon/lemon: 1.41% (1.4298 => 1.4499, std. dev.: 0.0009) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5085, std. dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.29% (2.0200 => 2.0461, std. dev.: 0.0020) MultiSource/Benchmarks/Olden/bisort/bisort: 1.21% (0.8239 => 0.8339, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1773, std. dev.: 0.0008) MultiSource/Benchmarks/sim/sim: 1.01% (5.0168 => 5.0674, std. dev.: 0.0140) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -19.73% (0.4657 => 0.3738, std. dev.: 0.0203) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.52% (0.2670 => 0.2496, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.23% (22.5627 => 21.1570, std. dev.: 0.0049) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.70% (0.3511 => 0.3311, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.28% (0.8818 => 0.8529, std. dev.: 0.0039) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.45% (0.6576 => 0.6415, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: -1.74% (0.6250 => 0.6141, std. dev.: 0.0005) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -10.22% (1.2308 => 1.1050, std. dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.16% (1.0460 => 0.9502, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.63% (0.3139 => 0.2931, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.20% (1.3780 => 1.3063, std. dev.: 0.0141) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9473, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -4.01% (2.5089 => 2.4083, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.73% (0.3458 => 0.3329, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.61% (1.9762 => 1.9048, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -2.36% (6.3560 => 6.2058, std. dev.: 0.0159) SingleSource/Benchmarks/Misc/richards_benchmark: -2.19% (1.1560 => 1.1307, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.98% (6.6320 => 6.5005, std. dev.: 0.0046) MultiSource/Applications/minisat/minisat: -1.93% (9.3358 => 9.1560, std. dev.: 0.0464) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6920, std. dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.87% (20.3410 => 19.9614, std. dev.: 0.0530) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9955, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) MultiSource/Applications/lua/lua: -1.36% (26.5159 => 26.1563, std. dev.: 0.0168) SingleSource/Benchmarks/Shootout/heapsort: -1.31% (3.9173 => 3.8661, std. dev.: 0.0067) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.26s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri May 11 22:47:25 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 12 May 2012 00:47:25 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120512054725.0B6902A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/618?compare_to=617&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 618, Order: 156697, Start Time: 2012-05-12 04:51:38, End Time: 2012-05-12 05:48:07 To: 617, Order: 156690, Start Time: 2012-05-12 03:28:18, End Time: 2012-05-12 04:24:55 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (59 on baseline) Performance Improvements: 0 (30 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (799 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.81% (2.0176 => 2.2760, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.10% (0.3130 => 0.3321, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.15% (0.2721 => 0.2834, std. dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.50% (3.9660 => 4.1048, std. dev.: 0.0044) MultiSource/Applications/SPASS/SPASS: 2.89% (13.8202 => 14.2200, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.87% (0.5265 => 0.5416, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 2.66% (0.4328 => 0.4443, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.54% (0.6959 => 0.7136, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 2.52% (0.8310 => 0.8519, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.48% (0.9199 => 0.9427, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 2.47% (1.0594 => 1.0856, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.46% (1.1364 => 1.1643, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.42% (1.2193 => 1.2488, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.39% (0.5637 => 0.5772, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.97% (0.5577 => 0.5687, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.94% (1.4563 => 1.4846, std. dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: 1.81% (16.6129 => 16.9138, std. dev.: 0.0171) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.79% (0.7710 => 0.7848, std. dev.: 0.0016) MultiSource/Applications/lambda-0_1_3/lambda: 1.68% (0.7038 => 0.7156, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.66% (13.2842 => 13.5046, std. dev.: 0.0175) MultiSource/Benchmarks/MallocBench/gs/gs: 1.66% (3.8646 => 3.9286, std. dev.: 0.0084) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.65% (0.7460 => 0.7583, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.58% (1.3245 => 1.3454, std. dev.: 0.0052) MultiSource/Applications/Burg/burg: 1.55% (1.1061 => 1.1232, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.50% (3.6692 => 3.7244, std. dev.: 0.0024) MultiSource/Applications/hbd/hbd: 1.50% (1.3693 => 1.3898, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.48% (1.3819 => 1.4024, std. dev.: 0.0011) MultiSource/Applications/siod/siod: 1.40% (2.1791 => 2.2096, std. dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 1.37% (1.2749 => 1.2924, std. dev.: 0.0014) MultiSource/Applications/treecc/treecc: 1.30% (1.9270 => 1.9520, std. dev.: 0.0040) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.27% (1.3813 => 1.3989, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.22% (3.2742 => 3.3142, std. dev.: 0.0025) MultiSource/Applications/sqlite3/sqlite3: 1.21% (16.2614 => 16.4588, std. dev.: 0.0142) MultiSource/Applications/JM/lencod/lencod: 1.15% (14.8535 => 15.0242, std. dev.: 0.0055) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.06% (2.1007 => 2.1230, std. dev.: 0.0012) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.02% (1.8175 => 2.2540, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/mandel-2: 8.04% (1.2998 => 1.4043, std. dev.: 0.0043) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6754, std. dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9877, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.67% (1.7688 => 1.8337, std. dev.: 0.0187) SingleSource/Benchmarks/Misc/salsa20: 3.62% (7.4271 => 7.6962, std. dev.: 0.0034) MultiSource/Benchmarks/nbench/nbench: 3.13% (11.2619 => 11.6144, std. dev.: 0.0028) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4540, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-6: 2.93% (1.9199 => 1.9762, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.90% (8.8259 => 9.0815, std. dev.: 0.0087) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9394, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.03% (7.9275 => 8.0881, std. dev.: 0.0241) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/ffbench: 1.55% (0.8273 => 0.8401, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.43% (1.4298 => 1.4502, std. dev.: 0.0008) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5082, std. dev.: 0.0091) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.28% (2.0200 => 2.0458, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 1.18% (5.0168 => 5.0758, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 1.13% (9.0760 => 9.1782, std. dev.: 0.0011) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -19.20% (0.4657 => 0.3763, std. dev.: 0.0065) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.74% (0.2670 => 0.2490, std. dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.35% (22.5627 => 21.1305, std. dev.: 0.0098) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.95% (0.3511 => 0.3302, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.11% (0.8818 => 0.8544, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.52% (0.6576 => 0.6410, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: -1.73% (0.6250 => 0.6142, std. dev.: 0.0001) MultiSource/Applications/lua/lua: -1.09% (3.7467 => 3.7060, std. dev.: 0.0034) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -10.47% (1.2308 => 1.1019, std. dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.16% (1.0460 => 0.9502, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.56% (0.3139 => 0.2933, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9474, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.38% (1.3780 => 1.3176, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -4.14% (2.5089 => 2.4051, std. dev.: 0.0025) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -3.68% (1.9762 => 1.9035, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/lists: -2.25% (6.3560 => 6.2128, std. dev.: 0.0087) SingleSource/Benchmarks/Misc/richards_benchmark: -2.14% (1.1560 => 1.1313, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.95% (6.6320 => 6.5028, std. dev.: 0.0048) MultiSource/Applications/minisat/minisat: -1.94% (9.3358 => 9.1551, std. dev.: 0.0322) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.90% (20.3410 => 19.9541, std. dev.: 0.0859) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6931, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9955, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.56% (0.9692 => 0.9541, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.49% (3.9173 => 3.8590, std. dev.: 0.0041) MultiSource/Applications/lua/lua: -1.25% (26.5159 => 26.1841, std. dev.: 0.0223) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.66s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat May 12 01:35:36 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 12 May 2012 03:35:36 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120512083536.853372A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/619?compare_to=618&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 619, Order: 156700, Start Time: 2012-05-12 07:39:22, End Time: 2012-05-12 08:36:17 To: 618, Order: 156697, Start Time: 2012-05-12 04:51:38, End Time: 2012-05-12 05:48:07 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (57 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (791 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.13% (2.0176 => 2.2825, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.74% (0.3130 => 0.3341, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.30% (0.2721 => 0.2838, std. dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.34% (3.9660 => 4.0985, std. dev.: 0.0016) MultiSource/Applications/SPASS/SPASS: 2.83% (13.8202 => 14.2113, std. dev.: 0.0163) MultiSource/Benchmarks/nbench/nbench: 2.69% (1.0594 => 1.0879, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.68% (0.5265 => 0.5406, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.67% (0.6959 => 0.7145, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.57% (1.1364 => 1.1656, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.52% (0.9199 => 0.9431, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/football/football: 2.45% (0.8310 => 0.8514, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.36% (1.4563 => 1.4907, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.36% (0.5637 => 0.5770, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.35% (1.2193 => 1.2480, std. dev.: 0.0045) MultiSource/Applications/siod/siod: 1.97% (2.1791 => 2.2221, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.94% (0.5577 => 0.5685, std. dev.: 0.0018) MultiSource/Applications/kimwitu++/kc: 1.92% (16.6129 => 16.9323, std. dev.: 0.0066) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.85% (0.7710 => 0.7853, std. dev.: 0.0018) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.84% (0.7460 => 0.7597, std. dev.: 0.0006) MultiSource/Applications/Burg/burg: 1.83% (1.1061 => 1.1263, std. dev.: 0.0042) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.68% (1.3819 => 1.4051, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.65% (13.2842 => 13.5040, std. dev.: 0.0084) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.64% (1.3813 => 1.4040, std. dev.: 0.0018) MultiSource/Applications/lambda-0_1_3/lambda: 1.62% (0.7038 => 0.7152, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/gs/gs: 1.59% (3.8646 => 3.9262, std. dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.55% (1.3245 => 1.3450, std. dev.: 0.0010) MultiSource/Applications/treecc/treecc: 1.44% (1.9270 => 1.9547, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.38% (3.6692 => 3.7199, std. dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.27% (3.2742 => 3.3157, std. dev.: 0.0149) MultiSource/Applications/SIBsim4/SIBsim4: 1.16% (1.2749 => 1.2897, std. dev.: 0.0026) MultiSource/Applications/JM/lencod/lencod: 1.15% (14.8535 => 15.0239, std. dev.: 0.0025) MultiSource/Applications/sqlite3/sqlite3: 1.14% (16.2614 => 16.4474, std. dev.: 0.0094) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.06% (1.8175 => 2.2547, std. dev.: 0.0101) SingleSource/Benchmarks/Misc/mandel-2: 8.19% (1.2998 => 1.4062, std. dev.: 0.0060) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.90% (1.5824 => 1.6757, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8142, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.78% (1.9144 => 1.9867, std. dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.65% (1.7688 => 1.8333, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/salsa20: 3.55% (7.4271 => 7.6904, std. dev.: 0.0094) MultiSource/Benchmarks/nbench/nbench: 3.17% (11.2619 => 11.6192, std. dev.: 0.0013) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4536, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-6: 2.92% (1.9199 => 1.9760, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.76% (2.8606 => 2.9395, std. dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.50% (8.8259 => 9.0469, std. dev.: 0.0288) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.18% (7.9275 => 8.1005, std. dev.: 0.0098) SingleSource/Benchmarks/Misc/ffbench: 1.60% (0.8273 => 0.8405, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: 1.47% (1.9290 => 1.9573, std. dev.: 0.0014) MultiSource/Applications/lemon/lemon: 1.42% (1.4298 => 1.4501, std. dev.: 0.0012) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5086, std. dev.: 0.0031) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.26% (2.0200 => 2.0455, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.19% (1.9433 => 1.9665, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1776, std. dev.: 0.0016) MultiSource/Benchmarks/sim/sim: 1.02% (5.0168 => 5.0679, std. dev.: 0.0131) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.82% (0.2670 => 0.2488, std. dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.19% (22.5627 => 21.1669, std. dev.: 0.0201) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.10% (0.3511 => 0.3297, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.22% (0.6576 => 0.6364, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.20% (0.8818 => 0.8536, std. dev.: 0.0043) SingleSource/UnitTests/ObjC/exceptions-3: -3.17% (0.3623 => 0.3508, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -3.11% (0.3601 => 0.3489, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -2.99% (0.3940 => 0.3822, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -2.99% (0.3650 => 0.3541, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/synchronized: -2.98% (0.3663 => 0.3554, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -2.96% (0.3646 => 0.3538, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -2.85% (0.3789 => 0.3681, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: -2.79% (0.3578 => 0.3478, std. dev.: 0.0030) SingleSource/UnitTests/ObjC/exceptions: -2.73% (0.3914 => 0.3807, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -2.60% (0.4003 => 0.3899, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: -2.08% (0.6250 => 0.6120, std. dev.: 0.0010) MultiSource/Applications/lua/lua: -1.08% (3.7467 => 3.7063, std. dev.: 0.0081) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -10.70% (1.2308 => 1.0991, std. dev.: 0.0072) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.53% (0.3139 => 0.2934, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9473, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.09% (1.3780 => 1.3217, std. dev.: 0.0044) SingleSource/Benchmarks/Dhrystone/dry: -4.02% (2.5089 => 2.4080, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.67% (0.3458 => 0.3331, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.59% (1.9762 => 1.9053, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -2.16% (6.3560 => 6.2184, std. dev.: 0.0138) SingleSource/Benchmarks/Misc/richards_benchmark: -2.15% (1.1560 => 1.1311, std. dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.05% (0.4867 => 0.4767, std. dev.: 0.0017) MultiSource/Applications/minisat/minisat: -1.98% (9.3358 => 9.1506, std. dev.: 0.0103) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.96% (6.6320 => 6.5019, std. dev.: 0.0062) MultiSource/Benchmarks/mafft/pairlocalalign: -1.87% (28.2225 => 27.6951, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.79% (20.3410 => 19.9776, std. dev.: 0.0097) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3446, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9953, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.47% (3.9173 => 3.8596, std. dev.: 0.0048) MultiSource/Applications/lua/lua: -1.32% (26.5159 => 26.1670, std. dev.: 0.0250) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.52s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat May 12 03:01:34 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 12 May 2012 05:01:34 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120512100134.7EC272A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/620?compare_to=619&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 620, Order: 156703, Start Time: 2012-05-12 09:05:38, End Time: 2012-05-12 10:02:16 To: 619, Order: 156700, Start Time: 2012-05-12 07:39:22, End Time: 2012-05-12 08:36:17 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (59 on baseline) Performance Improvements: 0 (42 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (787 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.37% (2.0176 => 2.2873, std. dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.68% (0.3130 => 0.3339, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.30% (0.2721 => 0.2838, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.38% (3.9660 => 4.1001, std. dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.81% (0.5265 => 0.5413, std. dev.: 0.0014) MultiSource/Applications/SPASS/SPASS: 2.78% (13.8202 => 14.2047, std. dev.: 0.0116) MultiSource/Benchmarks/nbench/nbench: 2.63% (1.0594 => 1.0873, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 2.61% (0.8310 => 0.8527, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.54% (0.6959 => 0.7136, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.34% (0.9199 => 0.9414, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.28% (1.2193 => 1.2471, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.18% (1.1364 => 1.1612, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.13% (0.5637 => 0.5757, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.09% (1.4563 => 1.4867, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.86% (0.5577 => 0.5681, std. dev.: 0.0012) MultiSource/Applications/kimwitu++/kc: 1.84% (16.6129 => 16.9182, std. dev.: 0.0080) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.77% (1.3819 => 1.4064, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.72% (13.2842 => 13.5127, std. dev.: 0.0064) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.71% (1.3813 => 1.4049, std. dev.: 0.0021) MultiSource/Applications/lambda-0_1_3/lambda: 1.65% (0.7038 => 0.7154, std. dev.: 0.0007) MultiSource/Applications/Burg/burg: 1.65% (1.1061 => 1.1243, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/gs/gs: 1.61% (3.8646 => 3.9269, std. dev.: 0.0037) MultiSource/Applications/siod/siod: 1.57% (2.1791 => 2.2134, std. dev.: 0.0019) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.54% (0.7460 => 0.7575, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.51% (1.3245 => 1.3445, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.49% (0.7710 => 0.7825, std. dev.: 0.0026) MultiSource/Applications/treecc/treecc: 1.47% (1.9270 => 1.9554, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.37% (3.6692 => 3.7195, std. dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.26% (2.1007 => 2.1271, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.23% (3.2742 => 3.3146, std. dev.: 0.0112) MultiSource/Applications/hbd/hbd: 1.22% (1.3693 => 1.3860, std. dev.: 0.0010) MultiSource/Applications/SIBsim4/SIBsim4: 1.22% (1.2749 => 1.2904, std. dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: 1.15% (16.2614 => 16.4477, std. dev.: 0.0046) MultiSource/Applications/JM/lencod/lencod: 1.09% (14.8535 => 15.0158, std. dev.: 0.0045) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.03% (1.8175 => 2.2543, std. dev.: 0.0129) SingleSource/Benchmarks/Misc/mandel-2: 7.97% (1.2998 => 1.4034, std. dev.: 0.0088) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.86% (1.5824 => 1.6751, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8146, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9875, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.71% (1.7688 => 1.8345, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/salsa20: 3.63% (7.4271 => 7.6966, std. dev.: 0.0022) MultiSource/Benchmarks/nbench/nbench: 3.13% (11.2619 => 11.6142, std. dev.: 0.0017) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4544, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-6: 2.91% (1.9199 => 1.9757, std. dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.76% (8.8259 => 9.0695, std. dev.: 0.0071) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9392, std. dev.: 0.0095) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.57% (7.9275 => 8.1314, std. dev.: 0.0040) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9603, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/ffbench: 1.60% (0.8273 => 0.8405, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5092, std. dev.: 0.0005) MultiSource/Benchmarks/sim/sim: 1.39% (5.0168 => 5.0865, std. dev.: 0.0081) MultiSource/Applications/lemon/lemon: 1.37% (1.4298 => 1.4494, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.25% (2.0200 => 2.0453, std. dev.: 0.0032) MultiSource/Benchmarks/Olden/bisort/bisort: 1.24% (0.8239 => 0.8341, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1773, std. dev.: 0.0007) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -16.68% (0.4657 => 0.3880, std. dev.: 0.0187) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.67% (0.2670 => 0.2492, std. dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.21% (22.5627 => 21.1605, std. dev.: 0.0120) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.41% (0.3511 => 0.3321, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.18% (0.8818 => 0.8538, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-3: -3.17% (0.3623 => 0.3508, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.12% (0.3650 => 0.3536, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-2: -3.08% (0.3601 => 0.3490, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.03% (0.6576 => 0.6377, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/trivial-interface: -2.96% (0.3578 => 0.3472, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -2.96% (0.3646 => 0.3538, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -2.94% (0.3940 => 0.3824, std. dev.: 0.0024) SingleSource/UnitTests/ObjC/for-in: -2.88% (0.3789 => 0.3680, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -2.81% (0.3663 => 0.3560, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -2.71% (0.3914 => 0.3808, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -2.70% (0.4003 => 0.3895, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: -2.10% (0.6250 => 0.6119, std. dev.: 0.0003) MultiSource/Applications/lua/lua: -1.07% (3.7467 => 3.7066, std. dev.: 0.0069) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -10.83% (1.2308 => 1.0975, std. dev.: 0.0081) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.16% (1.0460 => 0.9502, std. dev.: 0.0013) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.53% (0.3139 => 0.2934, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9475, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.63% (1.3780 => 1.3142, std. dev.: 0.0068) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.99% (2.5089 => 2.4089, std. dev.: 0.0010) MultiSource/Benchmarks/Olden/bh/bh: -3.75% (1.9762 => 1.9021, std. dev.: 0.0052) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.67% (0.3458 => 0.3331, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -2.21% (6.3560 => 6.2156, std. dev.: 0.0112) SingleSource/Benchmarks/Misc/richards_benchmark: -2.14% (1.1560 => 1.1313, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.96% (6.6320 => 6.5022, std. dev.: 0.0031) MultiSource/Applications/minisat/minisat: -1.89% (9.3358 => 9.1592, std. dev.: 0.0025) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6916, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.62% (20.3410 => 20.0113, std. dev.: 0.0557) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9951, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) MultiSource/Applications/lua/lua: -1.42% (26.5159 => 26.1398, std. dev.: 0.0556) SingleSource/Benchmarks/Shootout/heapsort: -1.37% (3.9173 => 3.8635, std. dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.05% (3.8887 => 3.8480, std. dev.: 0.0036) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.02% (2.5254 => 2.4996, std. dev.: 0.0033) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.48s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat May 12 05:15:51 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 12 May 2012 07:15:51 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120512121551.220F52A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/621?compare_to=620&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 621, Order: 156704, Start Time: 2012-05-12 11:19:58, End Time: 2012-05-12 12:16:33 To: 620, Order: 156703, Start Time: 2012-05-12 09:05:38, End Time: 2012-05-12 10:02:16 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (61 on baseline) Performance Improvements: 0 (29 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (798 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.07% (2.0176 => 2.2814, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.32% (0.3130 => 0.3359, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.01% (0.2721 => 0.2830, std. dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.51% (3.9660 => 4.1054, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.10% (0.5265 => 0.5428, std. dev.: 0.0024) MultiSource/Applications/SPASS/SPASS: 2.92% (13.8202 => 14.2238, std. dev.: 0.0031) MultiSource/Benchmarks/nbench/nbench: 2.90% (1.0594 => 1.0901, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.89% (0.6959 => 0.7160, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.79% (0.9199 => 0.9456, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 2.74% (0.8310 => 0.8538, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.56% (1.2193 => 1.2505, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash2: 2.50% (0.4328 => 0.4436, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.47% (1.1364 => 1.1645, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.39% (0.5637 => 0.5772, std. dev.: 0.0015) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.24% (0.7710 => 0.7883, std. dev.: 0.0023) MultiSource/Applications/siod/siod: 2.24% (2.1791 => 2.2279, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.15% (0.5577 => 0.5697, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.12% (1.4563 => 1.4872, std. dev.: 0.0032) MultiSource/Applications/kimwitu++/kc: 2.09% (16.6129 => 16.9599, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.97% (13.2842 => 13.5460, std. dev.: 0.0081) MultiSource/Applications/treecc/treecc: 1.97% (1.9270 => 1.9649, std. dev.: 0.0097) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.96% (1.3245 => 1.3505, std. dev.: 0.0082) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.96% (1.3819 => 1.4090, std. dev.: 0.0033) MultiSource/Applications/lambda-0_1_3/lambda: 1.93% (0.7038 => 0.7174, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 1.91% (3.8646 => 3.9385, std. dev.: 0.0093) MultiSource/Applications/Burg/burg: 1.84% (1.1061 => 1.1265, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.82% (1.3813 => 1.4065, std. dev.: 0.0017) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.82% (0.7460 => 0.7596, std. dev.: 0.0012) MultiSource/Applications/hbd/hbd: 1.50% (1.3693 => 1.3899, std. dev.: 0.0039) MultiSource/Applications/spiff/spiff: 1.48% (0.7506 => 0.7617, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.48% (3.6692 => 3.7234, std. dev.: 0.0039) MultiSource/Applications/sqlite3/sqlite3: 1.37% (16.2614 => 16.4837, std. dev.: 0.0205) MultiSource/Applications/JM/lencod/lencod: 1.24% (14.8535 => 15.0378, std. dev.: 0.0157) MultiSource/Applications/SIBsim4/SIBsim4: 1.18% (1.2749 => 1.2900, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.07% (3.2742 => 3.3093, std. dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.07% (2.1007 => 2.1231, std. dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.1333 => 1.1452, std. dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.35% (1.8175 => 2.2601, std. dev.: 0.0400) SingleSource/Benchmarks/Misc/mandel-2: 6.82% (1.2998 => 1.3885, std. dev.: 0.0147) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7298, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.87% (1.5824 => 1.6753, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9877, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.65% (1.7688 => 1.8334, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/salsa20: 3.60% (7.4271 => 7.6946, std. dev.: 0.0083) MultiSource/Benchmarks/nbench/nbench: 3.13% (11.2619 => 11.6146, std. dev.: 0.0050) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4540, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: 2.81% (1.9199 => 1.9738, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.76% (2.8606 => 2.9395, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.62% (8.8259 => 9.0574, std. dev.: 0.0158) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.55% (7.9275 => 8.1299, std. dev.: 0.0093) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9603, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.61% (0.8273 => 0.8406, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.45% (1.4298 => 1.4506, std. dev.: 0.0042) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5089, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.29% (2.0200 => 2.0460, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.22% (1.9433 => 1.9671, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/sieve: 1.19% (5.1531 => 5.2143, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 1.11% (9.0760 => 9.1763, std. dev.: 0.0030) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -18.83% (0.4657 => 0.3780, std. dev.: 0.0071) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.93% (0.2670 => 0.2485, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.64% (0.3511 => 0.3278, std. dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.20% (22.5627 => 21.1629, std. dev.: 0.0123) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.05% (0.8818 => 0.8549, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.90% (0.6576 => 0.6385, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/bigfib: -1.79% (0.6250 => 0.6138, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -10.13% (1.2308 => 1.1061, std. dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0008) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.31% (0.3139 => 0.2941, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9475, std. dev.: 0.0004) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.59% (1.3780 => 1.3148, std. dev.: 0.0071) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -4.03% (2.5089 => 2.4079, std. dev.: 0.0010) MultiSource/Benchmarks/Olden/bh/bh: -3.66% (1.9762 => 1.9039, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.64% (0.3458 => 0.3332, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: -2.15% (1.1560 => 1.1312, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -2.02% (6.3560 => 6.2274, std. dev.: 0.0048) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.88% (6.6320 => 6.5070, std. dev.: 0.0027) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6918, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: -1.87% (9.3358 => 9.1611, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3446, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.63% (20.3410 => 20.0095, std. dev.: 0.0161) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9952, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) MultiSource/Applications/lua/lua: -1.40% (26.5159 => 26.1449, std. dev.: 0.0515) SingleSource/Benchmarks/Shootout/heapsort: -1.37% (3.9173 => 3.8635, std. dev.: 0.0024) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.37s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat May 12 06:39:14 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 12 May 2012 08:39:14 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120512133914.024542A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/622?compare_to=621&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 622, Order: 156709, Start Time: 2012-05-12 12:43:31, End Time: 2012-05-12 13:39:57 To: 621, Order: 156704, Start Time: 2012-05-12 11:19:58, End Time: 2012-05-12 12:16:33 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (54 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 891 (794 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 1.17% (1.3885 => 1.4047, std. dev.: 0.0048) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.47% (2.0176 => 2.2692, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.58% (0.3130 => 0.3336, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.08% (0.2721 => 0.2832, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.03% (3.9660 => 4.0861, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.68% (0.5265 => 0.5406, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.54% (0.6959 => 0.7136, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 2.52% (1.0594 => 1.0861, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.44% (0.9199 => 0.9423, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 2.43% (13.8202 => 14.1558, std. dev.: 0.0118) MultiSource/Benchmarks/Prolangs-C/football/football: 2.36% (0.8310 => 0.8506, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.29% (1.2193 => 1.2472, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.16% (0.5637 => 0.5759, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.08% (1.3819 => 1.4106, std. dev.: 0.0025) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.07% (1.1364 => 1.1599, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.06% (1.3813 => 1.4098, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 1.93% (2.1791 => 2.2211, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.92% (0.5577 => 0.5684, std. dev.: 0.0009) MultiSource/Applications/kimwitu++/kc: 1.81% (16.6129 => 16.9144, std. dev.: 0.0193) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.77% (13.2842 => 13.5196, std. dev.: 0.0034) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.73% (0.7710 => 0.7843, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.70% (1.4563 => 1.4811, std. dev.: 0.0017) MultiSource/Benchmarks/MallocBench/gs/gs: 1.69% (3.8646 => 3.9301, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.61% (1.3245 => 1.3458, std. dev.: 0.0017) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.57% (0.7460 => 0.7577, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 1.49% (0.7038 => 0.7143, std. dev.: 0.0006) MultiSource/Applications/treecc/treecc: 1.44% (1.9270 => 1.9548, std. dev.: 0.0013) MultiSource/Applications/sqlite3/sqlite3: 1.28% (16.2614 => 16.4692, std. dev.: 0.0163) MultiSource/Applications/hbd/hbd: 1.20% (1.3693 => 1.3858, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.07% (3.6692 => 3.7083, std. dev.: 0.0047) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.02% (1.8175 => 2.2541, std. dev.: 0.0046) SingleSource/Benchmarks/Misc/mandel-2: 8.07% (1.2998 => 1.4047, std. dev.: 0.0048) SingleSource/Benchmarks/Misc/flops-4: 6.52% (1.0640 => 1.1334, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.90% (1.5824 => 1.6758, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9878, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.66% (1.7688 => 1.8336, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: 3.56% (7.4271 => 7.6917, std. dev.: 0.0100) MultiSource/Benchmarks/nbench/nbench: 3.14% (11.2619 => 11.6157, std. dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4549, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: 2.84% (1.9199 => 1.9744, std. dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.79% (8.8259 => 9.0725, std. dev.: 0.0069) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9392, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.26% (7.9275 => 8.1063, std. dev.: 0.0181) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.61% (0.8273 => 0.8406, std. dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.43% (8.3908 => 8.5106, std. dev.: 0.0036) MultiSource/Applications/lemon/lemon: 1.36% (1.4298 => 1.4493, std. dev.: 0.0015) MultiSource/Benchmarks/Olden/bisort/bisort: 1.35% (0.8239 => 0.8350, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.26% (2.0200 => 2.0455, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0001) MultiSource/Benchmarks/sim/sim: 1.16% (5.0168 => 5.0749, std. dev.: 0.0117) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1775, std. dev.: 0.0009) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -20.89% (0.4657 => 0.3684, std. dev.: 0.0075) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.55% (0.2670 => 0.2495, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.49% (0.3511 => 0.3283, std. dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.45% (22.5627 => 21.1081, std. dev.: 0.0046) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.40% (0.8818 => 0.8518, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: -3.28% (0.3623 => 0.3504, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.23% (0.3650 => 0.3532, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/property: -3.17% (0.3940 => 0.3815, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -3.00% (0.3601 => 0.3493, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -2.96% (0.3789 => 0.3677, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -2.93% (0.3578 => 0.3473, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/synchronized: -2.92% (0.3663 => 0.3556, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -2.88% (0.3646 => 0.3541, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: -2.85% (0.4003 => 0.3889, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -2.84% (0.3914 => 0.3803, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.77% (0.6576 => 0.6394, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: -2.42% (0.6250 => 0.6099, std. dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -10.29% (1.2308 => 1.1041, std. dev.: 0.0080) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.50% (0.3139 => 0.2935, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.89% (1.3780 => 1.3106, std. dev.: 0.0059) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9473, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -4.01% (2.5089 => 2.4083, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -3.64% (1.9762 => 1.9043, std. dev.: 0.0101) SingleSource/Benchmarks/Misc/richards_benchmark: -2.14% (1.1560 => 1.1313, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -2.00% (6.6320 => 6.4994, std. dev.: 0.0046) SingleSource/Benchmarks/Shootout/lists: -1.95% (6.3560 => 6.2318, std. dev.: 0.0074) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6923, std. dev.: 0.0009) MultiSource/Applications/minisat/minisat: -1.86% (9.3358 => 9.1617, std. dev.: 0.0064) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3446, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9954, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.61% (20.3410 => 20.0140, std. dev.: 0.0192) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.56% (0.9692 => 0.9541, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.38% (3.9173 => 3.8632, std. dev.: 0.0146) MultiSource/Applications/lua/lua: -1.37% (26.5159 => 26.1535, std. dev.: 0.0219) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.01% (3.8887 => 3.8496, std. dev.: 0.0030) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.55s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat May 12 09:01:33 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 12 May 2012 11:01:33 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120512160133.F37162A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/623?compare_to=622&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 623, Order: 156712, Start Time: 2012-05-12 15:05:46, End Time: 2012-05-12 16:02:17 To: 622, Order: 156709, Start Time: 2012-05-12 12:43:31, End Time: 2012-05-12 13:39:57 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (59 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (789 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.19% (2.0176 => 2.2838, std. dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.00% (0.3130 => 0.3349, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.37% (0.2721 => 0.2840, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.45% (3.9660 => 4.1028, std. dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.06% (0.5265 => 0.5426, std. dev.: 0.0024) MultiSource/Benchmarks/nbench/nbench: 3.05% (1.0594 => 1.0917, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.96% (0.6959 => 0.7165, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 2.90% (13.8202 => 14.2211, std. dev.: 0.0126) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.78% (0.9199 => 0.9455, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/football/football: 2.73% (0.8310 => 0.8537, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.50% (0.5637 => 0.5778, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.49% (1.2193 => 1.2497, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.42% (1.1364 => 1.1639, std. dev.: 0.0006) MultiSource/Applications/siod/siod: 2.18% (2.1791 => 2.2266, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.17% (1.4563 => 1.4879, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.17% (0.5577 => 0.5698, std. dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 2.10% (16.6129 => 16.9614, std. dev.: 0.0121) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.08% (13.2842 => 13.5605, std. dev.: 0.0064) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.07% (1.3819 => 1.4105, std. dev.: 0.0019) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.05% (1.3813 => 1.4096, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/gs/gs: 1.98% (3.8646 => 3.9413, std. dev.: 0.0032) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.96% (0.7710 => 0.7861, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.89% (1.3245 => 1.3495, std. dev.: 0.0006) MultiSource/Applications/Burg/burg: 1.87% (1.1061 => 1.1268, std. dev.: 0.0012) MultiSource/Applications/lambda-0_1_3/lambda: 1.80% (0.7038 => 0.7165, std. dev.: 0.0008) MultiSource/Applications/treecc/treecc: 1.77% (1.9270 => 1.9611, std. dev.: 0.0126) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.73% (0.7460 => 0.7589, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 1.61% (1.3693 => 1.3913, std. dev.: 0.0063) MultiSource/Applications/sqlite3/sqlite3: 1.56% (16.2614 => 16.5145, std. dev.: 0.0152) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.50% (3.6692 => 3.7242, std. dev.: 0.0046) MultiSource/Applications/SIBsim4/SIBsim4: 1.34% (1.2749 => 1.2920, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.29% (2.1007 => 2.1278, std. dev.: 0.0070) MultiSource/Applications/JM/lencod/lencod: 1.21% (14.8535 => 15.0334, std. dev.: 0.0094) MultiSource/Applications/JM/ldecod/ldecod: 1.16% (6.5754 => 6.6516, std. dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.13% (3.2742 => 3.3113, std. dev.: 0.0044) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.02% (1.8175 => 2.2541, std. dev.: 0.0352) SingleSource/Benchmarks/Misc/mandel-2: 8.26% (1.2998 => 1.4072, std. dev.: 0.0125) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.87% (1.5824 => 1.6753, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8146, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9877, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.70% (1.7688 => 1.8342, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/salsa20: 3.62% (7.4271 => 7.6961, std. dev.: 0.0044) MultiSource/Benchmarks/nbench/nbench: 3.12% (11.2619 => 11.6128, std. dev.: 0.0027) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4549, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-6: 2.82% (1.9199 => 1.9740, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9392, std. dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.72% (8.8259 => 9.0660, std. dev.: 0.0145) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.53% (7.9275 => 8.1278, std. dev.: 0.0061) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.55% (0.8273 => 0.8401, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: 1.48% (1.4298 => 1.4510, std. dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5102, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.26% (2.0200 => 2.0455, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.25% (1.9433 => 1.9676, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1773, std. dev.: 0.0014) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -21.26% (0.4657 => 0.3667, std. dev.: 0.0181) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.48% (0.2670 => 0.2497, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.27% (0.3511 => 0.3291, std. dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.10% (22.5627 => 21.1860, std. dev.: 0.0179) SingleSource/UnitTests/ObjC/exceptions-3: -3.34% (0.3623 => 0.3502, std. dev.: 0.0030) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.28% (0.8818 => 0.8529, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -3.22% (0.3601 => 0.3485, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.18% (0.3650 => 0.3534, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -3.15% (0.3646 => 0.3531, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -3.11% (0.3663 => 0.3549, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -3.07% (0.3940 => 0.3819, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -3.02% (0.3578 => 0.3470, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -2.93% (0.3789 => 0.3678, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -2.76% (0.3914 => 0.3806, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -2.67% (0.4003 => 0.3896, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.57% (0.6576 => 0.6407, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/bigfib: -2.03% (0.6250 => 0.6123, std. dev.: 0.0005) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -9.49% (1.2308 => 1.1140, std. dev.: 0.0051) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.56% (0.3139 => 0.2933, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9471, std. dev.: 0.0003) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.47% (1.3780 => 1.3164, std. dev.: 0.0032) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.98% (2.5089 => 2.4090, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.73% (0.3458 => 0.3329, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.66% (1.9762 => 1.9039, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/lists: -2.41% (6.3560 => 6.2030, std. dev.: 0.0093) SingleSource/Benchmarks/Misc/richards_benchmark: -2.15% (1.1560 => 1.1312, std. dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.08% (0.4867 => 0.4766, std. dev.: 0.0015) MultiSource/Applications/minisat/minisat: -1.91% (9.3358 => 9.1571, std. dev.: 0.0038) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.88% (6.6320 => 6.5073, std. dev.: 0.0029) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6922, std. dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.78% (20.3410 => 19.9785, std. dev.: 0.0345) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9953, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.49% (3.9173 => 3.8590, std. dev.: 0.0215) MultiSource/Applications/lua/lua: -1.47% (26.5159 => 26.1272, std. dev.: 0.0312) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.63s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat May 12 10:24:55 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 12 May 2012 12:24:55 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120512172455.3DF8D2A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/624?compare_to=623&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 624, Order: 156713, Start Time: 2012-05-12 16:29:09, End Time: 2012-05-12 17:25:37 To: 623, Order: 156712, Start Time: 2012-05-12 15:05:46, End Time: 2012-05-12 16:02:17 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (61 on baseline) Performance Improvements: 1 (39 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 891 (788 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -1.15% (1.1140 => 1.1012, std. dev.: 0.0043) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.60% (2.0176 => 2.2919, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.93% (0.3130 => 0.3347, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.19% (0.2721 => 0.2835, std. dev.: 0.0043) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.37% (3.9660 => 4.0996, std. dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.02% (0.5265 => 0.5424, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 2.98% (1.0594 => 1.0910, std. dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 2.90% (13.8202 => 14.2209, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.83% (0.6959 => 0.7156, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 2.79% (0.8310 => 0.8542, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.69% (0.9199 => 0.9446, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.53% (1.2193 => 1.2502, std. dev.: 0.0084) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.34% (1.1364 => 1.1630, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.32% (0.5637 => 0.5768, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 2.31% (0.4328 => 0.4428, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.16% (1.4563 => 1.4878, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.12% (0.5577 => 0.5695, std. dev.: 0.0041) MultiSource/Applications/siod/siod: 2.05% (2.1791 => 2.2238, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.02% (13.2842 => 13.5530, std. dev.: 0.0170) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.00% (1.3819 => 1.4096, std. dev.: 0.0017) MultiSource/Applications/kimwitu++/kc: 1.94% (16.6129 => 16.9357, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.86% (1.3245 => 1.3492, std. dev.: 0.0025) MultiSource/Benchmarks/MallocBench/gs/gs: 1.84% (3.8646 => 3.9359, std. dev.: 0.0021) MultiSource/Applications/Burg/burg: 1.74% (1.1061 => 1.1254, std. dev.: 0.0012) MultiSource/Applications/hbd/hbd: 1.73% (1.3693 => 1.3930, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.72% (1.3813 => 1.4051, std. dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 1.71% (0.7038 => 0.7158, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.67% (0.7710 => 0.7839, std. dev.: 0.0030) MultiSource/Applications/treecc/treecc: 1.65% (1.9270 => 1.9588, std. dev.: 0.0054) MultiSource/Applications/sqlite3/sqlite3: 1.62% (16.2614 => 16.5252, std. dev.: 0.0187) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.57% (0.7460 => 0.7577, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.44% (3.6692 => 3.7220, std. dev.: 0.0027) MultiSource/Applications/SIBsim4/SIBsim4: 1.40% (1.2749 => 1.2927, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.21% (3.2742 => 3.3137, std. dev.: 0.0018) MultiSource/Applications/JM/lencod/lencod: 1.20% (14.8535 => 15.0322, std. dev.: 0.0108) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.15% (2.1007 => 2.1248, std. dev.: 0.0010) MultiSource/Applications/JM/ldecod/ldecod: 1.04% (6.5754 => 6.6441, std. dev.: 0.0044) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.30% (1.8175 => 2.2591, std. dev.: 0.0417) SingleSource/Benchmarks/Misc/mandel-2: 8.06% (1.2998 => 1.4046, std. dev.: 0.0129) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.90% (1.5824 => 1.6758, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9877, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.69% (1.7688 => 1.8340, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: 3.64% (7.4271 => 7.6976, std. dev.: 0.0061) MultiSource/Benchmarks/nbench/nbench: 3.12% (11.2619 => 11.6137, std. dev.: 0.0049) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4531, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-6: 2.91% (1.9199 => 1.9758, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.83% (8.8259 => 9.0759, std. dev.: 0.0160) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9394, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.41% (7.9275 => 8.1182, std. dev.: 0.0125) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9603, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/ffbench: 1.62% (0.8273 => 0.8407, std. dev.: 0.0014) MultiSource/Applications/lemon/lemon: 1.48% (1.4298 => 1.4509, std. dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5086, std. dev.: 0.0005) MultiSource/Benchmarks/sim/sim: 1.37% (5.0168 => 5.0856, std. dev.: 0.0071) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.29% (2.0200 => 2.0460, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.22% (1.9433 => 1.9670, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/flops: 1.13% (9.0760 => 9.1789, std. dev.: 0.0015) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -20.85% (0.4657 => 0.3686, std. dev.: 0.0329) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.52% (0.2670 => 0.2496, std. dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.15% (22.5627 => 21.1755, std. dev.: 0.0104) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.07% (0.3511 => 0.3298, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: -3.95% (0.3623 => 0.3480, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -3.94% (0.3601 => 0.3459, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/property: -3.83% (0.3940 => 0.3789, std. dev.: 0.0036) SingleSource/UnitTests/ObjC/synchronized: -3.82% (0.3663 => 0.3523, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -3.81% (0.3646 => 0.3507, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.81% (0.3650 => 0.3511, std. dev.: 0.0033) SingleSource/UnitTests/ObjC/for-in: -3.72% (0.3789 => 0.3648, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -3.69% (0.3578 => 0.3446, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -3.45% (0.3914 => 0.3779, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -3.35% (0.4003 => 0.3869, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.05% (0.8818 => 0.8549, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.33% (0.6576 => 0.6423, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/bigfib: -1.95% (0.6250 => 0.6128, std. dev.: 0.0005) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -10.53% (1.2308 => 1.1012, std. dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.66% (0.3139 => 0.2930, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2639, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.12% (1.3780 => 1.3074, std. dev.: 0.0097) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9474, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -3.99% (2.5089 => 2.4087, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.64% (0.3458 => 0.3332, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -3.63% (1.9762 => 1.9044, std. dev.: 0.0046) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.42% (20.3410 => 19.8478, std. dev.: 0.0714) SingleSource/Benchmarks/Shootout/lists: -2.41% (6.3560 => 6.2028, std. dev.: 0.0144) SingleSource/Benchmarks/Misc/richards_benchmark: -2.15% (1.1560 => 1.1311, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: -1.94% (9.3358 => 9.1545, std. dev.: 0.0137) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6907, std. dev.: 0.0018) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.86% (6.6320 => 6.5089, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9954, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/heapsort: -1.47% (3.9173 => 3.8596, std. dev.: 0.0035) MultiSource/Applications/lua/lua: -1.34% (26.5159 => 26.1611, std. dev.: 0.0322) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.43s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat May 12 11:48:16 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 12 May 2012 13:48:16 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120512184816.20F922A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/625?compare_to=624&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 625, Order: 156716, Start Time: 2012-05-12 17:52:33, End Time: 2012-05-12 18:48:59 To: 624, Order: 156713, Start Time: 2012-05-12 16:29:09, End Time: 2012-05-12 17:25:37 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (53 on baseline) Performance Improvements: 1 (39 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 891 (796 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.16% (2.2919 => 2.2653, std. dev.: 0.0004) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.28% (2.0176 => 2.2653, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.42% (0.3130 => 0.3331, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.90% (0.2721 => 0.2827, std. dev.: 0.0016) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.01% (3.9660 => 4.0854, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.72% (0.5265 => 0.5408, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.56% (0.6959 => 0.7137, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 2.52% (1.0594 => 1.0861, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.40% (0.9199 => 0.9420, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 2.37% (13.8202 => 14.1477, std. dev.: 0.0153) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.29% (0.5637 => 0.5766, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.28% (1.2193 => 1.2471, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/football/football: 2.23% (0.8310 => 0.8495, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.19% (1.1364 => 1.1613, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.85% (1.4563 => 1.4832, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.68% (13.2842 => 13.5072, std. dev.: 0.0096) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.66% (0.7710 => 0.7838, std. dev.: 0.0017) MultiSource/Applications/siod/siod: 1.62% (2.1791 => 2.2145, std. dev.: 0.0053) MultiSource/Benchmarks/MallocBench/gs/gs: 1.62% (3.8646 => 3.9271, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.60% (1.3245 => 1.3457, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.51% (0.7460 => 0.7573, std. dev.: 0.0019) MultiSource/Applications/Burg/burg: 1.48% (1.1061 => 1.1225, std. dev.: 0.0052) MultiSource/Applications/kimwitu++/kc: 1.44% (16.6129 => 16.8525, std. dev.: 0.0217) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.43% (1.3813 => 1.4010, std. dev.: 0.0029) MultiSource/Applications/treecc/treecc: 1.40% (1.9270 => 1.9539, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 1.33% (16.2614 => 16.4777, std. dev.: 0.0172) MultiSource/Applications/hbd/hbd: 1.23% (1.3693 => 1.3862, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.23% (1.3819 => 1.3989, std. dev.: 0.0028) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.16% (3.6692 => 3.7119, std. dev.: 0.0064) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.23% (1.8175 => 2.2579, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/mandel-2: 7.60% (1.2998 => 1.3986, std. dev.: 0.0135) SingleSource/Benchmarks/Misc/flops-4: 6.52% (1.0640 => 1.1334, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.87% (1.5824 => 1.6753, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.87% (1.9144 => 1.9885, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.74% (1.7688 => 1.8349, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/salsa20: 3.61% (7.4271 => 7.6951, std. dev.: 0.0065) MultiSource/Benchmarks/nbench/nbench: 3.13% (11.2619 => 11.6140, std. dev.: 0.0028) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4547, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: 2.89% (1.9199 => 1.9754, std. dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.77% (8.8259 => 9.0707, std. dev.: 0.0136) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.74% (2.8606 => 2.9391, std. dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.36% (7.9275 => 8.1143, std. dev.: 0.0172) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.58% (0.8273 => 0.8404, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5097, std. dev.: 0.0024) MultiSource/Applications/lemon/lemon: 1.38% (1.4298 => 1.4495, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.27% (2.0200 => 2.0457, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.18% (1.9433 => 1.9662, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0068) SingleSource/Benchmarks/Misc/flops: 1.14% (9.0760 => 9.1798, std. dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 1.03% (5.0168 => 5.0687, std. dev.: 0.0140) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -21.67% (0.4657 => 0.3648, std. dev.: 0.0051) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.74% (0.2670 => 0.2490, std. dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.64% (22.5627 => 21.0653, std. dev.: 0.0126) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.24% (0.3511 => 0.3292, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-3: -3.86% (0.3623 => 0.3483, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.84% (0.3650 => 0.3510, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -3.66% (0.3663 => 0.3529, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -3.58% (0.3601 => 0.3472, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/property: -3.55% (0.3940 => 0.3800, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -3.54% (0.3646 => 0.3517, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -3.48% (0.3789 => 0.3657, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: -3.35% (0.4003 => 0.3869, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: -3.30% (0.3914 => 0.3785, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.22% (0.8818 => 0.8534, std. dev.: 0.0106) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.54% (0.6576 => 0.6409, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/bigfib: -2.27% (0.6250 => 0.6108, std. dev.: 0.0002) MultiSource/Applications/lua/lua: -1.10% (3.7467 => 3.7053, std. dev.: 0.0128) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -11.18% (1.2308 => 1.0932, std. dev.: 0.0074) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.53% (0.3139 => 0.2934, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.15% (1.3780 => 1.3071, std. dev.: 0.0062) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9475, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -4.00% (2.5089 => 2.4086, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -3.65% (1.9762 => 1.9041, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: -2.15% (1.1560 => 1.1311, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -2.06% (6.3560 => 6.2253, std. dev.: 0.0081) MultiSource/Applications/minisat/minisat: -1.98% (9.3358 => 9.1513, std. dev.: 0.0107) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.95% (20.3410 => 19.9442, std. dev.: 0.1009) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.88% (6.6320 => 6.5076, std. dev.: 0.0018) MultiSource/Benchmarks/mafft/pairlocalalign: -1.87% (28.2225 => 27.6937, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9953, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) MultiSource/Applications/lua/lua: -1.32% (26.5159 => 26.1670, std. dev.: 0.0360) SingleSource/Benchmarks/Shootout/heapsort: -1.27% (3.9173 => 3.8677, std. dev.: 0.0021) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.53s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat May 12 13:11:49 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 12 May 2012 15:11:49 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120512201149.4039E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/626?compare_to=625&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 626, Order: 156720, Start Time: 2012-05-12 19:15:58, End Time: 2012-05-12 20:12:32 To: 625, Order: 156716, Start Time: 2012-05-12 17:52:33, End Time: 2012-05-12 18:48:59 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (59 on baseline) Performance Improvements: 0 (29 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 891 (800 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.20% (2.2653 => 2.2924, std. dev.: 0.0003) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.62% (2.0176 => 2.2924, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.16% (0.3130 => 0.3354, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.56% (0.2721 => 0.2845, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.78% (3.9660 => 4.1159, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.27% (0.5265 => 0.5437, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 3.27% (1.0594 => 1.0940, std. dev.: 0.0105) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.05% (0.6959 => 0.7171, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.03% (0.9199 => 0.9478, std. dev.: 0.0028) MultiSource/Applications/SPASS/SPASS: 2.98% (13.8202 => 14.2327, std. dev.: 0.0145) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.92% (1.2193 => 1.2549, std. dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/football/football: 2.86% (0.8310 => 0.8548, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.74% (1.1364 => 1.1675, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.61% (0.5637 => 0.5784, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 2.50% (0.4328 => 0.4436, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.44% (1.4563 => 1.4918, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 2.36% (2.1791 => 2.2306, std. dev.: 0.0120) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.33% (0.5577 => 0.5707, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.32% (0.7710 => 0.7889, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.12% (1.3245 => 1.3526, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 2.09% (3.8646 => 3.9453, std. dev.: 0.0018) MultiSource/Applications/kimwitu++/kc: 2.07% (16.6129 => 16.9563, std. dev.: 0.0045) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.05% (13.2842 => 13.5566, std. dev.: 0.0064) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.88% (0.7460 => 0.7600, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 1.87% (1.1061 => 1.1268, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.84% (1.3813 => 1.4067, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 1.84% (1.9270 => 1.9624, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.82% (1.3819 => 1.4071, std. dev.: 0.0018) MultiSource/Applications/SIBsim4/SIBsim4: 1.76% (1.2749 => 1.2973, std. dev.: 0.0044) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.76% (3.6692 => 3.7336, std. dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: 1.62% (16.2614 => 16.5254, std. dev.: 0.0188) MultiSource/Applications/JM/lencod/lencod: 1.57% (14.8535 => 15.0867, std. dev.: 0.0099) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.38% (3.2742 => 3.3195, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.31% (2.1007 => 2.1283, std. dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 1.28% (6.5754 => 6.6594, std. dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.20% (1.1333 => 1.1469, std. dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.02% (1.8175 => 2.2541, std. dev.: 0.0053) SingleSource/Benchmarks/Misc/mandel-2: 8.34% (1.2998 => 1.4082, std. dev.: 0.0151) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.91% (1.5824 => 1.6759, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 3.83% (7.4271 => 7.7114, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/flops-5: 3.79% (1.9144 => 1.9869, std. dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.68% (1.7688 => 1.8339, std. dev.: 0.0066) MultiSource/Benchmarks/nbench/nbench: 3.13% (11.2619 => 11.6143, std. dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4551, std. dev.: 0.0044) SingleSource/Benchmarks/Misc/flops-6: 2.97% (1.9199 => 1.9769, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.82% (8.8259 => 9.0750, std. dev.: 0.0271) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9393, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.34% (7.9275 => 8.1127, std. dev.: 0.0154) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.70% (1.4298 => 1.4541, std. dev.: 0.0076) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9603, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.55% (0.8273 => 0.8401, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5103, std. dev.: 0.0028) MultiSource/Benchmarks/sim/sim: 1.39% (5.0168 => 5.0866, std. dev.: 0.0030) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.28% (2.0200 => 2.0459, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.14% (9.0760 => 9.1792, std. dev.: 0.0014) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -21.34% (0.4657 => 0.3663, std. dev.: 0.0077) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.52% (0.2670 => 0.2496, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.24% (22.5627 => 21.1553, std. dev.: 0.0093) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.01% (0.3511 => 0.3300, std. dev.: 0.0037) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.65% (0.8818 => 0.8584, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.22% (0.6576 => 0.6430, std. dev.: 0.0006) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -10.43% (1.2308 => 1.1024, std. dev.: 0.0044) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.56% (0.3139 => 0.2933, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9475, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.81% (1.3780 => 1.3117, std. dev.: 0.0086) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.97% (2.5089 => 2.4093, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.67% (0.3458 => 0.3331, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.63% (1.9762 => 1.9045, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/lists: -2.24% (6.3560 => 6.2134, std. dev.: 0.0104) SingleSource/Benchmarks/Misc/richards_benchmark: -2.15% (1.1560 => 1.1311, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: -1.95% (9.3358 => 9.1542, std. dev.: 0.0155) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.88% (6.6320 => 6.5070, std. dev.: 0.0040) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6915, std. dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.82% (20.3410 => 19.9705, std. dev.: 0.0540) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3446, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9955, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.56% (0.9692 => 0.9541, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.46% (3.9173 => 3.8600, std. dev.: 0.0014) MultiSource/Applications/lua/lua: -1.25% (26.5159 => 26.1833, std. dev.: 0.0093) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.01% (3.8887 => 3.8493, std. dev.: 0.0016) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.60s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat May 12 15:15:01 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 12 May 2012 17:15:01 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120512221501.739EC2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/627?compare_to=626&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 627, Order: 156721, Start Time: 2012-05-12 21:19:13, End Time: 2012-05-12 22:15:44 To: 626, Order: 156720, Start Time: 2012-05-12 19:15:58, End Time: 2012-05-12 20:12:32 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (62 on baseline) Performance Improvements: 0 (31 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (795 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.57% (2.0176 => 2.2914, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.06% (0.3130 => 0.3351, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.52% (0.2721 => 0.2844, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.73% (3.9660 => 4.1139, std. dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.32% (0.5265 => 0.5440, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 3.18% (1.0594 => 1.0931, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.98% (0.5637 => 0.5805, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.97% (0.9199 => 0.9472, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.96% (0.6959 => 0.7165, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 2.88% (13.8202 => 14.2179, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.86% (1.2193 => 1.2542, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 2.84% (0.8310 => 0.8546, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.69% (1.1364 => 1.1670, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 2.38% (0.4328 => 0.4431, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.33% (0.5577 => 0.5707, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.28% (0.7710 => 0.7886, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.24% (1.4563 => 1.4889, std. dev.: 0.0015) MultiSource/Applications/siod/siod: 2.15% (2.1791 => 2.2260, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.03% (1.3245 => 1.3514, std. dev.: 0.0067) MultiSource/Benchmarks/MallocBench/gs/gs: 1.98% (3.8646 => 3.9413, std. dev.: 0.0114) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.97% (13.2842 => 13.5457, std. dev.: 0.0157) MultiSource/Applications/kimwitu++/kc: 1.94% (16.6129 => 16.9359, std. dev.: 0.0116) MultiSource/Applications/Burg/burg: 1.89% (1.1061 => 1.1270, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.85% (1.3819 => 1.4074, std. dev.: 0.0036) MultiSource/Applications/lambda-0_1_3/lambda: 1.82% (0.7038 => 0.7166, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.80% (0.7460 => 0.7594, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 1.79% (1.9270 => 1.9614, std. dev.: 0.0017) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.78% (1.3813 => 1.4059, std. dev.: 0.0009) MultiSource/Applications/hbd/hbd: 1.75% (1.3693 => 1.3933, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.73% (3.6692 => 3.7327, std. dev.: 0.0027) MultiSource/Applications/SIBsim4/SIBsim4: 1.73% (1.2749 => 1.2969, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 1.71% (16.2614 => 16.5395, std. dev.: 0.0158) MultiSource/Applications/JM/lencod/lencod: 1.44% (14.8535 => 15.0667, std. dev.: 0.0260) MultiSource/Applications/JM/ldecod/ldecod: 1.23% (6.5754 => 6.6564, std. dev.: 0.0159) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.22% (3.2742 => 3.3142, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.13% (1.1333 => 1.1461, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.09% (2.1007 => 2.1236, std. dev.: 0.0018) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.39% (1.8175 => 2.2607, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: 7.89% (1.2998 => 1.4024, std. dev.: 0.0133) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6755, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9876, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.69% (1.7688 => 1.8341, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/salsa20: 3.55% (7.4271 => 7.6906, std. dev.: 0.0089) MultiSource/Benchmarks/nbench/nbench: 3.12% (11.2619 => 11.6135, std. dev.: 0.0056) MultiSource/Applications/hexxagon/hexxagon: 3.02% (12.0921 => 12.4572, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: 2.92% (1.9199 => 1.9759, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.89% (8.8259 => 9.0810, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9393, std. dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.40% (7.9275 => 8.1178, std. dev.: 0.0146) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.62% (0.8273 => 0.8407, std. dev.: 0.0031) SingleSource/Benchmarks/Dhrystone/fldry: 1.60% (1.9290 => 1.9598, std. dev.: 0.0011) MultiSource/Applications/lemon/lemon: 1.43% (1.4298 => 1.4503, std. dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5094, std. dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.27% (2.0200 => 2.0456, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.20% (1.9433 => 1.9666, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2139, std. dev.: 0.0033) MultiSource/Benchmarks/sim/sim: 1.16% (5.0168 => 5.0750, std. dev.: 0.0118) SingleSource/Benchmarks/Misc/flops: 1.14% (9.0760 => 9.1799, std. dev.: 0.0006) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -21.19% (0.4657 => 0.3670, std. dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.55% (0.2670 => 0.2495, std. dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.31% (22.5627 => 21.1401, std. dev.: 0.0032) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.01% (0.3511 => 0.3300, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.80% (0.8818 => 0.8571, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: -2.77% (0.3650 => 0.3549, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.20% (0.6576 => 0.6431, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/bigfib: -1.95% (0.6250 => 0.6128, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -10.75% (1.2308 => 1.0985, std. dev.: 0.0078) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.63% (0.3139 => 0.2931, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2641, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9471, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.32% (1.3780 => 1.3185, std. dev.: 0.0038) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -4.07% (2.5089 => 2.4068, std. dev.: 0.0016) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.62% (1.9762 => 1.9046, std. dev.: 0.0049) SingleSource/Benchmarks/Misc/richards_benchmark: -2.12% (1.1560 => 1.1315, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.09% (20.3410 => 19.9161, std. dev.: 0.0887) SingleSource/Benchmarks/Shootout/lists: -2.08% (6.3560 => 6.2240, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.88% (6.6320 => 6.5072, std. dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6924, std. dev.: 0.0014) MultiSource/Applications/minisat/minisat: -1.85% (9.3358 => 9.1631, std. dev.: 0.0246) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9954, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.39% (3.9173 => 3.8628, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.25% (3.8887 => 3.8402, std. dev.: 0.0061) MultiSource/Applications/lua/lua: -1.23% (26.5159 => 26.1892, std. dev.: 0.0271) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.48s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat May 12 16:38:28 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 12 May 2012 18:38:28 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120512233828.639C92A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/628?compare_to=627&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 628, Order: 156724, Start Time: 2012-05-12 22:42:43, End Time: 2012-05-12 23:39:11 To: 627, Order: 156721, Start Time: 2012-05-12 21:19:13, End Time: 2012-05-12 22:15:44 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (60 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (789 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.72% (2.0176 => 2.2742, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.87% (0.3130 => 0.3345, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.37% (0.2721 => 0.2840, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.38% (3.9660 => 4.1001, std. dev.: 0.0073) MultiSource/Benchmarks/nbench/nbench: 3.06% (1.0594 => 1.0918, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.96% (0.5265 => 0.5421, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.83% (0.6959 => 0.7156, std. dev.: 0.0014) MultiSource/Applications/SPASS/SPASS: 2.83% (13.8202 => 14.2107, std. dev.: 0.0153) MultiSource/Benchmarks/Prolangs-C/football/football: 2.82% (0.8310 => 0.8544, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.73% (0.9199 => 0.9450, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.60% (1.2193 => 1.2510, std. dev.: 0.0044) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.51% (1.1364 => 1.1649, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.47% (0.5637 => 0.5776, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 2.27% (2.1791 => 2.2285, std. dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.19% (0.5577 => 0.5699, std. dev.: 0.0029) MultiSource/Applications/kimwitu++/kc: 2.10% (16.6129 => 16.9611, std. dev.: 0.0087) MultiSource/Benchmarks/MallocBench/gs/gs: 2.09% (3.8646 => 3.9453, std. dev.: 0.0039) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.09% (1.4563 => 1.4867, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.97% (13.2842 => 13.5458, std. dev.: 0.0096) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.93% (1.3245 => 1.3501, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 1.89% (0.7038 => 0.7171, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.86% (0.7460 => 0.7599, std. dev.: 0.0016) MultiSource/Applications/Burg/burg: 1.82% (1.1061 => 1.1262, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.76% (0.7710 => 0.7846, std. dev.: 0.0013) MultiSource/Applications/treecc/treecc: 1.70% (1.9270 => 1.9598, std. dev.: 0.0077) MultiSource/Applications/sqlite3/sqlite3: 1.60% (16.2614 => 16.5217, std. dev.: 0.0112) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.55% (1.3813 => 1.4027, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.50% (3.6692 => 3.7242, std. dev.: 0.0073) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.49% (1.3819 => 1.4025, std. dev.: 0.0017) MultiSource/Applications/SIBsim4/SIBsim4: 1.49% (1.2749 => 1.2939, std. dev.: 0.0006) MultiSource/Applications/hbd/hbd: 1.40% (1.3693 => 1.3885, std. dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.38% (2.1007 => 2.1296, std. dev.: 0.0007) MultiSource/Applications/JM/lencod/lencod: 1.27% (14.8535 => 15.0427, std. dev.: 0.0058) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.27% (3.2742 => 3.3159, std. dev.: 0.0067) MultiSource/Applications/JM/ldecod/ldecod: 1.06% (6.5754 => 6.6452, std. dev.: 0.0014) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.18% (1.8175 => 2.2570, std. dev.: 0.0155) SingleSource/Benchmarks/Misc/mandel-2: 7.90% (1.2998 => 1.4025, std. dev.: 0.0063) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7298, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.85% (1.5824 => 1.6749, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8148, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9876, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.62% (1.7688 => 1.8328, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: 3.57% (7.4271 => 7.6919, std. dev.: 0.0020) MultiSource/Benchmarks/nbench/nbench: 3.12% (11.2619 => 11.6131, std. dev.: 0.0027) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4541, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: 2.90% (1.9199 => 1.9755, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9392, std. dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.65% (8.8259 => 9.0594, std. dev.: 0.0084) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.39% (7.9275 => 8.1169, std. dev.: 0.0082) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.58% (0.8273 => 0.8404, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.49% (1.4298 => 1.4511, std. dev.: 0.0049) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5098, std. dev.: 0.0048) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.27% (2.0200 => 2.0457, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.22% (1.9433 => 1.9670, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1772, std. dev.: 0.0014) MultiSource/Benchmarks/sim/sim: 1.07% (5.0168 => 5.0704, std. dev.: 0.0153) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -21.67% (0.4657 => 0.3648, std. dev.: 0.0355) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.52% (0.2670 => 0.2496, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.17% (22.5627 => 21.1712, std. dev.: 0.0151) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.04% (0.3511 => 0.3299, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-3: -3.95% (0.3623 => 0.3480, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.92% (0.3650 => 0.3507, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -3.89% (0.3601 => 0.3461, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -3.78% (0.3646 => 0.3508, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: -3.77% (0.3578 => 0.3443, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -3.77% (0.3663 => 0.3525, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -3.62% (0.3789 => 0.3652, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -3.60% (0.3940 => 0.3798, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -3.35% (0.4003 => 0.3869, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -3.35% (0.3914 => 0.3783, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.82% (0.8818 => 0.8569, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.10% (0.6576 => 0.6438, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/bigfib: -2.06% (0.6250 => 0.6121, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -10.03% (1.2308 => 1.1073, std. dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.56% (0.3139 => 0.2933, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9473, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.55% (1.3780 => 1.3153, std. dev.: 0.0063) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -3.98% (2.5089 => 2.4090, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.67% (0.3458 => 0.3331, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.66% (1.9762 => 1.9039, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/richards_benchmark: -2.10% (1.1560 => 1.1317, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -2.04% (6.3560 => 6.2265, std. dev.: 0.0111) MultiSource/Applications/minisat/minisat: -1.93% (9.3358 => 9.1556, std. dev.: 0.0115) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6917, std. dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.87% (20.3410 => 19.9608, std. dev.: 0.0795) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.86% (6.6320 => 6.5084, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9952, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.55% (3.9173 => 3.8567, std. dev.: 0.0203) MultiSource/Applications/lua/lua: -1.36% (26.5159 => 26.1560, std. dev.: 0.0311) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.95s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat May 12 20:25:05 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 12 May 2012 22:25:05 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120513032505.6FA272A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/629?compare_to=628&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 629, Order: 156726, Start Time: 2012-05-13 02:29:16, End Time: 2012-05-13 03:25:49 To: 628, Order: 156724, Start Time: 2012-05-12 22:42:43, End Time: 2012-05-12 23:39:11 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (60 on baseline) Performance Improvements: 1 (37 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 890 (791 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 1.15% (7.9539 => 8.0457, std. dev.: 0.0094) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -1.58% (3.8230 => 3.7626, std. dev.: 0.0095) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.86% (2.0176 => 2.2770, std. dev.: 0.0163) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.81% (0.3130 => 0.3343, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.41% (0.2721 => 0.2841, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.31% (3.9660 => 4.0973, std. dev.: 0.0170) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.00% (0.5265 => 0.5423, std. dev.: 0.0018) MultiSource/Benchmarks/nbench/nbench: 2.95% (1.0594 => 1.0907, std. dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/football/football: 2.82% (0.8310 => 0.8544, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.80% (0.6959 => 0.7154, std. dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 2.69% (13.8202 => 14.1919, std. dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.64% (0.9199 => 0.9442, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.54% (0.5637 => 0.5780, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.53% (1.2193 => 1.2501, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.31% (1.1364 => 1.1626, std. dev.: 0.0088) MultiSource/Applications/siod/siod: 2.23% (2.1791 => 2.2278, std. dev.: 0.0165) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.03% (1.4563 => 1.4859, std. dev.: 0.0065) MultiSource/Benchmarks/MallocBench/gs/gs: 2.00% (3.8646 => 3.9420, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.99% (0.5577 => 0.5688, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.98% (13.2842 => 13.5478, std. dev.: 0.0117) MultiSource/Applications/kimwitu++/kc: 1.97% (16.6129 => 16.9394, std. dev.: 0.0258) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.87% (1.3245 => 1.3493, std. dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 1.83% (0.7038 => 0.7167, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.82% (0.7460 => 0.7596, std. dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 1.67% (16.2614 => 16.5333, std. dev.: 0.0188) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.66% (1.3813 => 1.4042, std. dev.: 0.0022) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.65% (0.7710 => 0.7837, std. dev.: 0.0008) MultiSource/Applications/Burg/burg: 1.64% (1.1061 => 1.1242, std. dev.: 0.0012) MultiSource/Applications/treecc/treecc: 1.63% (1.9270 => 1.9585, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.45% (1.3819 => 1.4020, std. dev.: 0.0012) MultiSource/Applications/SIBsim4/SIBsim4: 1.43% (1.2749 => 1.2931, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.41% (3.6692 => 3.7210, std. dev.: 0.0195) MultiSource/Applications/hbd/hbd: 1.36% (1.3693 => 1.3879, std. dev.: 0.0025) MultiSource/Applications/JM/lencod/lencod: 1.23% (14.8535 => 15.0369, std. dev.: 0.0162) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.12% (3.2742 => 3.3108, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.11% (2.1007 => 2.1241, std. dev.: 0.0022) MultiSource/Applications/JM/ldecod/ldecod: 1.03% (6.5754 => 6.6431, std. dev.: 0.0146) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 23.71% (1.8175 => 2.2485, std. dev.: 0.0512) SingleSource/Benchmarks/Misc/mandel-2: 7.86% (1.2998 => 1.4019, std. dev.: 0.0073) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7298, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.89% (1.5824 => 1.6756, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9875, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: 3.73% (7.4271 => 7.7042, std. dev.: 0.0014) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.68% (1.7688 => 1.8339, std. dev.: 0.0061) MultiSource/Benchmarks/nbench/nbench: 3.11% (11.2619 => 11.6127, std. dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4542, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: 2.88% (1.9199 => 1.9752, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.84% (8.8259 => 9.0767, std. dev.: 0.0134) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.74% (2.8606 => 2.9391, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.19% (7.9275 => 8.1010, std. dev.: 0.0166) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.60% (0.8273 => 0.8405, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.48% (1.4298 => 1.4510, std. dev.: 0.0010) MultiSource/Benchmarks/NPB-serial/is/is: 1.43% (8.3908 => 8.5107, std. dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.25% (2.0200 => 2.0453, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.18% (1.9433 => 1.9663, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/flops: 1.11% (9.0760 => 9.1770, std. dev.: 0.0005) MultiSource/Benchmarks/sim/sim: 1.10% (5.0168 => 5.0722, std. dev.: 0.0100) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.48% (0.2670 => 0.2497, std. dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.25% (22.5627 => 21.1534, std. dev.: 0.0044) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.10% (0.3511 => 0.3297, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions-3: -4.03% (0.3623 => 0.3477, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.00% (0.3650 => 0.3504, std. dev.: 0.0045) SingleSource/UnitTests/ObjC/exceptions-2: -3.94% (0.3601 => 0.3459, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -3.84% (0.3646 => 0.3506, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: -3.79% (0.3663 => 0.3524, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: -3.77% (0.3578 => 0.3443, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -3.68% (0.3940 => 0.3795, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -3.59% (0.3789 => 0.3653, std. dev.: 0.0031) SingleSource/UnitTests/ObjC/exceptions: -3.42% (0.3914 => 0.3780, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/parameter-passing: -3.27% (0.4003 => 0.3872, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.93% (0.8818 => 0.8560, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: -2.26% (0.6250 => 0.6109, std. dev.: 0.0038) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.02% (0.6576 => 0.6443, std. dev.: 0.0009) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -10.81% (1.2308 => 1.0977, std. dev.: 0.0063) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.16% (1.0460 => 0.9502, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.44% (0.3139 => 0.2937, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2639, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.36% (1.3780 => 1.3042, std. dev.: 0.0075) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9475, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -4.04% (2.5089 => 2.4076, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.73% (0.3458 => 0.3329, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.66% (1.9762 => 1.9039, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: -2.14% (1.1560 => 1.1313, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -2.09% (6.3560 => 6.2234, std. dev.: 0.0074) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6915, std. dev.: 0.0017) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.86% (6.6320 => 6.5086, std. dev.: 0.0013) MultiSource/Applications/minisat/minisat: -1.86% (9.3358 => 9.1624, std. dev.: 0.0292) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9954, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.56% (0.9692 => 0.9541, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.55% (20.3410 => 20.0252, std. dev.: 0.0125) SingleSource/Benchmarks/Shootout/heapsort: -1.44% (3.9173 => 3.8609, std. dev.: 0.0027) MultiSource/Applications/lua/lua: -1.23% (26.5159 => 26.1897, std. dev.: 0.0106) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.06s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat May 12 21:48:30 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 12 May 2012 23:48:30 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120513044830.BBEF92A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/630?compare_to=629&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 630, Order: 156727, Start Time: 2012-05-13 03:52:45, End Time: 2012-05-13 04:49:14 To: 629, Order: 156726, Start Time: 2012-05-13 02:29:16, End Time: 2012-05-13 03:25:49 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (55 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (794 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.52% (2.0176 => 2.2703, std. dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.74% (0.3130 => 0.3341, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.19% (0.2721 => 0.2835, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.09% (3.9660 => 4.0886, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.74% (0.5265 => 0.5409, std. dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 2.67% (1.0594 => 1.0877, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/football/football: 2.61% (0.8310 => 0.8527, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 2.54% (13.8202 => 14.1709, std. dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.51% (0.6959 => 0.7134, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.51% (0.9199 => 0.9430, std. dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.35% (1.2193 => 1.2479, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.28% (1.1364 => 1.1623, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.27% (0.5637 => 0.5765, std. dev.: 0.0006) MultiSource/Applications/siod/siod: 1.98% (2.1791 => 2.2222, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.87% (1.4563 => 1.4835, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.79% (0.5577 => 0.5677, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.79% (13.2842 => 13.5220, std. dev.: 0.0053) MultiSource/Applications/kimwitu++/kc: 1.78% (16.6129 => 16.9082, std. dev.: 0.0124) MultiSource/Benchmarks/MallocBench/gs/gs: 1.74% (3.8646 => 3.9318, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.74% (1.3245 => 1.3475, std. dev.: 0.0008) MultiSource/Applications/lambda-0_1_3/lambda: 1.69% (0.7038 => 0.7157, std. dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: 1.57% (16.2614 => 16.5175, std. dev.: 0.0055) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.57% (0.7460 => 0.7577, std. dev.: 0.0005) MultiSource/Applications/hbd/hbd: 1.55% (1.3693 => 1.3905, std. dev.: 0.0025) MultiSource/Applications/Burg/burg: 1.52% (1.1061 => 1.1229, std. dev.: 0.0030) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.51% (1.3819 => 1.4028, std. dev.: 0.0014) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.47% (0.7710 => 0.7823, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.36% (3.6692 => 3.7190, std. dev.: 0.0012) MultiSource/Applications/SIBsim4/SIBsim4: 1.36% (1.2749 => 1.2922, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.34% (1.3813 => 1.3998, std. dev.: 0.0019) MultiSource/Applications/JM/lencod/lencod: 1.04% (14.8535 => 15.0083, std. dev.: 0.0129) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.04% (3.2742 => 3.3082, std. dev.: 0.0016) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.20% (1.8175 => 2.2573, std. dev.: 0.0528) SingleSource/Benchmarks/Misc/mandel-2: 7.13% (1.2998 => 1.3925, std. dev.: 0.0084) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.91% (1.5824 => 1.6759, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9875, std. dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.75% (1.7688 => 1.8351, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/salsa20: 3.52% (7.4271 => 7.6888, std. dev.: 0.0092) MultiSource/Benchmarks/nbench/nbench: 3.15% (11.2619 => 11.6170, std. dev.: 0.0017) MultiSource/Applications/hexxagon/hexxagon: 2.98% (12.0921 => 12.4528, std. dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.89% (8.8259 => 9.0807, std. dev.: 0.0092) SingleSource/Benchmarks/Misc/flops-6: 2.88% (1.9199 => 1.9752, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.76% (2.8606 => 2.9395, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.22% (7.9275 => 8.1035, std. dev.: 0.0145) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9603, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/ffbench: 1.60% (0.8273 => 0.8405, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.51% (1.4298 => 1.4514, std. dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5080, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.29% (2.0200 => 2.0461, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1776, std. dev.: 0.0011) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -19.54% (0.4657 => 0.3747, std. dev.: 0.0086) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.74% (0.2670 => 0.2490, std. dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.38% (22.5627 => 21.1239, std. dev.: 0.0203) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.12% (0.3511 => 0.3296, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.44% (0.3650 => 0.3488, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -4.39% (0.3623 => 0.3464, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -4.36% (0.3601 => 0.3444, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -4.29% (0.3663 => 0.3506, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -4.28% (0.3646 => 0.3490, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -4.19% (0.3578 => 0.3428, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -4.06% (0.3789 => 0.3635, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -4.06% (0.3940 => 0.3780, std. dev.: 0.0026) SingleSource/UnitTests/ObjC/exceptions: -3.83% (0.3914 => 0.3764, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -3.77% (0.4003 => 0.3852, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.07% (0.8818 => 0.8547, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.42% (0.6576 => 0.6417, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: -2.24% (0.6250 => 0.6110, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -10.10% (1.2308 => 1.1065, std. dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.16% (1.0460 => 0.9502, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.50% (0.3139 => 0.2935, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.05% (1.3780 => 1.3084, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9475, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -4.02% (2.5089 => 2.4081, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.73% (0.3458 => 0.3329, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.71% (1.9762 => 1.9029, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout/lists: -2.15% (6.3560 => 6.2191, std. dev.: 0.0110) SingleSource/Benchmarks/Misc/richards_benchmark: -2.15% (1.1560 => 1.1312, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.91% (20.3410 => 19.9516, std. dev.: 0.0516) MultiSource/Applications/minisat/minisat: -1.89% (9.3358 => 9.1591, std. dev.: 0.0089) MultiSource/Benchmarks/mafft/pairlocalalign: -1.89% (28.2225 => 27.6902, std. dev.: 0.0023) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.85% (6.6320 => 6.5092, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3446, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9960, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout/heapsort: -1.46% (3.9173 => 3.8603, std. dev.: 0.0015) MultiSource/Applications/lua/lua: -1.24% (26.5159 => 26.1874, std. dev.: 0.0358) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.38s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat May 12 23:11:56 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 13 May 2012 01:11:56 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120513061156.04A432A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/631?compare_to=630&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 631, Order: 156728, Start Time: 2012-05-13 05:16:11, End Time: 2012-05-13 06:12:40 To: 630, Order: 156727, Start Time: 2012-05-13 03:52:45, End Time: 2012-05-13 04:49:14 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (55 on baseline) Performance Improvements: 0 (38 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 891 (795 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 1.99% (1.3925 => 1.4202, std. dev.: 0.0027) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.51% (2.0176 => 2.2701, std. dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.74% (0.3130 => 0.3341, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.08% (0.2721 => 0.2832, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.08% (3.9660 => 4.0880, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.83% (0.5265 => 0.5414, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 2.70% (1.0594 => 1.0880, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.63% (0.9199 => 0.9441, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.57% (0.6959 => 0.7138, std. dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 2.43% (13.8202 => 14.1567, std. dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.43% (0.5637 => 0.5774, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.31% (1.2193 => 1.2475, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.27% (1.1364 => 1.1622, std. dev.: 0.0009) MultiSource/Applications/siod/siod: 2.05% (2.1791 => 2.2238, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.95% (0.5577 => 0.5686, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 1.86% (3.8646 => 3.9364, std. dev.: 0.0036) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.85% (1.4563 => 1.4833, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.76% (1.3245 => 1.3478, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.73% (13.2842 => 13.5145, std. dev.: 0.0201) MultiSource/Applications/kimwitu++/kc: 1.71% (16.6129 => 16.8963, std. dev.: 0.0105) MultiSource/Applications/lambda-0_1_3/lambda: 1.68% (0.7038 => 0.7156, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 1.63% (16.2614 => 16.5270, std. dev.: 0.0209) MultiSource/Applications/Burg/burg: 1.57% (1.1061 => 1.1235, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.49% (1.3813 => 1.4019, std. dev.: 0.0010) MultiSource/Applications/treecc/treecc: 1.48% (1.9270 => 1.9555, std. dev.: 0.0052) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.46% (0.7460 => 0.7569, std. dev.: 0.0008) MultiSource/Applications/SIBsim4/SIBsim4: 1.40% (1.2749 => 1.2928, std. dev.: 0.0050) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.40% (1.3819 => 1.4013, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.36% (3.6692 => 3.7190, std. dev.: 0.0029) MultiSource/Applications/hbd/hbd: 1.17% (1.3693 => 1.3853, std. dev.: 0.0007) MultiSource/Applications/JM/lencod/lencod: 1.10% (14.8535 => 15.0173, std. dev.: 0.0116) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 23.98% (1.8175 => 2.2534, std. dev.: 0.0486) SingleSource/Benchmarks/Misc/mandel-2: 9.26% (1.2998 => 1.4202, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.92% (1.5824 => 1.6760, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8141, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9877, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.71% (1.7688 => 1.8345, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: 3.67% (7.4271 => 7.6998, std. dev.: 0.0063) MultiSource/Benchmarks/nbench/nbench: 3.13% (11.2619 => 11.6139, std. dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 3.00% (8.8259 => 9.0907, std. dev.: 0.0070) MultiSource/Applications/hexxagon/hexxagon: 2.98% (12.0921 => 12.4527, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/flops-6: 2.86% (1.9199 => 1.9748, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9392, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.56% (7.9275 => 8.1304, std. dev.: 0.0065) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.55% (0.8273 => 0.8401, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: 1.52% (1.9290 => 1.9584, std. dev.: 0.0009) MultiSource/Applications/lemon/lemon: 1.49% (1.4298 => 1.4511, std. dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5084, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.30% (2.0200 => 2.0463, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.22% (1.9433 => 1.9671, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0036) MultiSource/Benchmarks/sim/sim: 1.16% (5.0168 => 5.0751, std. dev.: 0.0098) SingleSource/Benchmarks/Misc/flops: 1.11% (9.0760 => 9.1770, std. dev.: 0.0011) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -21.56% (0.4657 => 0.3653, std. dev.: 0.0055) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.67% (0.2670 => 0.2492, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.49% (22.5627 => 21.0976, std. dev.: 0.0217) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.10% (0.3511 => 0.3297, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: -4.20% (0.3623 => 0.3471, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.11% (0.3650 => 0.3500, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-2: -4.08% (0.3601 => 0.3454, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -4.03% (0.3646 => 0.3499, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -4.01% (0.3663 => 0.3516, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -4.00% (0.3578 => 0.3435, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -3.88% (0.3940 => 0.3787, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -3.83% (0.3789 => 0.3644, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -3.55% (0.4003 => 0.3861, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.97% (0.8818 => 0.8556, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: -2.42% (0.6250 => 0.6099, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.13% (0.6576 => 0.6436, std. dev.: 0.0014) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -10.67% (1.2308 => 1.0995, std. dev.: 0.0078) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.53% (0.3139 => 0.2934, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.96% (1.3780 => 1.3097, std. dev.: 0.0061) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9471, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -4.01% (2.5089 => 2.4084, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.68% (1.9762 => 1.9035, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: -2.16% (1.1560 => 1.1310, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: -1.97% (9.3358 => 9.1516, std. dev.: 0.0463) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.92% (6.6320 => 6.5047, std. dev.: 0.0038) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6916, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout/lists: -1.75% (6.3560 => 6.2446, std. dev.: 0.0049) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9957, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.42% (20.3410 => 20.0528, std. dev.: 0.0306) MultiSource/Applications/lua/lua: -1.31% (26.5159 => 26.1675, std. dev.: 0.0332) SingleSource/Benchmarks/Shootout/heapsort: -1.11% (3.9173 => 3.8737, std. dev.: 0.0007) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.66s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun May 13 04:22:21 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 13 May 2012 06:22:21 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120513112221.450C42A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/632?compare_to=631&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 632, Order: 156730, Start Time: 2012-05-13 10:26:18, End Time: 2012-05-13 11:23:06 To: 631, Order: 156728, Start Time: 2012-05-13 05:16:11, End Time: 2012-05-13 06:12:40 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (57 on baseline) Performance Improvements: 0 (38 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 891 (793 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/McGill/chomp: 1.10% (1.0995 => 1.1116, std. dev.: 0.0022) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.47% (2.0176 => 2.2691, std. dev.: 0.0134) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.77% (0.3130 => 0.3342, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.15% (0.2721 => 0.2834, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.21% (3.9660 => 4.0934, std. dev.: 0.0064) MultiSource/Benchmarks/nbench/nbench: 2.70% (1.0594 => 1.0880, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.69% (0.6959 => 0.7146, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.65% (0.9199 => 0.9443, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.64% (0.5265 => 0.5404, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/football/football: 2.59% (0.8310 => 0.8525, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.49% (1.2193 => 1.2496, std. dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 2.46% (13.8202 => 14.1606, std. dev.: 0.0026) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.31% (1.1364 => 1.1626, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.25% (0.5637 => 0.5764, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 1.98% (2.1791 => 2.2223, std. dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.97% (0.5577 => 0.5687, std. dev.: 0.0016) MultiSource/Applications/kimwitu++/kc: 1.82% (16.6129 => 16.9145, std. dev.: 0.0120) MultiSource/Benchmarks/MallocBench/gs/gs: 1.81% (3.8646 => 3.9347, std. dev.: 0.0057) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.80% (1.4563 => 1.4825, std. dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.78% (13.2842 => 13.5210, std. dev.: 0.0154) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.69% (1.3245 => 1.3469, std. dev.: 0.0048) MultiSource/Applications/lambda-0_1_3/lambda: 1.63% (0.7038 => 0.7153, std. dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: 1.58% (16.2614 => 16.5181, std. dev.: 0.0038) MultiSource/Applications/Burg/burg: 1.53% (1.1061 => 1.1230, std. dev.: 0.0037) MultiSource/Applications/treecc/treecc: 1.53% (1.9270 => 1.9564, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.51% (1.3819 => 1.4027, std. dev.: 0.0034) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.41% (1.3813 => 1.4008, std. dev.: 0.0019) MultiSource/Applications/SIBsim4/SIBsim4: 1.39% (1.2749 => 1.2926, std. dev.: 0.0024) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.36% (0.7710 => 0.7815, std. dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.32% (3.6692 => 3.7178, std. dev.: 0.0089) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.04% (3.2742 => 3.3082, std. dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 1.02% (14.8535 => 15.0048, std. dev.: 0.0106) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 23.88% (1.8175 => 2.2516, std. dev.: 0.0235) SingleSource/Benchmarks/Misc/mandel-2: 8.07% (1.2998 => 1.4047, std. dev.: 0.0099) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7298, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.90% (1.5824 => 1.6757, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8147, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 3.86% (1.9144 => 1.9883, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.74% (1.7688 => 1.8350, std. dev.: 0.0179) SingleSource/Benchmarks/Misc/salsa20: 3.56% (7.4271 => 7.6916, std. dev.: 0.0069) MultiSource/Benchmarks/nbench/nbench: 3.13% (11.2619 => 11.6140, std. dev.: 0.0033) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4533, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/flops-6: 2.90% (1.9199 => 1.9756, std. dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.84% (8.8259 => 9.0769, std. dev.: 0.0087) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.76% (2.8606 => 2.9395, std. dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.31% (7.9275 => 8.1103, std. dev.: 0.0173) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.60% (0.8273 => 0.8405, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.41% (1.4298 => 1.4499, std. dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5081, std. dev.: 0.0087) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.27% (2.0200 => 2.0457, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0033) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.13% (1.9433 => 1.9653, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 1.11% (9.0760 => 9.1771, std. dev.: 0.0014) MultiSource/Benchmarks/sim/sim: 1.08% (5.0168 => 5.0708, std. dev.: 0.0128) MultiSource/Applications/SPASS/SPASS: 1.01% (10.7476 => 10.8565, std. dev.: 0.0198) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.67% (0.2670 => 0.2492, std. dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.52% (22.5627 => 21.0905, std. dev.: 0.0068) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.10% (0.3511 => 0.3297, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-3: -4.28% (0.3623 => 0.3468, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.16% (0.3650 => 0.3498, std. dev.: 0.0054) SingleSource/UnitTests/ObjC/exceptions-2: -4.11% (0.3601 => 0.3453, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -4.05% (0.3578 => 0.3433, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -4.00% (0.3646 => 0.3500, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -3.98% (0.3940 => 0.3783, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -3.96% (0.3663 => 0.3518, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -3.85% (0.3789 => 0.3643, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -3.68% (0.3914 => 0.3770, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -3.62% (0.4003 => 0.3858, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.89% (0.8818 => 0.8563, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: -2.43% (0.6250 => 0.6098, std. dev.: 0.0036) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.95% (0.6576 => 0.6448, std. dev.: 0.0009) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -9.68% (1.2308 => 1.1116, std. dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.16% (1.0460 => 0.9502, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.47% (0.3139 => 0.2936, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9474, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.78% (1.3780 => 1.3121, std. dev.: 0.0117) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -4.01% (2.5089 => 2.4083, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.67% (1.9762 => 1.9037, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout/lists: -2.18% (6.3560 => 6.2175, std. dev.: 0.0098) SingleSource/Benchmarks/Misc/richards_benchmark: -2.14% (1.1560 => 1.1313, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: -1.89% (9.3358 => 9.1596, std. dev.: 0.0217) MultiSource/Benchmarks/mafft/pairlocalalign: -1.87% (28.2225 => 27.6951, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.86% (6.6320 => 6.5084, std. dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.78% (20.3410 => 19.9787, std. dev.: 0.0197) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9954, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.37% (3.9173 => 3.8635, std. dev.: 0.0027) MultiSource/Applications/lua/lua: -1.28% (26.5159 => 26.1757, std. dev.: 0.0130) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.25s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun May 13 05:45:59 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 13 May 2012 07:45:59 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120513124559.688FC2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/633?compare_to=632&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 633, Order: 156736, Start Time: 2012-05-13 11:50:09, End Time: 2012-05-13 12:46:44 To: 632, Order: 156730, Start Time: 2012-05-13 10:26:18, End Time: 2012-05-13 11:23:06 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (59 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 891 (790 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 2.81% (3.7981 => 3.9049, std. dev.: 0.0112) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.48% (2.0176 => 2.2694, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.93% (0.3130 => 0.3347, std. dev.: 0.0046) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.15% (0.2721 => 0.2834, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.11% (3.9660 => 4.0892, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.81% (0.5265 => 0.5413, std. dev.: 0.0019) MultiSource/Benchmarks/nbench/nbench: 2.72% (1.0594 => 1.0882, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.70% (0.6959 => 0.7147, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: 2.65% (0.8310 => 0.8530, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.55% (0.9199 => 0.9434, std. dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 2.49% (13.8202 => 14.1638, std. dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.47% (0.5637 => 0.5776, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.45% (1.2193 => 1.2492, std. dev.: 0.0022) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.21% (1.1364 => 1.1615, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.13% (0.5577 => 0.5696, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 2.08% (2.1791 => 2.2245, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.06% (1.4563 => 1.4863, std. dev.: 0.0020) MultiSource/Benchmarks/MallocBench/gs/gs: 1.85% (3.8646 => 3.9361, std. dev.: 0.0124) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.83% (1.3245 => 1.3488, std. dev.: 0.0038) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.81% (13.2842 => 13.5250, std. dev.: 0.0211) MultiSource/Applications/kimwitu++/kc: 1.73% (16.6129 => 16.9008, std. dev.: 0.0050) MultiSource/Applications/sqlite3/sqlite3: 1.69% (16.2614 => 16.5359, std. dev.: 0.0074) MultiSource/Applications/lambda-0_1_3/lambda: 1.66% (0.7038 => 0.7155, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.66% (0.7710 => 0.7838, std. dev.: 0.0042) MultiSource/Applications/Burg/burg: 1.56% (1.1061 => 1.1233, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.54% (1.3813 => 1.4026, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.53% (0.7460 => 0.7574, std. dev.: 0.0011) MultiSource/Applications/treecc/treecc: 1.48% (1.9270 => 1.9556, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.46% (1.3819 => 1.4021, std. dev.: 0.0022) MultiSource/Applications/SIBsim4/SIBsim4: 1.43% (1.2749 => 1.2931, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.42% (3.6692 => 3.7212, std. dev.: 0.0046) MultiSource/Applications/hbd/hbd: 1.17% (1.3693 => 1.3853, std. dev.: 0.0011) MultiSource/Applications/JM/lencod/lencod: 1.10% (14.8535 => 15.0163, std. dev.: 0.0144) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.03% (3.2742 => 3.3079, std. dev.: 0.0059) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.54% (1.8175 => 2.2636, std. dev.: 0.0209) SingleSource/Benchmarks/Misc/mandel-2: 7.79% (1.2998 => 1.4010, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.86% (1.5824 => 1.6752, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9881, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.58% (1.7688 => 1.8322, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/salsa20: 3.55% (7.4271 => 7.6905, std. dev.: 0.0023) MultiSource/Benchmarks/llubenchmark/llu: 3.49% (3.7731 => 3.9049, std. dev.: 0.0112) MultiSource/Benchmarks/nbench/nbench: 3.19% (11.2619 => 11.6208, std. dev.: 0.0017) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4539, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: 2.97% (1.9199 => 1.9770, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.80% (8.8259 => 9.0726, std. dev.: 0.0122) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9394, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.60% (7.9275 => 8.1338, std. dev.: 0.0076) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.60% (1.9290 => 1.9599, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 1.56% (0.8273 => 0.8402, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.45% (1.4298 => 1.4506, std. dev.: 0.0042) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5092, std. dev.: 0.0081) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.29% (2.0200 => 2.0460, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: 1.27% (5.0168 => 5.0804, std. dev.: 0.0100) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.20% (1.9433 => 1.9666, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/flops: 1.11% (9.0760 => 9.1764, std. dev.: 0.0020) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -20.44% (0.4657 => 0.3705, std. dev.: 0.0331) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.59% (0.2670 => 0.2494, std. dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.49% (22.5627 => 21.0991, std. dev.: 0.0066) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.10% (0.3511 => 0.3297, std. dev.: 0.0034) SingleSource/UnitTests/ObjC/exceptions-3: -4.25% (0.3623 => 0.3469, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.14% (0.3650 => 0.3499, std. dev.: 0.0033) SingleSource/UnitTests/ObjC/exceptions-2: -4.11% (0.3601 => 0.3453, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -4.01% (0.3663 => 0.3516, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -4.00% (0.3646 => 0.3500, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -3.97% (0.3578 => 0.3436, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -3.88% (0.3940 => 0.3787, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -3.75% (0.3789 => 0.3647, std. dev.: 0.0027) SingleSource/UnitTests/ObjC/exceptions: -3.65% (0.3914 => 0.3771, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: -3.55% (0.4003 => 0.3861, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.94% (0.8818 => 0.8559, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: -2.51% (0.6250 => 0.6093, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.07% (0.6576 => 0.6440, std. dev.: 0.0032) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -9.79% (1.2308 => 1.1103, std. dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.56% (0.3139 => 0.2933, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.99% (1.3780 => 1.3092, std. dev.: 0.0067) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9472, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0010) SingleSource/Benchmarks/Dhrystone/dry: -3.99% (2.5089 => 2.4087, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.73% (0.3458 => 0.3329, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.63% (1.9762 => 1.9044, std. dev.: 0.0099) SingleSource/Benchmarks/Misc/richards_benchmark: -2.14% (1.1560 => 1.1313, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -2.09% (6.3560 => 6.2232, std. dev.: 0.0079) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6910, std. dev.: 0.0028) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.88% (6.6320 => 6.5073, std. dev.: 0.0019) MultiSource/Applications/minisat/minisat: -1.83% (9.3358 => 9.1648, std. dev.: 0.0232) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9956, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.47% (3.9173 => 3.8598, std. dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.40% (20.3410 => 20.0558, std. dev.: 0.0157) MultiSource/Applications/lua/lua: -1.15% (26.5159 => 26.2097, std. dev.: 0.0370) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.38s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun May 13 07:09:26 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 13 May 2012 09:09:26 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120513140926.302DF2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/634?compare_to=633&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 634, Order: 156739, Start Time: 2012-05-13 13:13:37, End Time: 2012-05-13 14:10:11 To: 633, Order: 156736, Start Time: 2012-05-13 11:50:09, End Time: 2012-05-13 12:46:44 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (55 on baseline) Performance Improvements: 0 (38 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (795 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.48% (2.0176 => 2.2694, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.90% (0.3130 => 0.3346, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.15% (0.2721 => 0.2834, std. dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.99% (3.9660 => 4.0844, std. dev.: 0.0081) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.76% (0.6959 => 0.7151, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.66% (0.5265 => 0.5405, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 2.65% (1.0594 => 1.0875, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.60% (0.9199 => 0.9438, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/football/football: 2.56% (0.8310 => 0.8523, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 2.42% (13.8202 => 14.1544, std. dev.: 0.0149) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.40% (1.2193 => 1.2486, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.36% (0.5637 => 0.5770, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.30% (1.1364 => 1.1625, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.03% (1.4563 => 1.4859, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 2.00% (2.1791 => 2.2226, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.86% (0.5577 => 0.5681, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/gs/gs: 1.81% (3.8646 => 3.9347, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.80% (13.2842 => 13.5236, std. dev.: 0.0059) MultiSource/Applications/kimwitu++/kc: 1.76% (16.6129 => 16.9053, std. dev.: 0.0194) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.66% (0.7710 => 0.7838, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.64% (1.3245 => 1.3462, std. dev.: 0.0013) MultiSource/Applications/Burg/burg: 1.54% (1.1061 => 1.1231, std. dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: 1.51% (16.2614 => 16.5065, std. dev.: 0.0103) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.51% (1.3813 => 1.4021, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.49% (0.7460 => 0.7571, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 1.45% (1.9270 => 1.9550, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.42% (1.3819 => 1.4015, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.23% (3.6692 => 3.7144, std. dev.: 0.0088) MultiSource/Applications/hbd/hbd: 1.17% (1.3693 => 1.3853, std. dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 1.04% (14.8535 => 15.0082, std. dev.: 0.0048) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.38% (1.8175 => 2.2606, std. dev.: 0.0098) SingleSource/Benchmarks/Misc/mandel-2: 8.32% (1.2998 => 1.4080, std. dev.: 0.0078) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7298, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.86% (1.5824 => 1.6751, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8146, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 3.80% (1.9144 => 1.9871, std. dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.67% (1.7688 => 1.8337, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/salsa20: 3.64% (7.4271 => 7.6974, std. dev.: 0.0023) MultiSource/Benchmarks/nbench/nbench: 3.12% (11.2619 => 11.6133, std. dev.: 0.0047) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4546, std. dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.86% (8.8259 => 9.0781, std. dev.: 0.0064) SingleSource/Benchmarks/Misc/flops-6: 2.85% (1.9199 => 1.9746, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.76% (2.8606 => 2.9395, std. dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.25% (7.9275 => 8.1061, std. dev.: 0.0180) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9603, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.57% (0.8273 => 0.8403, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5082, std. dev.: 0.0019) MultiSource/Applications/lemon/lemon: 1.39% (1.4298 => 1.4497, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.29% (2.0200 => 2.0460, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/bisort/bisort: 1.29% (0.8239 => 0.8345, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.18% (1.9433 => 1.9663, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1780, std. dev.: 0.0020) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -20.25% (0.4657 => 0.3714, std. dev.: 0.0287) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.63% (0.2670 => 0.2493, std. dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.54% (22.5627 => 21.0875, std. dev.: 0.0168) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.04% (0.3511 => 0.3299, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-3: -4.25% (0.3623 => 0.3469, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.16% (0.3650 => 0.3498, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/synchronized: -4.07% (0.3663 => 0.3514, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -4.00% (0.3601 => 0.3457, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: -4.00% (0.3578 => 0.3435, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -3.89% (0.3646 => 0.3504, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -3.86% (0.3940 => 0.3788, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -3.83% (0.3789 => 0.3644, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -3.65% (0.3914 => 0.3771, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: -3.52% (0.4003 => 0.3862, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.95% (0.8818 => 0.8558, std. dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/bigfib: -2.48% (0.6250 => 0.6095, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.10% (0.6576 => 0.6438, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -9.89% (1.2308 => 1.1091, std. dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.16% (1.0460 => 0.9502, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.59% (0.3139 => 0.2932, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9472, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -4.01% (2.5089 => 2.4084, std. dev.: 0.0026) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.73% (0.3458 => 0.3329, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.66% (1.9762 => 1.9038, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/richards_benchmark: -2.16% (1.1560 => 1.1310, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.14% (20.3410 => 19.9066, std. dev.: 0.0533) SingleSource/Benchmarks/Shootout/lists: -2.13% (6.3560 => 6.2205, std. dev.: 0.0035) MultiSource/Applications/minisat/minisat: -1.89% (9.3358 => 9.1591, std. dev.: 0.0100) MultiSource/Benchmarks/mafft/pairlocalalign: -1.87% (28.2225 => 27.6940, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.82% (6.6320 => 6.5112, std. dev.: 0.0052) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9955, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0001) MultiSource/Applications/lua/lua: -1.36% (26.5159 => 26.1559, std. dev.: 0.0461) SingleSource/Benchmarks/Shootout/heapsort: -1.27% (3.9173 => 3.8677, std. dev.: 0.0056) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.20s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun May 13 08:32:50 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 13 May 2012 10:32:50 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120513153250.3D0972A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/635?compare_to=634&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 635, Order: 156740, Start Time: 2012-05-13 14:37:07, End Time: 2012-05-13 15:33:35 To: 634, Order: 156739, Start Time: 2012-05-13 13:13:37, End Time: 2012-05-13 14:10:11 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (54 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (797 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.56% (2.0176 => 2.2710, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.77% (0.3130 => 0.3342, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.19% (0.2721 => 0.2835, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.06% (3.9660 => 4.0875, std. dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.70% (0.5265 => 0.5407, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.67% (0.6959 => 0.7145, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/football/football: 2.65% (0.8310 => 0.8530, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.59% (0.9199 => 0.9437, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.45% (0.5637 => 0.5775, std. dev.: 0.0019) MultiSource/Applications/SPASS/SPASS: 2.43% (13.8202 => 14.1560, std. dev.: 0.0083) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.37% (1.2193 => 1.2482, std. dev.: 0.0051) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.30% (1.1364 => 1.1625, std. dev.: 0.0009) MultiSource/Applications/siod/siod: 2.04% (2.1791 => 2.2235, std. dev.: 0.0158) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.94% (1.4563 => 1.4846, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.92% (0.5577 => 0.5684, std. dev.: 0.0018) MultiSource/Benchmarks/MallocBench/gs/gs: 1.77% (3.8646 => 3.9329, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.76% (13.2842 => 13.5186, std. dev.: 0.0182) MultiSource/Applications/kimwitu++/kc: 1.72% (16.6129 => 16.8991, std. dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.68% (1.3245 => 1.3467, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.66% (0.7710 => 0.7838, std. dev.: 0.0015) MultiSource/Applications/lambda-0_1_3/lambda: 1.65% (0.7038 => 0.7154, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 1.55% (16.2614 => 16.5131, std. dev.: 0.0176) MultiSource/Applications/Burg/burg: 1.53% (1.1061 => 1.1230, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.51% (0.7460 => 0.7573, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.42% (1.3819 => 1.4015, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.40% (1.3813 => 1.4007, std. dev.: 0.0057) MultiSource/Applications/treecc/treecc: 1.39% (1.9270 => 1.9537, std. dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: 1.35% (1.2749 => 1.2921, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.24% (3.6692 => 3.7147, std. dev.: 0.0031) MultiSource/Applications/hbd/hbd: 1.19% (1.3693 => 1.3856, std. dev.: 0.0012) MultiSource/Applications/JM/lencod/lencod: 1.03% (14.8535 => 15.0063, std. dev.: 0.0151) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.15% (1.8175 => 2.2564, std. dev.: 0.0548) SingleSource/Benchmarks/Misc/mandel-2: 8.09% (1.2998 => 1.4050, std. dev.: 0.0072) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6754, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.86% (1.9144 => 1.9883, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.71% (1.7688 => 1.8345, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: 3.65% (7.4271 => 7.6980, std. dev.: 0.0064) MultiSource/Benchmarks/nbench/nbench: 3.13% (11.2619 => 11.6140, std. dev.: 0.0015) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4553, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: 2.93% (1.9199 => 1.9761, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9392, std. dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.65% (8.8259 => 9.0600, std. dev.: 0.0233) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.50% (7.9275 => 8.1260, std. dev.: 0.0225) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.62% (0.8273 => 0.8407, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.52% (1.4298 => 1.4516, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5103, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.31% (2.0200 => 2.0464, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1773, std. dev.: 0.0015) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.52% (0.2670 => 0.2496, std. dev.: 0.0013) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.47% (22.5627 => 21.1036, std. dev.: 0.0056) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.12% (0.3511 => 0.3296, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -4.22% (0.3623 => 0.3470, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.19% (0.3650 => 0.3497, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-2: -4.08% (0.3601 => 0.3454, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -4.02% (0.3578 => 0.3434, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -4.00% (0.3646 => 0.3500, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -3.99% (0.3663 => 0.3517, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -3.88% (0.3789 => 0.3642, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -3.86% (0.3940 => 0.3788, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -3.60% (0.3914 => 0.3773, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.06% (0.8818 => 0.8548, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: -2.59% (0.6250 => 0.6088, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.13% (0.6576 => 0.6436, std. dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -10.98% (1.2308 => 1.0956, std. dev.: 0.0144) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.16% (1.0460 => 0.9502, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.56% (0.3139 => 0.2933, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.92% (1.3780 => 1.3102, std. dev.: 0.0064) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9473, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -4.06% (2.5089 => 2.4070, std. dev.: 0.0011) MultiSource/Benchmarks/Olden/bh/bh: -3.66% (1.9762 => 1.9038, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.64% (0.3458 => 0.3332, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: -2.17% (1.1560 => 1.1309, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: -2.06% (9.3358 => 9.1436, std. dev.: 0.0493) SingleSource/Benchmarks/Shootout/lists: -1.89% (6.3560 => 6.2358, std. dev.: 0.0031) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6916, std. dev.: 0.0020) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.88% (6.6320 => 6.5074, std. dev.: 0.0062) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9953, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.54% (20.3410 => 20.0284, std. dev.: 0.0240) SingleSource/Benchmarks/Shootout/heapsort: -1.40% (3.9173 => 3.8625, std. dev.: 0.0082) MultiSource/Applications/lua/lua: -1.14% (26.5159 => 26.2139, std. dev.: 0.0061) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.46s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun May 13 09:56:14 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 13 May 2012 11:56:14 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120513165614.107AE2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/636?compare_to=635&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 636, Order: 156744, Start Time: 2012-05-13 16:00:32, End Time: 2012-05-13 16:56:59 To: 635, Order: 156740, Start Time: 2012-05-13 14:37:07, End Time: 2012-05-13 15:33:35 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (57 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (791 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.55% (2.0176 => 2.2708, std. dev.: 0.0143) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.74% (0.3130 => 0.3341, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.26% (0.2721 => 0.2837, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.10% (3.9660 => 4.0888, std. dev.: 0.0093) MultiSource/Benchmarks/nbench/nbench: 2.73% (1.0594 => 1.0883, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.72% (0.5265 => 0.5408, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/football/football: 2.68% (0.8310 => 0.8533, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.67% (0.6959 => 0.7145, std. dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.59% (0.5637 => 0.5783, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.57% (0.9199 => 0.9435, std. dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 2.47% (13.8202 => 14.1619, std. dev.: 0.0212) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.40% (1.2193 => 1.2486, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.24% (1.1364 => 1.1619, std. dev.: 0.0006) MultiSource/Applications/siod/siod: 2.02% (2.1791 => 2.2232, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.92% (0.7710 => 0.7858, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.88% (0.5577 => 0.5682, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.84% (13.2842 => 13.5292, std. dev.: 0.0245) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.84% (1.4563 => 1.4831, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/gs/gs: 1.84% (3.8646 => 3.9356, std. dev.: 0.0027) MultiSource/Applications/kimwitu++/kc: 1.77% (16.6129 => 16.9068, std. dev.: 0.0137) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.71% (1.3245 => 1.3471, std. dev.: 0.0006) MultiSource/Applications/Burg/burg: 1.70% (1.1061 => 1.1249, std. dev.: 0.0016) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.64% (0.7460 => 0.7582, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 1.54% (16.2614 => 16.5121, std. dev.: 0.0089) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.51% (1.3813 => 1.4022, std. dev.: 0.0027) MultiSource/Applications/lambda-0_1_3/lambda: 1.48% (0.7038 => 0.7142, std. dev.: 0.0015) MultiSource/Applications/treecc/treecc: 1.45% (1.9270 => 1.9549, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.45% (1.3819 => 1.4019, std. dev.: 0.0011) MultiSource/Applications/SIBsim4/SIBsim4: 1.36% (1.2749 => 1.2923, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 1.23% (1.3693 => 1.3862, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.21% (3.6692 => 3.7137, std. dev.: 0.0083) MultiSource/Applications/JM/lencod/lencod: 1.10% (14.8535 => 15.0168, std. dev.: 0.0068) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.01% (3.2742 => 3.3073, std. dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.01% (2.1007 => 2.1219, std. dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.06% (1.8175 => 2.2548, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/mandel-2: 7.85% (1.2998 => 1.4018, std. dev.: 0.0070) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.85% (1.5824 => 1.6750, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.81% (1.9144 => 1.9873, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.69% (1.7688 => 1.8340, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: 3.64% (7.4271 => 7.6971, std. dev.: 0.0072) MultiSource/Benchmarks/nbench/nbench: 3.13% (11.2619 => 11.6148, std. dev.: 0.0014) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4548, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: 2.86% (1.9199 => 1.9749, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9392, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.72% (8.8259 => 9.0657, std. dev.: 0.0120) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.30% (7.9275 => 8.1096, std. dev.: 0.0120) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 1.62% (0.8273 => 0.8407, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.45% (1.4298 => 1.4505, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5099, std. dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.28% (2.0200 => 2.0459, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.18% (1.9433 => 1.9663, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/flops: 1.13% (9.0760 => 9.1783, std. dev.: 0.0013) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -21.97% (0.4657 => 0.3634, std. dev.: 0.0052) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.63% (0.2670 => 0.2493, std. dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.48% (22.5627 => 21.0998, std. dev.: 0.0050) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.10% (0.3511 => 0.3297, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -4.22% (0.3623 => 0.3470, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.19% (0.3650 => 0.3497, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-2: -4.11% (0.3601 => 0.3453, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: -4.05% (0.3578 => 0.3433, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: -4.01% (0.3663 => 0.3516, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -3.91% (0.3940 => 0.3786, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -3.85% (0.3789 => 0.3643, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -3.84% (0.3646 => 0.3506, std. dev.: 0.0028) SingleSource/UnitTests/ObjC/exceptions: -3.63% (0.3914 => 0.3772, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -3.57% (0.4003 => 0.3860, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.01% (0.8818 => 0.8553, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.02% (0.6576 => 0.6443, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -10.20% (1.2308 => 1.1053, std. dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.53% (0.3139 => 0.2934, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9473, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.79% (1.3780 => 1.3120, std. dev.: 0.0047) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -3.95% (2.5089 => 2.4099, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.64% (0.3458 => 0.3332, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.63% (1.9762 => 1.9044, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -2.13% (6.3560 => 6.2206, std. dev.: 0.0127) SingleSource/Benchmarks/Misc/richards_benchmark: -2.12% (1.1560 => 1.1315, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.11% (20.3410 => 19.9108, std. dev.: 0.0659) MultiSource/Applications/minisat/minisat: -1.90% (9.3358 => 9.1584, std. dev.: 0.0262) MultiSource/Benchmarks/mafft/pairlocalalign: -1.87% (28.2225 => 27.6948, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.85% (6.6320 => 6.5091, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3446, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9952, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.56% (0.9692 => 0.9541, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout/heapsort: -1.51% (3.9173 => 3.8581, std. dev.: 0.0052) MultiSource/Applications/lua/lua: -1.27% (26.5159 => 26.1789, std. dev.: 0.0105) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.23% (2.5254 => 2.4943, std. dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.13% (3.8887 => 3.8449, std. dev.: 0.0040) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.34s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun May 13 12:01:40 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 13 May 2012 14:01:40 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120513190140.F29BC2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/637?compare_to=636&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 637, Order: 156745, Start Time: 2012-05-13 18:05:58, End Time: 2012-05-13 19:02:24 To: 636, Order: 156744, Start Time: 2012-05-13 16:00:32, End Time: 2012-05-13 16:56:59 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (57 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (791 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.46% (2.0176 => 2.2690, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.84% (0.3130 => 0.3344, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.26% (0.2721 => 0.2837, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.09% (3.9660 => 4.0884, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.85% (0.5265 => 0.5415, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/football/football: 2.68% (0.8310 => 0.8533, std. dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 2.68% (1.0594 => 1.0878, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.64% (0.6959 => 0.7143, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.57% (0.9199 => 0.9435, std. dev.: 0.0018) MultiSource/Applications/SPASS/SPASS: 2.51% (13.8202 => 14.1671, std. dev.: 0.0139) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.50% (0.5637 => 0.5778, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.36% (1.2193 => 1.2481, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.27% (1.1364 => 1.1622, std. dev.: 0.0062) MultiSource/Applications/siod/siod: 2.13% (2.1791 => 2.2256, std. dev.: 0.0141) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.92% (0.5577 => 0.5684, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.88% (1.4563 => 1.4837, std. dev.: 0.0080) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.85% (13.2842 => 13.5298, std. dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.83% (1.3245 => 1.3488, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/gs/gs: 1.82% (3.8646 => 3.9351, std. dev.: 0.0057) MultiSource/Applications/kimwitu++/kc: 1.70% (16.6129 => 16.8955, std. dev.: 0.0083) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.64% (0.7460 => 0.7582, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.63% (0.7710 => 0.7836, std. dev.: 0.0028) MultiSource/Applications/sqlite3/sqlite3: 1.59% (16.2614 => 16.5201, std. dev.: 0.0176) MultiSource/Applications/Burg/burg: 1.56% (1.1061 => 1.1234, std. dev.: 0.0033) MultiSource/Applications/lambda-0_1_3/lambda: 1.53% (0.7038 => 0.7146, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.45% (1.3813 => 1.4013, std. dev.: 0.0016) MultiSource/Applications/treecc/treecc: 1.45% (1.9270 => 1.9549, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.44% (1.3819 => 1.4018, std. dev.: 0.0009) MultiSource/Applications/SIBsim4/SIBsim4: 1.39% (1.2749 => 1.2926, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 1.25% (1.3693 => 1.3864, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.22% (3.6692 => 3.7141, std. dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: 1.07% (14.8535 => 15.0118, std. dev.: 0.0153) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.01% (2.1007 => 2.1219, std. dev.: 0.0010) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 23.99% (1.8175 => 2.2536, std. dev.: 0.0347) SingleSource/Benchmarks/Misc/mandel-2: 8.69% (1.2998 => 1.4127, std. dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.52% (2.5629 => 2.7299, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.87% (1.5824 => 1.6753, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.81% (1.9144 => 1.9874, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.73% (1.7688 => 1.8347, std. dev.: 0.0047) SingleSource/Benchmarks/Misc/salsa20: 3.59% (7.4271 => 7.6939, std. dev.: 0.0083) MultiSource/Benchmarks/nbench/nbench: 3.15% (11.2619 => 11.6164, std. dev.: 0.0043) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4542, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: 2.91% (1.9199 => 1.9757, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9394, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.65% (8.8259 => 9.0602, std. dev.: 0.0180) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.27% (7.9275 => 8.1074, std. dev.: 0.0045) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9603, std. dev.: 0.0083) SingleSource/Benchmarks/Misc/ffbench: 1.62% (0.8273 => 0.8407, std. dev.: 0.0050) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5091, std. dev.: 0.0023) MultiSource/Applications/lemon/lemon: 1.39% (1.4298 => 1.4497, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.28% (2.0200 => 2.0459, std. dev.: 0.0048) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1774, std. dev.: 0.0006) MultiSource/Benchmarks/sim/sim: 1.11% (5.0168 => 5.0726, std. dev.: 0.0132) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -21.47% (0.4657 => 0.3657, std. dev.: 0.0159) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.55% (0.2670 => 0.2495, std. dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.51% (22.5627 => 21.0938, std. dev.: 0.0196) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.12% (0.3511 => 0.3296, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: -4.22% (0.3623 => 0.3470, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -4.11% (0.3601 => 0.3453, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.11% (0.3650 => 0.3500, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-4: -3.98% (0.3646 => 0.3501, std. dev.: 0.0035) SingleSource/UnitTests/ObjC/trivial-interface: -3.97% (0.3578 => 0.3436, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -3.96% (0.3663 => 0.3518, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -3.88% (0.3940 => 0.3787, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -3.80% (0.3789 => 0.3645, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -3.63% (0.3914 => 0.3772, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -3.57% (0.4003 => 0.3860, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.94% (0.8818 => 0.8559, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: -2.54% (0.6250 => 0.6091, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.05% (0.6576 => 0.6441, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -9.99% (1.2308 => 1.1079, std. dev.: 0.0064) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.56% (0.3139 => 0.2933, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9474, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.82% (1.3780 => 1.3116, std. dev.: 0.0089) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -4.09% (2.5089 => 2.4062, std. dev.: 0.0020) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.67% (0.3458 => 0.3331, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.64% (1.9762 => 1.9042, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/richards_benchmark: -2.13% (1.1560 => 1.1314, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -2.04% (6.3560 => 6.2263, std. dev.: 0.0022) MultiSource/Applications/minisat/minisat: -1.97% (9.3358 => 9.1519, std. dev.: 0.0131) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.89% (20.3410 => 19.9571, std. dev.: 0.0361) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6915, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.82% (6.6320 => 6.5116, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3446, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9955, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.38% (3.9173 => 3.8632, std. dev.: 0.0028) MultiSource/Applications/lua/lua: -1.34% (26.5159 => 26.1613, std. dev.: 0.0414) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.14% (3.8887 => 3.8445, std. dev.: 0.0055) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.77s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun May 13 15:05:01 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 13 May 2012 17:05:01 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120513220501.BAAF92A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/638?compare_to=637&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 638, Order: 156746, Start Time: 2012-05-13 21:09:16, End Time: 2012-05-13 22:05:46 To: 637, Order: 156745, Start Time: 2012-05-13 18:05:58, End Time: 2012-05-13 19:02:24 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (56 on baseline) Performance Improvements: 0 (38 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (794 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.62% (2.0176 => 2.2722, std. dev.: 0.0144) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.96% (0.3130 => 0.3348, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.41% (0.2721 => 0.2841, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.12% (3.9660 => 4.0897, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.91% (0.9199 => 0.9467, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.81% (0.5265 => 0.5413, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/football/football: 2.72% (0.8310 => 0.8536, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 2.66% (1.0594 => 1.0876, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.60% (0.6959 => 0.7140, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.52% (0.5637 => 0.5779, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 2.49% (13.8202 => 14.1643, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.42% (1.2193 => 1.2488, std. dev.: 0.0034) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.30% (1.1364 => 1.1625, std. dev.: 0.0023) MultiSource/Applications/siod/siod: 2.18% (2.1791 => 2.2266, std. dev.: 0.0142) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.06% (1.4563 => 1.4863, std. dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.03% (0.5577 => 0.5690, std. dev.: 0.0028) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.89% (13.2842 => 13.5359, std. dev.: 0.0120) MultiSource/Applications/kimwitu++/kc: 1.81% (16.6129 => 16.9128, std. dev.: 0.0135) MultiSource/Benchmarks/MallocBench/gs/gs: 1.79% (3.8646 => 3.9339, std. dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.71% (1.3245 => 1.3472, std. dev.: 0.0027) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.68% (1.3813 => 1.4045, std. dev.: 0.0016) MultiSource/Applications/lambda-0_1_3/lambda: 1.65% (0.7038 => 0.7154, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.62% (0.7710 => 0.7835, std. dev.: 0.0016) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.61% (0.7460 => 0.7580, std. dev.: 0.0018) MultiSource/Applications/sqlite3/sqlite3: 1.58% (16.2614 => 16.5179, std. dev.: 0.0179) MultiSource/Applications/treecc/treecc: 1.54% (1.9270 => 1.9567, std. dev.: 0.0062) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.53% (1.3819 => 1.4030, std. dev.: 0.0018) MultiSource/Applications/SIBsim4/SIBsim4: 1.42% (1.2749 => 1.2930, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.31% (3.6692 => 3.7173, std. dev.: 0.0063) MultiSource/Applications/hbd/hbd: 1.20% (1.3693 => 1.3858, std. dev.: 0.0013) MultiSource/Applications/JM/lencod/lencod: 1.07% (14.8535 => 15.0130, std. dev.: 0.0083) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 23.74% (1.8175 => 2.2489, std. dev.: 0.0592) SingleSource/Benchmarks/Misc/mandel-2: 7.65% (1.2998 => 1.3992, std. dev.: 0.0042) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7298, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.90% (1.5824 => 1.6757, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9877, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.69% (1.7688 => 1.8341, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/salsa20: 3.60% (7.4271 => 7.6942, std. dev.: 0.0056) MultiSource/Benchmarks/nbench/nbench: 3.15% (11.2619 => 11.6161, std. dev.: 0.0033) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4541, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/flops-6: 2.94% (1.9199 => 1.9764, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.89% (8.8259 => 9.0806, std. dev.: 0.0166) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9394, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.25% (7.9275 => 8.1060, std. dev.: 0.0143) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.57% (0.8273 => 0.8403, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5101, std. dev.: 0.0013) MultiSource/Applications/lemon/lemon: 1.38% (1.4298 => 1.4495, std. dev.: 0.0008) MultiSource/Benchmarks/Olden/bisort/bisort: 1.29% (0.8239 => 0.8345, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.28% (2.0200 => 2.0459, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.18% (1.9433 => 1.9663, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1777, std. dev.: 0.0016) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -20.98% (0.4657 => 0.3680, std. dev.: 0.0218) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.63% (0.2670 => 0.2493, std. dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.48% (22.5627 => 21.1014, std. dev.: 0.0041) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.12% (0.3511 => 0.3296, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: -4.22% (0.3623 => 0.3470, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.14% (0.3650 => 0.3499, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: -4.08% (0.3601 => 0.3454, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -4.00% (0.3578 => 0.3435, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -3.99% (0.3663 => 0.3517, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -3.87% (0.3646 => 0.3505, std. dev.: 0.0027) SingleSource/UnitTests/ObjC/for-in: -3.72% (0.3789 => 0.3648, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -3.58% (0.3914 => 0.3774, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: -3.57% (0.4003 => 0.3860, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.97% (0.8818 => 0.8556, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: -2.53% (0.6250 => 0.6092, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.10% (0.6576 => 0.6438, std. dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -10.04% (1.2308 => 1.1072, std. dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0011) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.56% (0.3139 => 0.2933, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.10% (1.3780 => 1.3077, std. dev.: 0.0095) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9474, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0011) SingleSource/Benchmarks/Dhrystone/dry: -3.99% (2.5089 => 2.4088, std. dev.: 0.0010) MultiSource/Benchmarks/Olden/bh/bh: -3.66% (1.9762 => 1.9039, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.64% (0.3458 => 0.3332, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.14% (20.3410 => 19.9065, std. dev.: 0.0401) SingleSource/Benchmarks/Misc/richards_benchmark: -2.12% (1.1560 => 1.1315, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -2.05% (6.3560 => 6.2258, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -2.03% (6.6320 => 6.4976, std. dev.: 0.0025) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6927, std. dev.: 0.0029) MultiSource/Applications/minisat/minisat: -1.80% (9.3358 => 9.1680, std. dev.: 0.0334) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3446, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9952, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.47% (3.9173 => 3.8598, std. dev.: 0.0038) MultiSource/Applications/lua/lua: -1.27% (26.5159 => 26.1787, std. dev.: 0.0347) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.68s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun May 13 22:21:03 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 14 May 2012 00:21:03 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120514052103.9D5C82A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/639?compare_to=638&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 639, Order: 156752, Start Time: 2012-05-14 04:25:16, End Time: 2012-05-14 05:21:48 To: 638, Order: 156746, Start Time: 2012-05-13 21:09:16, End Time: 2012-05-13 22:05:46 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (55 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (794 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.55% (2.0176 => 2.2708, std. dev.: 0.0166) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.87% (0.3130 => 0.3345, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.19% (0.2721 => 0.2835, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.13% (3.9660 => 4.0900, std. dev.: 0.0080) MultiSource/Benchmarks/nbench/nbench: 2.76% (1.0594 => 1.0886, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.72% (0.5265 => 0.5408, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: 2.68% (0.8310 => 0.8533, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.62% (0.6959 => 0.7141, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.57% (0.5637 => 0.5782, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.55% (0.9199 => 0.9434, std. dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 2.49% (13.8202 => 14.1643, std. dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.39% (1.2193 => 1.2485, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.39% (1.1364 => 1.1636, std. dev.: 0.0064) MultiSource/Applications/siod/siod: 2.16% (2.1791 => 2.2262, std. dev.: 0.0137) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.13% (1.4563 => 1.4873, std. dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.08% (0.5577 => 0.5693, std. dev.: 0.0030) MultiSource/Benchmarks/MallocBench/gs/gs: 1.84% (3.8646 => 3.9358, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.81% (1.3245 => 1.3485, std. dev.: 0.0013) MultiSource/Applications/kimwitu++/kc: 1.80% (16.6129 => 16.9122, std. dev.: 0.0126) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.80% (13.2842 => 13.5232, std. dev.: 0.0192) MultiSource/Applications/lambda-0_1_3/lambda: 1.73% (0.7038 => 0.7160, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.61% (0.7460 => 0.7580, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 1.58% (1.1061 => 1.1236, std. dev.: 0.0014) MultiSource/Applications/sqlite3/sqlite3: 1.56% (16.2614 => 16.5150, std. dev.: 0.0218) MultiSource/Applications/treecc/treecc: 1.52% (1.9270 => 1.9562, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.50% (0.7710 => 0.7826, std. dev.: 0.0039) MultiSource/Applications/SIBsim4/SIBsim4: 1.47% (1.2749 => 1.2937, std. dev.: 0.0039) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.42% (1.3819 => 1.4015, std. dev.: 0.0009) MultiSource/Applications/hbd/hbd: 1.22% (1.3693 => 1.3860, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.20% (3.6692 => 3.7134, std. dev.: 0.0114) MultiSource/Applications/JM/lencod/lencod: 1.08% (14.8535 => 15.0136, std. dev.: 0.0153) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.14% (1.8175 => 2.2562, std. dev.: 0.0159) SingleSource/Benchmarks/Misc/mandel-2: 7.41% (1.2998 => 1.3961, std. dev.: 0.0082) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.87% (1.5824 => 1.6753, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.86% (1.9144 => 1.9883, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: 3.66% (7.4271 => 7.6991, std. dev.: 0.0055) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.65% (1.7688 => 1.8334, std. dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 3.12% (11.2619 => 11.6131, std. dev.: 0.0014) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4534, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-6: 2.90% (1.9199 => 1.9755, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9393, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.71% (8.8259 => 9.0651, std. dev.: 0.0246) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.46% (7.9275 => 8.1227, std. dev.: 0.0070) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/ffbench: 1.58% (0.8273 => 0.8404, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.45% (1.4298 => 1.4505, std. dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5097, std. dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.28% (2.0200 => 2.0458, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.19% (1.9433 => 1.9664, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/flops: 1.13% (9.0760 => 9.1789, std. dev.: 0.0007) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -21.75% (0.4657 => 0.3644, std. dev.: 0.0352) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.55% (0.2670 => 0.2495, std. dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.50% (22.5627 => 21.0950, std. dev.: 0.0090) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.04% (0.3511 => 0.3299, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -4.17% (0.3623 => 0.3472, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -4.11% (0.3601 => 0.3453, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.08% (0.3650 => 0.3501, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -4.00% (0.3578 => 0.3435, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -3.99% (0.3663 => 0.3517, std. dev.: 0.0017) SingleSource/UnitTests/ObjC/exceptions-4: -3.95% (0.3646 => 0.3502, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -3.91% (0.3940 => 0.3786, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -3.77% (0.3789 => 0.3646, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -3.53% (0.3914 => 0.3776, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.98% (0.8818 => 0.8555, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: -2.40% (0.6250 => 0.6100, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.01% (0.6576 => 0.6444, std. dev.: 0.0009) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -10.20% (1.2308 => 1.1053, std. dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.16% (1.0460 => 0.9502, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.59% (0.3139 => 0.2932, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.32% (1.3780 => 1.3047, std. dev.: 0.0077) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9473, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -4.01% (2.5089 => 2.4082, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.68% (1.9762 => 1.9035, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/richards_benchmark: -2.15% (1.1560 => 1.1312, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -2.06% (6.3560 => 6.2250, std. dev.: 0.0057) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.98% (20.3410 => 19.9374, std. dev.: 0.0468) MultiSource/Applications/minisat/minisat: -1.95% (9.3358 => 9.1542, std. dev.: 0.0227) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.92% (6.6320 => 6.5047, std. dev.: 0.0030) MultiSource/Benchmarks/mafft/pairlocalalign: -1.89% (28.2225 => 27.6894, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9954, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.53% (3.9173 => 3.8573, std. dev.: 0.0036) MultiSource/Applications/lua/lua: -1.21% (26.5159 => 26.1962, std. dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.05% (3.8887 => 3.8479, std. dev.: 0.0051) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.35s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun May 13 23:44:28 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 14 May 2012 01:44:28 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120514064428.90F852A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/640?compare_to=639&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 640, Order: 156753, Start Time: 2012-05-14 05:48:44, End Time: 2012-05-14 06:45:13 To: 639, Order: 156752, Start Time: 2012-05-14 04:25:16, End Time: 2012-05-14 05:21:48 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (59 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (790 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.54% (2.0176 => 2.2707, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.90% (0.3130 => 0.3346, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.23% (0.2721 => 0.2836, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.15% (3.9660 => 4.0909, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.85% (0.5265 => 0.5415, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.85% (0.6959 => 0.7157, std. dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/football/football: 2.79% (0.8310 => 0.8542, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 2.72% (1.0594 => 1.0882, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.70% (0.9199 => 0.9447, std. dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 2.50% (13.8202 => 14.1662, std. dev.: 0.0151) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.47% (0.5637 => 0.5776, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.45% (1.2193 => 1.2492, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.34% (1.1364 => 1.1630, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 2.22% (2.1791 => 2.2274, std. dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.13% (0.5577 => 0.5696, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.00% (1.4563 => 1.4854, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/gs/gs: 1.91% (3.8646 => 3.9384, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.88% (13.2842 => 13.5342, std. dev.: 0.0075) MultiSource/Applications/kimwitu++/kc: 1.83% (16.6129 => 16.9164, std. dev.: 0.0254) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.81% (1.3245 => 1.3485, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.72% (0.7460 => 0.7588, std. dev.: 0.0005) MultiSource/Applications/Burg/burg: 1.68% (1.1061 => 1.1247, std. dev.: 0.0025) MultiSource/Applications/lambda-0_1_3/lambda: 1.68% (0.7038 => 0.7156, std. dev.: 0.0015) MultiSource/Applications/treecc/treecc: 1.61% (1.9270 => 1.9581, std. dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: 1.61% (16.2614 => 16.5230, std. dev.: 0.0068) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.61% (0.7710 => 0.7834, std. dev.: 0.0027) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.53% (1.3813 => 1.4025, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.50% (1.3819 => 1.4026, std. dev.: 0.0026) MultiSource/Applications/SIBsim4/SIBsim4: 1.37% (1.2749 => 1.2924, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.27% (3.6692 => 3.7159, std. dev.: 0.0019) MultiSource/Applications/hbd/hbd: 1.27% (1.3693 => 1.3867, std. dev.: 0.0024) MultiSource/Applications/JM/lencod/lencod: 1.10% (14.8535 => 15.0169, std. dev.: 0.0202) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.02% (3.2742 => 3.3077, std. dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.24% (1.8175 => 2.2580, std. dev.: 0.0531) MultiSource/Benchmarks/McCat/17-bintr/bintr: 12.33% (0.0957 => 0.1075, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 7.76% (1.2998 => 1.4007, std. dev.: 0.0096) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7298, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6754, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9878, std. dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.69% (1.7688 => 1.8341, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: 3.66% (7.4271 => 7.6990, std. dev.: 0.0032) MultiSource/Benchmarks/nbench/nbench: 3.19% (11.2619 => 11.6207, std. dev.: 0.0031) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4538, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.92% (8.8259 => 9.0837, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/flops-6: 2.83% (1.9199 => 1.9743, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.74% (2.8606 => 2.9391, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.61% (7.9275 => 8.1346, std. dev.: 0.0051) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: 1.65% (5.0168 => 5.0995, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/ffbench: 1.60% (0.8273 => 0.8405, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.48% (1.4298 => 1.4510, std. dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.43% (8.3908 => 8.5109, std. dev.: 0.0019) SingleSource/Benchmarks/Dhrystone/fldry: 1.34% (1.9290 => 1.9549, std. dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.28% (2.0200 => 2.0458, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.24% (1.9433 => 1.9673, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1777, std. dev.: 0.0005) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -20.89% (0.4657 => 0.3684, std. dev.: 0.0152) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.59% (0.2670 => 0.2494, std. dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.41% (22.5627 => 21.1169, std. dev.: 0.0176) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.10% (0.3511 => 0.3297, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -4.17% (0.3623 => 0.3472, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.05% (0.3650 => 0.3502, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -4.03% (0.3601 => 0.3456, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -3.98% (0.3646 => 0.3501, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -3.96% (0.3663 => 0.3518, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -3.80% (0.3578 => 0.3442, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: -3.80% (0.3789 => 0.3645, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -3.78% (0.3940 => 0.3791, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -3.55% (0.3914 => 0.3775, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -3.42% (0.4003 => 0.3866, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.91% (0.8818 => 0.8561, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: -2.34% (0.6250 => 0.6104, std. dev.: 0.0040) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.05% (0.6576 => 0.6441, std. dev.: 0.0010) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -9.77% (1.2308 => 1.1105, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.16% (1.0460 => 0.9502, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.53% (0.3139 => 0.2934, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9475, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.48% (1.3780 => 1.3162, std. dev.: 0.0020) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -4.00% (2.5089 => 2.4085, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.67% (0.3458 => 0.3331, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.62% (1.9762 => 1.9047, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: -2.16% (1.1560 => 1.1310, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: -2.01% (9.3358 => 9.1483, std. dev.: 0.0048) SingleSource/Benchmarks/Shootout/lists: -2.00% (6.3560 => 6.2291, std. dev.: 0.0022) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6917, std. dev.: 0.0017) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.84% (6.6320 => 6.5098, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.73% (20.3410 => 19.9896, std. dev.: 0.0400) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3444, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9960, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/heapsort: -1.57% (3.9173 => 3.8557, std. dev.: 0.0078) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.56% (0.9692 => 0.9541, std. dev.: 0.0000) MultiSource/Applications/lua/lua: -1.22% (26.5159 => 26.1925, std. dev.: 0.0264) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.82s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon May 14 01:11:56 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 14 May 2012 03:11:56 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120514081156.095282A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/641?compare_to=640&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 641, Order: 156754, Start Time: 2012-05-14 07:15:51, End Time: 2012-05-14 08:12:40 To: 640, Order: 156753, Start Time: 2012-05-14 05:48:44, End Time: 2012-05-14 06:45:13 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (56 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 891 (793 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 25.87% (0.3684 => 0.4637, std. dev.: 0.0304) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.52% (2.0176 => 2.2702, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.90% (0.3130 => 0.3346, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.19% (0.2721 => 0.2835, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.07% (3.9660 => 4.0878, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.95% (1.1364 => 1.1699, std. dev.: 0.0067) MultiSource/Benchmarks/nbench/nbench: 2.78% (1.0594 => 1.0889, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.77% (0.5265 => 0.5411, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/football/football: 2.73% (0.8310 => 0.8537, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.59% (0.9199 => 0.9437, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.57% (0.6959 => 0.7138, std. dev.: 0.0042) MultiSource/Applications/SPASS/SPASS: 2.54% (13.8202 => 14.1717, std. dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.50% (0.5637 => 0.5778, std. dev.: 0.0013) MultiSource/Applications/hbd/hbd: 2.48% (1.3693 => 1.4033, std. dev.: 0.0106) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.42% (1.4563 => 1.4915, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.41% (1.2193 => 1.2487, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.38% (0.5577 => 0.5710, std. dev.: 0.0010) MultiSource/Applications/siod/siod: 2.35% (2.1791 => 2.2302, std. dev.: 0.0190) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.08% (0.7710 => 0.7870, std. dev.: 0.0043) MultiSource/Applications/sqlite3/sqlite3: 1.90% (16.2614 => 16.5696, std. dev.: 0.0919) MultiSource/Benchmarks/MallocBench/gs/gs: 1.83% (3.8646 => 3.9355, std. dev.: 0.0043) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.81% (13.2842 => 13.5243, std. dev.: 0.0105) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.80% (1.3245 => 1.3484, std. dev.: 0.0007) MultiSource/Applications/kimwitu++/kc: 1.77% (16.6129 => 16.9074, std. dev.: 0.0130) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.73% (0.7460 => 0.7589, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.58% (1.3819 => 1.4037, std. dev.: 0.0072) MultiSource/Applications/treecc/treecc: 1.56% (1.9270 => 1.9570, std. dev.: 0.0010) MultiSource/Applications/Burg/burg: 1.55% (1.1061 => 1.1232, std. dev.: 0.0061) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.52% (1.3813 => 1.4023, std. dev.: 0.0008) MultiSource/Applications/SIBsim4/SIBsim4: 1.47% (1.2749 => 1.2936, std. dev.: 0.0023) MultiSource/Applications/JM/lencod/lencod: 1.29% (14.8535 => 15.0451, std. dev.: 0.0070) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.25% (3.6692 => 3.7150, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.06% (2.1007 => 2.1229, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.02% (3.2742 => 3.3076, std. dev.: 0.0017) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 23.86% (1.8175 => 2.2512, std. dev.: 0.0069) SingleSource/Benchmarks/Misc/mandel-2: 8.19% (1.2998 => 1.4062, std. dev.: 0.0103) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.87% (1.5824 => 1.6753, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8146, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 3.81% (1.9144 => 1.9873, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.64% (1.7688 => 1.8332, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/salsa20: 3.61% (7.4271 => 7.6954, std. dev.: 0.0077) MultiSource/Benchmarks/nbench/nbench: 3.13% (11.2619 => 11.6143, std. dev.: 0.0033) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 3.02% (8.8259 => 9.0922, std. dev.: 0.0049) MultiSource/Applications/hexxagon/hexxagon: 3.01% (12.0921 => 12.4555, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/flops-6: 2.84% (1.9199 => 1.9745, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.74% (2.8606 => 2.9391, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.49% (7.9275 => 8.1252, std. dev.: 0.0043) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.56% (0.8273 => 0.8402, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.54% (1.4298 => 1.4518, std. dev.: 0.0028) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5091, std. dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.28% (2.0200 => 2.0458, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.19% (1.9433 => 1.9665, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1778, std. dev.: 0.0007) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.67% (0.2670 => 0.2492, std. dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.49% (22.5627 => 21.0990, std. dev.: 0.0091) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.18% (0.3511 => 0.3294, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.11% (0.3650 => 0.3500, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-2: -4.08% (0.3601 => 0.3454, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -4.07% (0.3663 => 0.3514, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-3: -4.03% (0.3623 => 0.3477, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: -3.98% (0.3646 => 0.3501, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/property: -3.93% (0.3940 => 0.3785, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: -3.88% (0.3578 => 0.3439, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -3.80% (0.3789 => 0.3645, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -3.53% (0.3914 => 0.3776, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/parameter-passing: -3.42% (0.4003 => 0.3866, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.57% (0.8818 => 0.8591, std. dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/bigfib: -2.43% (0.6250 => 0.6098, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.64% (0.6576 => 0.6468, std. dev.: 0.0007) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -10.36% (1.2308 => 1.1033, std. dev.: 0.0051) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.16% (1.0460 => 0.9502, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.53% (0.3139 => 0.2934, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2642, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.25% (1.3780 => 1.3057, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9471, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -4.04% (2.5089 => 2.4076, std. dev.: 0.0012) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.65% (1.9762 => 1.9041, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/richards_benchmark: -2.12% (1.1560 => 1.1315, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: -2.01% (9.3358 => 9.1482, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout/lists: -1.90% (6.3560 => 6.2354, std. dev.: 0.0097) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6914, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.87% (6.6320 => 6.5082, std. dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.85% (20.3410 => 19.9637, std. dev.: 0.0730) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3444, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9957, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/heapsort: -1.45% (3.9173 => 3.8605, std. dev.: 0.0040) MultiSource/Applications/lua/lua: -1.16% (26.5159 => 26.2070, std. dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.11% (3.8887 => 3.8455, std. dev.: 0.0028) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.68s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon May 14 02:36:11 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 14 May 2012 04:36:11 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120514093611.CDA222A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/642?compare_to=641&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 642, Order: 156755, Start Time: 2012-05-14 08:39:50, End Time: 2012-05-14 09:36:56 To: 641, Order: 156754, Start Time: 2012-05-14 07:15:51, End Time: 2012-05-14 08:12:40 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (58 on baseline) Performance Improvements: 3 (39 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 889 (791 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/hbd/hbd: -1.10% (1.4033 => 1.3878, std. dev.: 0.0049) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: -1.71% (1.4062 => 1.3822, std. dev.: 0.0053) SingleSource/Benchmarks/Shootout/ary3: -1.22% (3.7325 => 3.6870, std. dev.: 0.0072) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.70% (2.0176 => 2.2739, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.12% (0.3130 => 0.3353, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.15% (0.2721 => 0.2834, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.24% (3.9660 => 4.0944, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.92% (0.6959 => 0.7162, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.87% (0.5265 => 0.5416, std. dev.: 0.0014) MultiSource/Benchmarks/nbench/nbench: 2.79% (1.0594 => 1.0890, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/football/football: 2.78% (0.8310 => 0.8541, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.71% (0.9199 => 0.9448, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.61% (0.5637 => 0.5784, std. dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 2.59% (13.8202 => 14.1787, std. dev.: 0.0072) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.46% (1.1364 => 1.1643, std. dev.: 0.0019) MultiSource/Applications/siod/siod: 2.28% (2.1791 => 2.2287, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.08% (0.5577 => 0.5693, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.08% (13.2842 => 13.5605, std. dev.: 0.0125) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.96% (1.4563 => 1.4848, std. dev.: 0.0035) MultiSource/Benchmarks/MallocBench/gs/gs: 1.95% (3.8646 => 3.9399, std. dev.: 0.0061) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.93% (0.7710 => 0.7859, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.87% (1.3819 => 1.4078, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.86% (1.3245 => 1.3491, std. dev.: 0.0021) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.81% (1.3813 => 1.4063, std. dev.: 0.0014) MultiSource/Applications/kimwitu++/kc: 1.80% (16.6129 => 16.9122, std. dev.: 0.0133) MultiSource/Applications/lambda-0_1_3/lambda: 1.79% (0.7038 => 0.7164, std. dev.: 0.0011) MultiSource/Applications/Burg/burg: 1.71% (1.1061 => 1.1250, std. dev.: 0.0034) MultiSource/Applications/sqlite3/sqlite3: 1.69% (16.2614 => 16.5362, std. dev.: 0.0165) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.62% (0.7460 => 0.7581, std. dev.: 0.0006) MultiSource/Applications/treecc/treecc: 1.61% (1.9270 => 1.9581, std. dev.: 0.0014) MultiSource/Applications/SIBsim4/SIBsim4: 1.41% (1.2749 => 1.2929, std. dev.: 0.0038) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.38% (3.6692 => 3.7197, std. dev.: 0.0091) MultiSource/Applications/hbd/hbd: 1.35% (1.3693 => 1.3878, std. dev.: 0.0049) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.23% (2.1007 => 2.1266, std. dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 1.22% (14.8535 => 15.0341, std. dev.: 0.0189) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.08% (3.2742 => 3.3097, std. dev.: 0.0022) MultiSource/Applications/JM/ldecod/ldecod: 1.01% (6.5754 => 6.6415, std. dev.: 0.0143) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.72% (1.8175 => 2.2668, std. dev.: 0.0443) SingleSource/Benchmarks/Misc/flops-4: 6.52% (1.0640 => 1.1334, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.34% (1.2998 => 1.3822, std. dev.: 0.0053) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.93% (1.5824 => 1.6763, std. dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9879, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.67% (1.7688 => 1.8338, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: 3.59% (7.4271 => 7.6935, std. dev.: 0.0088) MultiSource/Benchmarks/nbench/nbench: 3.12% (11.2619 => 11.6135, std. dev.: 0.0025) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4538, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-6: 2.91% (1.9199 => 1.9758, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.74% (2.8606 => 2.9391, std. dev.: 0.0024) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.74% (8.8259 => 9.0676, std. dev.: 0.0162) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.31% (7.9275 => 8.1104, std. dev.: 0.0179) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9603, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.60% (0.8273 => 0.8405, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.45% (1.4298 => 1.4505, std. dev.: 0.0018) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5093, std. dev.: 0.0086) MultiSource/Benchmarks/sim/sim: 1.35% (5.0168 => 5.0844, std. dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.27% (2.0200 => 2.0457, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 1.10% (9.0760 => 9.1762, std. dev.: 0.0014) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.85% (0.2670 => 0.2487, std. dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.29% (22.5627 => 21.1444, std. dev.: 0.0044) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.12% (0.3511 => 0.3296, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-3: -4.11% (0.3623 => 0.3474, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -4.00% (0.3601 => 0.3457, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.92% (0.3650 => 0.3507, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/synchronized: -3.88% (0.3663 => 0.3521, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -3.84% (0.3646 => 0.3506, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -3.80% (0.3578 => 0.3442, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -3.76% (0.3940 => 0.3792, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -3.72% (0.3789 => 0.3648, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions: -3.53% (0.3914 => 0.3776, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -3.37% (0.4003 => 0.3868, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.85% (0.8818 => 0.8567, std. dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/bigfib: -2.43% (0.6250 => 0.6098, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.16% (0.6576 => 0.6434, std. dev.: 0.0012) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -10.90% (1.2308 => 1.0967, std. dev.: 0.0120) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.16% (1.0460 => 0.9502, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.53% (0.3139 => 0.2934, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.29% (1.3780 => 1.3051, std. dev.: 0.0044) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9472, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -4.04% (2.5089 => 2.4075, std. dev.: 0.0012) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -3.61% (1.9762 => 1.9049, std. dev.: 0.0044) SingleSource/Benchmarks/Misc/richards_benchmark: -2.13% (1.1560 => 1.1314, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: -2.07% (9.3358 => 9.1423, std. dev.: 0.0301) SingleSource/Benchmarks/Shootout/lists: -2.02% (6.3560 => 6.2279, std. dev.: 0.0018) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.91% (6.6320 => 6.5050, std. dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: -1.87% (28.2225 => 27.6946, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.72% (20.3410 => 19.9919, std. dev.: 0.0632) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9958, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.51% (3.9173 => 3.8580, std. dev.: 0.0149) MultiSource/Applications/lua/lua: -1.14% (26.5159 => 26.2144, std. dev.: 0.0176) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.12% (3.8887 => 3.8452, std. dev.: 0.0039) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.67s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon May 14 03:59:47 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 14 May 2012 05:59:47 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120514105947.550A12A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/643?compare_to=642&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 643, Order: 156757, Start Time: 2012-05-14 10:04:02, End Time: 2012-05-14 11:00:33 To: 642, Order: 156755, Start Time: 2012-05-14 08:39:50, End Time: 2012-05-14 09:36:56 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (57 on baseline) Performance Improvements: 1 (39 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 890 (792 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 2.35% (1.3822 => 1.4147, std. dev.: 0.0018) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -12.48% (0.4198 => 0.3674, std. dev.: 0.0069) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.64% (2.0176 => 2.2726, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.90% (0.3130 => 0.3346, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.12% (0.2721 => 0.2833, std. dev.: 0.0030) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.20% (3.9660 => 4.0928, std. dev.: 0.0040) MultiSource/Benchmarks/nbench/nbench: 2.78% (1.0594 => 1.0888, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.77% (0.5265 => 0.5411, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 2.72% (0.8310 => 0.8536, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.70% (0.9199 => 0.9447, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.66% (0.6959 => 0.7144, std. dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 2.61% (13.8202 => 14.1814, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.59% (0.5637 => 0.5783, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.50% (1.2193 => 1.2498, std. dev.: 0.0099) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.45% (1.1364 => 1.1642, std. dev.: 0.0011) MultiSource/Applications/siod/siod: 2.14% (2.1791 => 2.2258, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.08% (1.4563 => 1.4866, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.97% (0.7710 => 0.7862, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.93% (13.2842 => 13.5407, std. dev.: 0.0244) MultiSource/Benchmarks/MallocBench/gs/gs: 1.91% (3.8646 => 3.9383, std. dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.84% (1.3245 => 1.3489, std. dev.: 0.0020) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.78% (1.3813 => 1.4059, std. dev.: 0.0017) MultiSource/Applications/lambda-0_1_3/lambda: 1.72% (0.7038 => 0.7159, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.69% (0.7460 => 0.7586, std. dev.: 0.0011) MultiSource/Applications/kimwitu++/kc: 1.69% (16.6129 => 16.8929, std. dev.: 0.0135) MultiSource/Applications/sqlite3/sqlite3: 1.67% (16.2614 => 16.5336, std. dev.: 0.0149) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.66% (1.3819 => 1.4048, std. dev.: 0.0022) MultiSource/Applications/treecc/treecc: 1.65% (1.9270 => 1.9588, std. dev.: 0.0038) MultiSource/Applications/Burg/burg: 1.65% (1.1061 => 1.1243, std. dev.: 0.0024) MultiSource/Applications/SIBsim4/SIBsim4: 1.42% (1.2749 => 1.2930, std. dev.: 0.0017) MultiSource/Applications/hbd/hbd: 1.26% (1.3693 => 1.3865, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.24% (3.6692 => 3.7148, std. dev.: 0.0026) MultiSource/Applications/JM/lencod/lencod: 1.18% (14.8535 => 15.0292, std. dev.: 0.0104) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.18% (2.1007 => 2.1254, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.12% (3.2742 => 3.3109, std. dev.: 0.0071) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.80% (1.8175 => 2.2682, std. dev.: 0.0136) SingleSource/Benchmarks/Misc/mandel-2: 8.84% (1.2998 => 1.4147, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.87% (1.5824 => 1.6753, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9876, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: 3.70% (7.4271 => 7.7018, std. dev.: 0.0033) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.68% (1.7688 => 1.8339, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 3.16% (11.2619 => 11.6178, std. dev.: 0.0033) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 3.07% (8.8259 => 9.0965, std. dev.: 0.0028) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4550, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: 2.83% (1.9199 => 1.9743, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9393, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.59% (7.9275 => 8.1331, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.60% (0.8273 => 0.8405, std. dev.: 0.0012) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5100, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.42% (1.4298 => 1.4501, std. dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.29% (2.0200 => 2.0461, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.13% (1.9433 => 1.9653, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops: 1.11% (9.0760 => 9.1769, std. dev.: 0.0025) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -21.11% (0.4657 => 0.3674, std. dev.: 0.0069) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.89% (0.2670 => 0.2486, std. dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.35% (22.5627 => 21.1298, std. dev.: 0.0147) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.15% (0.3511 => 0.3295, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-3: -4.06% (0.3623 => 0.3476, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.03% (0.3650 => 0.3503, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -3.97% (0.3601 => 0.3458, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -3.88% (0.3578 => 0.3439, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -3.87% (0.3646 => 0.3505, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -3.85% (0.3663 => 0.3522, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -3.68% (0.3940 => 0.3795, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -3.67% (0.3789 => 0.3650, std. dev.: 0.0029) SingleSource/UnitTests/ObjC/exceptions: -3.50% (0.3914 => 0.3777, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -3.47% (0.4003 => 0.3864, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.72% (0.8818 => 0.8578, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/bigfib: -2.43% (0.6250 => 0.6098, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.08% (0.6576 => 0.6439, std. dev.: 0.0007) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -10.72% (1.2308 => 1.0988, std. dev.: 0.0061) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.16% (1.0460 => 0.9502, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.56% (0.3139 => 0.2933, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9475, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.39% (1.3780 => 1.3175, std. dev.: 0.0014) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -4.01% (2.5089 => 2.4082, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.73% (0.3458 => 0.3329, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -3.62% (1.9762 => 1.9047, std. dev.: 0.0081) SingleSource/Benchmarks/Shootout/lists: -2.20% (6.3560 => 6.2161, std. dev.: 0.0105) SingleSource/Benchmarks/Misc/richards_benchmark: -2.15% (1.1560 => 1.1311, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: -2.01% (9.3358 => 9.1484, std. dev.: 0.0108) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.97% (20.3410 => 19.9410, std. dev.: 0.0264) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.91% (6.6320 => 6.5055, std. dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6925, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9958, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0003) MultiSource/Applications/lua/lua: -1.49% (26.5159 => 26.1211, std. dev.: 0.0569) SingleSource/Benchmarks/Shootout/heapsort: -1.38% (3.9173 => 3.8633, std. dev.: 0.0003) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.28s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon May 14 09:31:59 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 14 May 2012 11:31:59 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120514163159.14F442A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/644?compare_to=643&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 644, Order: 156760, Start Time: 2012-05-14 15:36:08, End Time: 2012-05-14 16:32:43 To: 643, Order: 156757, Start Time: 2012-05-14 10:04:02, End Time: 2012-05-14 11:00:33 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (59 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (792 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.59% (2.0176 => 2.2717, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.96% (0.3130 => 0.3348, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.19% (0.2721 => 0.2835, std. dev.: 0.0017) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.15% (3.9660 => 4.0908, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.02% (0.5265 => 0.5424, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.85% (0.6959 => 0.7157, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.78% (0.9199 => 0.9455, std. dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 2.78% (1.0594 => 1.0888, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 2.77% (0.8310 => 0.8540, std. dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 2.60% (13.8202 => 14.1796, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.49% (1.2193 => 1.2496, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.38% (0.5637 => 0.5771, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.35% (1.1364 => 1.1631, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 2.22% (2.1791 => 2.2275, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.06% (0.7710 => 0.7869, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.03% (1.4563 => 1.4858, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.99% (0.5577 => 0.5688, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.98% (13.2842 => 13.5466, std. dev.: 0.0157) MultiSource/Benchmarks/MallocBench/gs/gs: 1.97% (3.8646 => 3.9406, std. dev.: 0.0142) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.96% (1.3245 => 1.3504, std. dev.: 0.0079) MultiSource/Applications/lambda-0_1_3/lambda: 1.82% (0.7038 => 0.7166, std. dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 1.78% (16.6129 => 16.9083, std. dev.: 0.0075) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.77% (1.3813 => 1.4058, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.74% (1.3819 => 1.4059, std. dev.: 0.0021) MultiSource/Applications/treecc/treecc: 1.67% (1.9270 => 1.9591, std. dev.: 0.0048) MultiSource/Applications/sqlite3/sqlite3: 1.65% (16.2614 => 16.5303, std. dev.: 0.0206) MultiSource/Applications/Burg/burg: 1.57% (1.1061 => 1.1235, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.57% (0.7460 => 0.7577, std. dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: 1.41% (1.2749 => 1.2929, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.28% (3.6692 => 3.7162, std. dev.: 0.0049) MultiSource/Applications/hbd/hbd: 1.28% (1.3693 => 1.3868, std. dev.: 0.0034) MultiSource/Applications/JM/lencod/lencod: 1.25% (14.8535 => 15.0399, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.22% (2.1007 => 2.1263, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.12% (3.2742 => 3.3109, std. dev.: 0.0042) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.18% (1.8175 => 2.2570, std. dev.: 0.0439) SingleSource/Benchmarks/Misc/mandel-2: 7.84% (1.2998 => 1.4017, std. dev.: 0.0122) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7298, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.90% (1.5824 => 1.6758, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8143, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9876, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: 3.82% (7.4271 => 7.7105, std. dev.: 0.0035) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.70% (1.7688 => 1.8343, std. dev.: 0.0062) MultiSource/Benchmarks/nbench/nbench: 3.17% (11.2619 => 11.6189, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4551, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: 2.92% (1.9199 => 1.9760, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.76% (2.8606 => 2.9396, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.62% (8.8259 => 9.0572, std. dev.: 0.0257) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.54% (7.9275 => 8.1289, std. dev.: 0.0047) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.60% (0.8273 => 0.8405, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.45% (1.4298 => 1.4506, std. dev.: 0.0012) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5084, std. dev.: 0.0035) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.25% (2.0200 => 2.0453, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.19% (1.9433 => 1.9665, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0036) MultiSource/Benchmarks/sim/sim: 1.14% (5.0168 => 5.0740, std. dev.: 0.0130) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1777, std. dev.: 0.0010) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -20.57% (0.4657 => 0.3699, std. dev.: 0.0041) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.89% (0.2670 => 0.2486, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.35% (22.5627 => 21.1299, std. dev.: 0.0027) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.12% (0.3511 => 0.3296, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -4.03% (0.3623 => 0.3477, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.95% (0.3650 => 0.3506, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -3.92% (0.3601 => 0.3460, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -3.86% (0.3578 => 0.3440, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -3.85% (0.3663 => 0.3522, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -3.76% (0.3940 => 0.3792, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -3.68% (0.3646 => 0.3512, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -3.67% (0.3789 => 0.3650, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -3.40% (0.4003 => 0.3867, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.78% (0.8818 => 0.8573, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: -2.35% (0.6250 => 0.6103, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -10.81% (1.2308 => 1.0978, std. dev.: 0.0356) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.16% (1.0460 => 0.9502, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9474, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.75% (1.3780 => 1.3125, std. dev.: 0.0031) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -4.00% (2.5089 => 2.4085, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.73% (0.3458 => 0.3329, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.63% (1.9762 => 1.9044, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/lists: -2.25% (6.3560 => 6.2128, std. dev.: 0.0125) SingleSource/Benchmarks/Misc/richards_benchmark: -2.15% (1.1560 => 1.1311, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -2.05% (6.6320 => 6.4959, std. dev.: 0.0086) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.95% (20.3410 => 19.9441, std. dev.: 0.0243) MultiSource/Applications/minisat/minisat: -1.93% (9.3358 => 9.1560, std. dev.: 0.0360) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6911, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9957, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.45% (3.9173 => 3.8605, std. dev.: 0.0034) MultiSource/Applications/lua/lua: -1.24% (26.5159 => 26.1883, std. dev.: 0.0284) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.94s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon May 14 10:55:27 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 14 May 2012 12:55:27 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120514175527.4674D2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/645?compare_to=644&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 645, Order: 156768, Start Time: 2012-05-14 16:59:45, End Time: 2012-05-14 17:56:13 To: 644, Order: 156760, Start Time: 2012-05-14 15:36:08, End Time: 2012-05-14 16:32:43 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (58 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 891 (791 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/McGill/chomp: 1.31% (1.0978 => 1.1122, std. dev.: 0.0011) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.10% (2.0176 => 2.2819, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.03% (0.3130 => 0.3350, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.23% (0.2721 => 0.2836, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.32% (3.9660 => 4.0975, std. dev.: 0.0049) MultiSource/Benchmarks/nbench/nbench: 2.86% (1.0594 => 1.0897, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.85% (0.6959 => 0.7157, std. dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.79% (0.5265 => 0.5412, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.75% (0.9199 => 0.9452, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: 2.71% (0.8310 => 0.8535, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.57% (0.5637 => 0.5782, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.52% (1.2193 => 1.2500, std. dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 2.49% (13.8202 => 14.1642, std. dev.: 0.0131) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.45% (1.1364 => 1.1642, std. dev.: 0.0010) MultiSource/Applications/siod/siod: 2.18% (2.1791 => 2.2266, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.02% (0.7710 => 0.7866, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.01% (0.5577 => 0.5689, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/gs/gs: 1.99% (3.8646 => 3.9414, std. dev.: 0.0068) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.98% (1.4563 => 1.4851, std. dev.: 0.0010) MultiSource/Applications/kimwitu++/kc: 1.93% (16.6129 => 16.9331, std. dev.: 0.0117) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.92% (13.2842 => 13.5392, std. dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.92% (1.3245 => 1.3499, std. dev.: 0.0052) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.85% (1.3813 => 1.4068, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.84% (1.3819 => 1.4073, std. dev.: 0.0043) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.84% (0.7460 => 0.7597, std. dev.: 0.0019) MultiSource/Applications/lambda-0_1_3/lambda: 1.83% (0.7038 => 0.7167, std. dev.: 0.0001) MultiSource/Applications/Burg/burg: 1.78% (1.1061 => 1.1258, std. dev.: 0.0019) MultiSource/Applications/treecc/treecc: 1.62% (1.9270 => 1.9582, std. dev.: 0.0041) MultiSource/Applications/sqlite3/sqlite3: 1.54% (16.2614 => 16.5115, std. dev.: 0.0045) MultiSource/Applications/SIBsim4/SIBsim4: 1.44% (1.2749 => 1.2932, std. dev.: 0.0007) MultiSource/Applications/hbd/hbd: 1.39% (1.3693 => 1.3883, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.36% (3.6692 => 3.7190, std. dev.: 0.0015) MultiSource/Applications/JM/lencod/lencod: 1.20% (14.8535 => 15.0310, std. dev.: 0.0094) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.14% (2.1007 => 2.1246, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.11% (3.2742 => 3.3106, std. dev.: 0.0129) MultiSource/Applications/JM/ldecod/ldecod: 1.03% (6.5754 => 6.6433, std. dev.: 0.0026) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 23.85% (1.8175 => 2.2510, std. dev.: 0.0568) SingleSource/Benchmarks/Misc/mandel-2: 8.16% (1.2998 => 1.4058, std. dev.: 0.0039) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.86% (1.5824 => 1.6752, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9882, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 3.59% (7.4271 => 7.6938, std. dev.: 0.0054) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.57% (1.7688 => 1.8320, std. dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 3.12% (11.2619 => 11.6128, std. dev.: 0.0025) MultiSource/Applications/hexxagon/hexxagon: 2.98% (12.0921 => 12.4529, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: 2.88% (1.9199 => 1.9752, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.83% (8.8259 => 9.0754, std. dev.: 0.0099) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9392, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.31% (7.9275 => 8.1104, std. dev.: 0.0079) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9603, std. dev.: 0.0081) MultiSource/Benchmarks/NPB-serial/is/is: 1.39% (8.3908 => 8.5077, std. dev.: 0.0020) MultiSource/Applications/lemon/lemon: 1.37% (1.4298 => 1.4494, std. dev.: 0.0043) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.26% (2.0200 => 2.0454, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.20% (1.9433 => 1.9667, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 1.14% (9.0760 => 9.1791, std. dev.: 0.0009) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -21.07% (0.4657 => 0.3676, std. dev.: 0.0105) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.00% (0.2670 => 0.2483, std. dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.38% (22.5627 => 21.1243, std. dev.: 0.0148) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.24% (0.3511 => 0.3292, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-3: -4.20% (0.3623 => 0.3471, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -4.19% (0.3601 => 0.3450, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.14% (0.3650 => 0.3499, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/synchronized: -4.12% (0.3663 => 0.3512, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -4.11% (0.3646 => 0.3496, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -4.02% (0.3578 => 0.3434, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -3.96% (0.3940 => 0.3784, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -3.93% (0.3789 => 0.3640, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -3.68% (0.3914 => 0.3770, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -3.65% (0.4003 => 0.3857, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.79% (0.8818 => 0.8572, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: -2.32% (0.6250 => 0.6105, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.10% (0.6576 => 0.6438, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -9.64% (1.2308 => 1.1122, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.59% (0.3139 => 0.2932, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9475, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.75% (1.3780 => 1.3125, std. dev.: 0.0024) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -4.03% (2.5089 => 2.4079, std. dev.: 0.0013) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.73% (0.3458 => 0.3329, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -3.64% (1.9762 => 1.9042, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/richards_benchmark: -2.12% (1.1560 => 1.1315, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout/lists: -2.05% (6.3560 => 6.2257, std. dev.: 0.0032) MultiSource/Applications/minisat/minisat: -1.98% (9.3358 => 9.1513, std. dev.: 0.0156) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6920, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.85% (6.6320 => 6.5095, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.66% (20.3410 => 20.0029, std. dev.: 0.0383) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9951, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.49% (3.9173 => 3.8591, std. dev.: 0.0013) MultiSource/Applications/lua/lua: -1.36% (26.5159 => 26.1545, std. dev.: 0.0283) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.44s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon May 14 12:25:05 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 14 May 2012 14:25:05 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120514192505.0D0A72A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/646?compare_to=645&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 646, Order: 156769, Start Time: 2012-05-14 18:29:19, End Time: 2012-05-14 19:25:50 To: 645, Order: 156768, Start Time: 2012-05-14 16:59:45, End Time: 2012-05-14 17:56:13 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (59 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (790 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.48% (2.0176 => 2.2694, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.77% (0.3130 => 0.3342, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.23% (0.2721 => 0.2836, std. dev.: 0.0030) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.08% (3.9660 => 4.0883, std. dev.: 0.0033) MultiSource/Benchmarks/nbench/nbench: 2.74% (1.0594 => 1.0884, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.72% (0.5265 => 0.5408, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 2.52% (0.8310 => 0.8519, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.50% (0.5637 => 0.5778, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.49% (0.9199 => 0.9428, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.47% (0.6959 => 0.7131, std. dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 2.45% (13.8202 => 14.1583, std. dev.: 0.0083) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.41% (1.1364 => 1.1638, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.39% (1.2193 => 1.2485, std. dev.: 0.0030) MultiSource/Applications/siod/siod: 2.07% (2.1791 => 2.2242, std. dev.: 0.0060) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.97% (13.2842 => 13.5458, std. dev.: 0.0088) MultiSource/Applications/kimwitu++/kc: 1.93% (16.6129 => 16.9327, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.88% (0.5577 => 0.5682, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.86% (1.3813 => 1.4070, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.85% (1.4563 => 1.4833, std. dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: 1.85% (0.7038 => 0.7168, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 1.80% (3.8646 => 3.9343, std. dev.: 0.0066) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.79% (1.3819 => 1.4066, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.73% (1.3245 => 1.3474, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.66% (0.7460 => 0.7584, std. dev.: 0.0015) MultiSource/Applications/hbd/hbd: 1.60% (1.3693 => 1.3912, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 1.56% (1.1061 => 1.1233, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 1.48% (16.2614 => 16.5021, std. dev.: 0.0259) MultiSource/Applications/treecc/treecc: 1.42% (1.9270 => 1.9543, std. dev.: 0.0025) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.40% (0.7710 => 0.7818, std. dev.: 0.0037) MultiSource/Applications/SIBsim4/SIBsim4: 1.36% (1.2749 => 1.2922, std. dev.: 0.0061) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.16% (3.6692 => 3.7116, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.11% (3.2742 => 3.3104, std. dev.: 0.0031) MultiSource/Applications/JM/lencod/lencod: 1.04% (14.8535 => 15.0077, std. dev.: 0.0064) MultiSource/Benchmarks/Bullet/bullet: 1.03% (33.2944 => 33.6383, std. dev.: 0.0033) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.06% (1.8175 => 2.2547, std. dev.: 0.0068) SingleSource/Benchmarks/Misc/mandel-2: 7.32% (1.2998 => 1.3949, std. dev.: 0.0188) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.87% (1.5824 => 1.6753, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8143, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9878, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: 3.70% (7.4271 => 7.7020, std. dev.: 0.0044) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.66% (1.7688 => 1.8336, std. dev.: 0.0178) MultiSource/Benchmarks/nbench/nbench: 3.16% (11.2619 => 11.6182, std. dev.: 0.0022) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 3.01% (8.8259 => 9.0920, std. dev.: 0.0081) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4531, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-6: 2.85% (1.9199 => 1.9747, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9392, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.23% (7.9275 => 8.1042, std. dev.: 0.0197) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/ffbench: 1.56% (0.8273 => 0.8402, std. dev.: 0.0013) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5085, std. dev.: 0.0092) MultiSource/Applications/lemon/lemon: 1.39% (1.4298 => 1.4497, std. dev.: 0.0007) MultiSource/Benchmarks/sim/sim: 1.36% (5.0168 => 5.0850, std. dev.: 0.0075) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.25% (1.9433 => 1.9675, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.23% (2.0200 => 2.0449, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 1.13% (9.0760 => 9.1784, std. dev.: 0.0006) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -21.62% (0.4657 => 0.3650, std. dev.: 0.0279) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.97% (0.2670 => 0.2484, std. dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.39% (22.5627 => 21.1218, std. dev.: 0.0057) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.35% (0.3511 => 0.3288, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-3: -4.50% (0.3623 => 0.3460, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -4.47% (0.3601 => 0.3440, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.47% (0.3650 => 0.3487, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -4.34% (0.3663 => 0.3504, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -4.33% (0.3646 => 0.3488, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -4.33% (0.3578 => 0.3423, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -4.25% (0.3789 => 0.3628, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -4.19% (0.3940 => 0.3775, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -3.91% (0.3914 => 0.3761, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -3.67% (0.4003 => 0.3856, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.98% (0.8818 => 0.8555, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.25% (0.6576 => 0.6428, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: -2.08% (0.6250 => 0.6120, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -10.39% (1.2308 => 1.1029, std. dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.16% (1.0460 => 0.9502, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.50% (0.3139 => 0.2935, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.38% (1.3780 => 1.3039, std. dev.: 0.0091) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9473, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -4.04% (2.5089 => 2.4076, std. dev.: 0.0014) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.73% (0.3458 => 0.3329, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -3.69% (1.9762 => 1.9033, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: -2.15% (1.1560 => 1.1312, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -2.08% (6.3560 => 6.2236, std. dev.: 0.0059) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -2.00% (6.6320 => 6.4995, std. dev.: 0.0051) MultiSource/Applications/minisat/minisat: -1.93% (9.3358 => 9.1552, std. dev.: 0.0294) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.91% (20.3410 => 19.9525, std. dev.: 0.0324) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6919, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9952, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.56% (0.9692 => 0.9541, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/heapsort: -1.44% (3.9173 => 3.8609, std. dev.: 0.0069) MultiSource/Applications/lua/lua: -1.15% (26.5159 => 26.2118, std. dev.: 0.0116) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.93s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon May 14 13:48:45 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 14 May 2012 15:48:45 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120514204845.283572A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/647?compare_to=646&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 647, Order: 156774, Start Time: 2012-05-14 19:53:01, End Time: 2012-05-14 20:49:30 To: 646, Order: 156769, Start Time: 2012-05-14 18:29:19, End Time: 2012-05-14 19:25:50 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (57 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 891 (792 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 1.23% (3.7744 => 3.8207, std. dev.: 0.0168) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.44% (2.0176 => 2.2686, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.71% (0.3130 => 0.3340, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.41% (0.2721 => 0.2841, std. dev.: 0.0028) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.15% (3.9660 => 4.0910, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.87% (0.5265 => 0.5416, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.82% (0.6959 => 0.7155, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 2.68% (1.0594 => 1.0878, std. dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.67% (0.9199 => 0.9445, std. dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.57% (0.5637 => 0.5782, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 2.48% (0.8310 => 0.8516, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.41% (1.2193 => 1.2487, std. dev.: 0.0084) MultiSource/Applications/SPASS/SPASS: 2.37% (13.8202 => 14.1480, std. dev.: 0.0104) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.32% (1.1364 => 1.1628, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.08% (0.7710 => 0.7870, std. dev.: 0.0017) MultiSource/Applications/siod/siod: 2.04% (2.1791 => 2.2235, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.99% (0.5577 => 0.5688, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 1.93% (3.8646 => 3.9391, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.88% (1.4563 => 1.4837, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.83% (13.2842 => 13.5269, std. dev.: 0.0221) MultiSource/Applications/kimwitu++/kc: 1.78% (16.6129 => 16.9089, std. dev.: 0.0140) MultiSource/Applications/hbd/hbd: 1.76% (1.3693 => 1.3934, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 1.74% (1.1061 => 1.1253, std. dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.69% (1.3245 => 1.3469, std. dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: 1.69% (0.7038 => 0.7157, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.65% (0.7460 => 0.7583, std. dev.: 0.0016) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.63% (1.3813 => 1.4038, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.59% (1.3819 => 1.4039, std. dev.: 0.0018) MultiSource/Applications/sqlite3/sqlite3: 1.56% (16.2614 => 16.5148, std. dev.: 0.0102) MultiSource/Applications/treecc/treecc: 1.45% (1.9270 => 1.9549, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.29% (3.6692 => 3.7167, std. dev.: 0.0031) MultiSource/Applications/JM/lencod/lencod: 1.07% (14.8535 => 15.0118, std. dev.: 0.0154) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 23.96% (1.8175 => 2.2530, std. dev.: 0.0495) SingleSource/Benchmarks/Misc/mandel-2: 7.52% (1.2998 => 1.3975, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.86% (1.5824 => 1.6751, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9879, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.69% (1.7688 => 1.8340, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: 3.66% (7.4271 => 7.6989, std. dev.: 0.0057) MultiSource/Benchmarks/nbench/nbench: 3.11% (11.2619 => 11.6122, std. dev.: 0.0025) MultiSource/Applications/hexxagon/hexxagon: 3.01% (12.0921 => 12.4562, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: 2.82% (1.9199 => 1.9740, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.77% (8.8259 => 9.0704, std. dev.: 0.0157) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9393, std. dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.54% (7.9275 => 8.1291, std. dev.: 0.0087) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ffbench: 1.61% (0.8273 => 0.8406, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.55% (1.4298 => 1.4520, std. dev.: 0.0008) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5085, std. dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.29% (2.0200 => 2.0460, std. dev.: 0.0001) MultiSource/Benchmarks/llubenchmark/llu: 1.26% (3.7731 => 3.8207, std. dev.: 0.0168) MultiSource/Benchmarks/sim/sim: 1.26% (5.0168 => 5.0800, std. dev.: 0.0021) MultiSource/Benchmarks/Olden/bisort/bisort: 1.21% (0.8239 => 0.8339, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 1.11% (9.0760 => 9.1764, std. dev.: 0.0020) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -20.79% (0.4657 => 0.3689, std. dev.: 0.0106) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.67% (0.2670 => 0.2492, std. dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.51% (22.5627 => 21.0937, std. dev.: 0.0061) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.21% (0.3511 => 0.3293, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: -3.37% (0.3623 => 0.3501, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.26% (0.3650 => 0.3531, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-2: -3.25% (0.3601 => 0.3484, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -3.18% (0.3646 => 0.3530, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: -3.17% (0.3663 => 0.3547, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -3.16% (0.3578 => 0.3465, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -3.04% (0.3789 => 0.3674, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -2.99% (0.3940 => 0.3822, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -2.86% (0.3914 => 0.3802, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.84% (0.8818 => 0.8568, std. dev.: 0.0015) SingleSource/UnitTests/ObjC/parameter-passing: -2.80% (0.4003 => 0.3891, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: -2.14% (0.6250 => 0.6116, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.90% (0.6576 => 0.6451, std. dev.: 0.0015) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -10.00% (1.2308 => 1.1077, std. dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.53% (0.3139 => 0.2934, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2650, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9475, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.80% (1.3780 => 1.3118, std. dev.: 0.0056) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -4.03% (2.5089 => 2.4078, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.73% (0.3458 => 0.3329, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -3.68% (1.9762 => 1.9034, std. dev.: 0.0123) SingleSource/Benchmarks/Shootout/lists: -2.28% (6.3560 => 6.2114, std. dev.: 0.0075) SingleSource/Benchmarks/Misc/richards_benchmark: -2.13% (1.1560 => 1.1314, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.11% (20.3410 => 19.9118, std. dev.: 0.0594) MultiSource/Applications/minisat/minisat: -2.02% (9.3358 => 9.1470, std. dev.: 0.0085) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6909, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.85% (6.6320 => 6.5094, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3446, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9958, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.51% (3.9173 => 3.8580, std. dev.: 0.0051) MultiSource/Applications/lua/lua: -1.24% (26.5159 => 26.1858, std. dev.: 0.0227) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.48s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon May 14 15:12:16 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 14 May 2012 17:12:16 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120514221216.48F732A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/648?compare_to=647&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 648, Order: 156776, Start Time: 2012-05-14 21:16:26, End Time: 2012-05-14 22:13:00 To: 647, Order: 156774, Start Time: 2012-05-14 19:53:01, End Time: 2012-05-14 20:49:30 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (60 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (788 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.75% (2.0176 => 2.2748, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.12% (0.3130 => 0.3353, std. dev.: 0.0057) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.67% (0.2721 => 0.2848, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.63% (3.9660 => 4.1098, std. dev.: 0.0034) MultiSource/Benchmarks/nbench/nbench: 3.24% (1.0594 => 1.0937, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.10% (0.5265 => 0.5428, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.09% (0.6959 => 0.7174, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/football/football: 3.06% (0.8310 => 0.8564, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.84% (0.9199 => 0.9460, std. dev.: 0.0017) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.76% (1.1364 => 1.1678, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 2.76% (13.8202 => 14.2017, std. dev.: 0.0161) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.74% (1.2193 => 1.2527, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.68% (0.5637 => 0.5788, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.18% (1.4563 => 1.4880, std. dev.: 0.0022) MultiSource/Applications/siod/siod: 2.11% (2.1791 => 2.2250, std. dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.11% (13.2842 => 13.5640, std. dev.: 0.0121) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.08% (0.5577 => 0.5693, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 2.04% (3.8646 => 3.9434, std. dev.: 0.0066) MultiSource/Applications/kimwitu++/kc: 2.01% (16.6129 => 16.9471, std. dev.: 0.0138) MultiSource/Applications/lambda-0_1_3/lambda: 2.00% (0.7038 => 0.7179, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.96% (1.3245 => 1.3505, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.93% (0.7460 => 0.7604, std. dev.: 0.0011) MultiSource/Applications/Burg/burg: 1.91% (1.1061 => 1.1272, std. dev.: 0.0033) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.91% (0.7710 => 0.7857, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.87% (1.3819 => 1.4078, std. dev.: 0.0015) MultiSource/Applications/sqlite3/sqlite3: 1.86% (16.2614 => 16.5641, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.86% (3.6692 => 3.7374, std. dev.: 0.0076) MultiSource/Applications/SIBsim4/SIBsim4: 1.81% (1.2749 => 1.2980, std. dev.: 0.0008) MultiSource/Applications/treecc/treecc: 1.81% (1.9270 => 1.9619, std. dev.: 0.0022) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.72% (1.3813 => 1.4051, std. dev.: 0.0010) MultiSource/Applications/hbd/hbd: 1.57% (1.3693 => 1.3908, std. dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 1.46% (14.8535 => 15.0708, std. dev.: 0.0082) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.40% (3.2742 => 3.3200, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.32% (2.1007 => 2.1285, std. dev.: 0.0084) MultiSource/Applications/JM/ldecod/ldecod: 1.24% (6.5754 => 6.6572, std. dev.: 0.0037) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.10% (1.8175 => 2.2555, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7298, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.24% (1.2998 => 1.3809, std. dev.: 0.0088) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.91% (1.5824 => 1.6759, std. dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8146, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9876, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 3.65% (7.4271 => 7.6985, std. dev.: 0.0031) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.62% (1.7688 => 1.8328, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 3.13% (11.2619 => 11.6143, std. dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.99% (8.8259 => 9.0900, std. dev.: 0.0041) MultiSource/Applications/hexxagon/hexxagon: 2.98% (12.0921 => 12.4530, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/flops-6: 2.92% (1.9199 => 1.9759, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.77% (2.8606 => 2.9397, std. dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.39% (7.9275 => 8.1167, std. dev.: 0.0073) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9603, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ffbench: 1.61% (0.8273 => 0.8406, std. dev.: 0.0015) MultiSource/Applications/lemon/lemon: 1.43% (1.4298 => 1.4502, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5092, std. dev.: 0.0104) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.29% (2.0200 => 2.0460, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bisort/bisort: 1.27% (0.8239 => 0.8344, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.17% (1.9433 => 1.9661, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: 1.14% (9.0760 => 9.1797, std. dev.: 0.0006) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.29% (0.2670 => 0.2502, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.21% (22.5627 => 21.1608, std. dev.: 0.0023) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.95% (0.3511 => 0.3302, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-3: -3.97% (0.3623 => 0.3479, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.95% (0.3650 => 0.3506, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -3.92% (0.3601 => 0.3460, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -3.82% (0.3663 => 0.3523, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -3.78% (0.3646 => 0.3508, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -3.75% (0.3578 => 0.3444, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -3.68% (0.3940 => 0.3795, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -3.38% (0.3789 => 0.3661, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/parameter-passing: -3.30% (0.4003 => 0.3871, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -3.24% (0.3914 => 0.3787, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: -2.30% (0.6250 => 0.6106, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.23% (0.8818 => 0.8621, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.01% (0.6576 => 0.6444, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: -1.77% (0.5748 => 0.5646, std. dev.: 0.0010) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -10.64% (1.2308 => 1.0999, std. dev.: 0.0049) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.16% (1.0460 => 0.9502, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.53% (0.3139 => 0.2934, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2641, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.17% (1.3780 => 1.3067, std. dev.: 0.0141) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9472, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -4.03% (2.5089 => 2.4078, std. dev.: 0.0018) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.67% (0.3458 => 0.3331, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.64% (1.9762 => 1.9042, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/richards_benchmark: -2.15% (1.1560 => 1.1311, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -2.12% (6.3560 => 6.2215, std. dev.: 0.0064) MultiSource/Applications/minisat/minisat: -1.99% (9.3358 => 9.1498, std. dev.: 0.0295) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.97% (6.6320 => 6.5011, std. dev.: 0.0042) MultiSource/Benchmarks/mafft/pairlocalalign: -1.87% (28.2225 => 27.6937, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.80% (20.3410 => 19.9742, std. dev.: 0.0099) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9955, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.53% (3.9173 => 3.8574, std. dev.: 0.0048) MultiSource/Applications/lua/lua: -1.46% (26.5159 => 26.1293, std. dev.: 0.0343) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.01% (3.8887 => 3.8494, std. dev.: 0.0049) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.44s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon May 14 16:35:45 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 14 May 2012 18:35:45 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120514233545.E2A512A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/649?compare_to=648&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 649, Order: 156783, Start Time: 2012-05-14 22:40:01, End Time: 2012-05-14 23:36:31 To: 648, Order: 156776, Start Time: 2012-05-14 21:16:26, End Time: 2012-05-14 22:13:00 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (65 on baseline) Performance Improvements: 0 (38 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 890 (785 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 1.67% (1.3809 => 1.4040, std. dev.: 0.0055) MultiSource/Benchmarks/llubenchmark/llu: 1.52% (3.7674 => 3.8248, std. dev.: 0.0186) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.75% (2.0176 => 2.2749, std. dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.09% (0.3130 => 0.3352, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.52% (0.2721 => 0.2844, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.48% (3.9660 => 4.1039, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.08% (0.5265 => 0.5427, std. dev.: 0.0059) MultiSource/Benchmarks/nbench/nbench: 3.06% (1.0594 => 1.0918, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 2.92% (0.8310 => 0.8553, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.90% (0.9199 => 0.9466, std. dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.89% (0.6959 => 0.7160, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 2.80% (13.8202 => 14.2070, std. dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.64% (1.2193 => 1.2515, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.61% (1.1364 => 1.1661, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.55% (0.5637 => 0.5781, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash2: 2.38% (0.4328 => 0.4431, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 2.23% (2.1791 => 2.2276, std. dev.: 0.0013) MultiSource/Applications/lambda-0_1_3/lambda: 2.20% (0.7038 => 0.7193, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.19% (0.5577 => 0.5699, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.16% (1.4563 => 1.4878, std. dev.: 0.0048) MultiSource/Applications/kimwitu++/kc: 2.06% (16.6129 => 16.9544, std. dev.: 0.0092) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.04% (13.2842 => 13.5558, std. dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.00% (1.3245 => 1.3510, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 1.96% (3.8646 => 3.9404, std. dev.: 0.0046) MultiSource/Applications/Burg/burg: 1.87% (1.1061 => 1.1268, std. dev.: 0.0061) MultiSource/Applications/hbd/hbd: 1.80% (1.3693 => 1.3940, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.80% (1.3813 => 1.4062, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.77% (1.3819 => 1.4063, std. dev.: 0.0014) MultiSource/Applications/treecc/treecc: 1.75% (1.9270 => 1.9608, std. dev.: 0.0127) MultiSource/Applications/sqlite3/sqlite3: 1.71% (16.2614 => 16.5400, std. dev.: 0.0236) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.70% (0.7460 => 0.7587, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.69% (0.7710 => 0.7840, std. dev.: 0.0031) MultiSource/Applications/SIBsim4/SIBsim4: 1.56% (1.2749 => 1.2948, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.53% (3.6692 => 3.7252, std. dev.: 0.0046) MultiSource/Applications/JM/lencod/lencod: 1.38% (14.8535 => 15.0592, std. dev.: 0.0094) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.36% (3.2742 => 3.3186, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.35% (2.1007 => 2.1290, std. dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: 1.08% (33.2944 => 33.6545, std. dev.: 0.0076) MultiSource/Applications/JM/ldecod/ldecod: 1.08% (6.5754 => 6.6464, std. dev.: 0.0096) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.1333 => 1.1451, std. dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.00% (1.5188 => 1.5340, std. dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.47% (1.8175 => 2.2622, std. dev.: 0.0084) SingleSource/Benchmarks/Misc/mandel-2: 8.02% (1.2998 => 1.4040, std. dev.: 0.0055) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.90% (1.5824 => 1.6757, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8147, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-5: 3.86% (1.9144 => 1.9883, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.69% (1.7688 => 1.8341, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: 3.69% (7.4271 => 7.7009, std. dev.: 0.0067) MultiSource/Benchmarks/nbench/nbench: 3.15% (11.2619 => 11.6166, std. dev.: 0.0029) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4543, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.99% (8.8259 => 9.0896, std. dev.: 0.0148) SingleSource/Benchmarks/Misc/flops-6: 2.85% (1.9199 => 1.9747, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.76% (2.8606 => 2.9395, std. dev.: 0.0022) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.33% (7.9275 => 8.1120, std. dev.: 0.0168) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.61% (0.8273 => 0.8406, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.42% (1.4298 => 1.4501, std. dev.: 0.0008) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5093, std. dev.: 0.0007) MultiSource/Benchmarks/llubenchmark/llu: 1.37% (3.7731 => 3.8248, std. dev.: 0.0186) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.28% (2.0200 => 2.0458, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.18% (1.9433 => 1.9662, std. dev.: 0.0070) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: 1.13% (5.0168 => 5.0735, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/flops: 1.11% (9.0760 => 9.1769, std. dev.: 0.0014) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.59% (0.2670 => 0.2494, std. dev.: 0.0022) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.20% (22.5627 => 21.1630, std. dev.: 0.0175) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.67% (0.3511 => 0.3312, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-3: -4.55% (0.3623 => 0.3458, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -4.50% (0.3601 => 0.3439, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.47% (0.3650 => 0.3487, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -4.36% (0.3578 => 0.3422, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -4.33% (0.3646 => 0.3488, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -4.29% (0.3663 => 0.3506, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -4.09% (0.3940 => 0.3779, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -3.91% (0.3789 => 0.3641, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -3.76% (0.3914 => 0.3767, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -3.67% (0.4003 => 0.3856, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.51% (0.8818 => 0.8597, std. dev.: 0.0049) SingleSource/Benchmarks/Misc-C++/bigfib: -2.06% (0.6250 => 0.6121, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.90% (0.6576 => 0.6451, std. dev.: 0.0011) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -9.86% (1.2308 => 1.1094, std. dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0014) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.56% (0.3139 => 0.2933, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2641, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9473, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.81% (1.3780 => 1.3117, std. dev.: 0.0044) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -3.95% (2.5089 => 2.4097, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -3.63% (1.9762 => 1.9044, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout/lists: -2.18% (6.3560 => 6.2177, std. dev.: 0.0123) SingleSource/Benchmarks/Misc/richards_benchmark: -2.13% (1.1560 => 1.1314, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -2.02% (6.6320 => 6.4979, std. dev.: 0.0072) MultiSource/Applications/minisat/minisat: -2.00% (9.3358 => 9.1490, std. dev.: 0.0095) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6910, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.64% (20.3410 => 20.0077, std. dev.: 0.0639) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9955, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.56% (0.9692 => 0.9541, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.47% (3.9173 => 3.8599, std. dev.: 0.0058) MultiSource/Applications/lua/lua: -1.25% (26.5159 => 26.1840, std. dev.: 0.0352) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.89s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon May 14 17:59:13 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 14 May 2012 19:59:13 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120515005913.5D1912A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/650?compare_to=649&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 650, Order: 156788, Start Time: 2012-05-15 00:03:30, End Time: 2012-05-15 00:59:59 To: 649, Order: 156783, Start Time: 2012-05-14 22:40:01, End Time: 2012-05-14 23:36:31 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (59 on baseline) Performance Improvements: 0 (41 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (788 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.73% (2.0176 => 2.2744, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.77% (0.3130 => 0.3342, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.30% (0.2721 => 0.2838, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.26% (3.9660 => 4.0953, std. dev.: 0.0044) MultiSource/Benchmarks/nbench/nbench: 2.87% (1.0594 => 1.0898, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: 2.86% (0.8310 => 0.8548, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.85% (0.5265 => 0.5415, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.72% (0.6959 => 0.7148, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 2.70% (13.8202 => 14.1937, std. dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.66% (0.9199 => 0.9444, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.46% (1.2193 => 1.2493, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.34% (0.5637 => 0.5769, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.30% (1.1364 => 1.1625, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 2.15% (2.1791 => 2.2260, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.09% (1.4563 => 1.4868, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.04% (0.5577 => 0.5691, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.92% (13.2842 => 13.5389, std. dev.: 0.0265) MultiSource/Applications/lambda-0_1_3/lambda: 1.90% (0.7038 => 0.7172, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.86% (1.3245 => 1.3491, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 1.86% (3.8646 => 3.9363, std. dev.: 0.0078) MultiSource/Applications/kimwitu++/kc: 1.78% (16.6129 => 16.9083, std. dev.: 0.0140) MultiSource/Applications/Burg/burg: 1.74% (1.1061 => 1.1254, std. dev.: 0.0029) MultiSource/Applications/sqlite3/sqlite3: 1.69% (16.2614 => 16.5360, std. dev.: 0.0087) MultiSource/Applications/treecc/treecc: 1.60% (1.9270 => 1.9579, std. dev.: 0.0045) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.60% (1.3813 => 1.4034, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.50% (1.3819 => 1.4026, std. dev.: 0.0021) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.43% (0.7460 => 0.7567, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.40% (0.7710 => 0.7818, std. dev.: 0.0041) MultiSource/Applications/SIBsim4/SIBsim4: 1.38% (1.2749 => 1.2925, std. dev.: 0.0006) MultiSource/Applications/hbd/hbd: 1.37% (1.3693 => 1.3880, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.29% (2.1007 => 2.1277, std. dev.: 0.0064) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.27% (3.2742 => 3.3159, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.26% (3.6692 => 3.7153, std. dev.: 0.0036) MultiSource/Applications/JM/lencod/lencod: 1.12% (14.8535 => 15.0202, std. dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.03% (1.5188 => 1.5345, std. dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 23.85% (1.8175 => 2.2509, std. dev.: 0.0060) SingleSource/Benchmarks/Misc/mandel-2: 8.36% (1.2998 => 1.4084, std. dev.: 0.0040) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.87% (1.5824 => 1.6753, std. dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.79% (1.9144 => 1.9870, std. dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.60% (1.7688 => 1.8325, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/salsa20: 3.59% (7.4271 => 7.6938, std. dev.: 0.0090) MultiSource/Benchmarks/nbench/nbench: 3.12% (11.2619 => 11.6136, std. dev.: 0.0014) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4545, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-6: 2.91% (1.9199 => 1.9758, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9392, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.64% (8.8259 => 9.0590, std. dev.: 0.0032) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.42% (7.9275 => 8.1190, std. dev.: 0.0079) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.60% (1.9290 => 1.9599, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/ffbench: 1.60% (0.8273 => 0.8405, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.53% (1.4298 => 1.4517, std. dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5092, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.30% (2.0200 => 2.0462, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 1.11% (9.0760 => 9.1768, std. dev.: 0.0020) MultiSource/Benchmarks/sim/sim: 1.08% (5.0168 => 5.0709, std. dev.: 0.0125) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -19.56% (0.4657 => 0.3746, std. dev.: 0.0026) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.74% (0.2670 => 0.2490, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.46% (22.5627 => 21.1045, std. dev.: 0.0196) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.78% (0.3511 => 0.3308, std. dev.: 0.0031) SingleSource/UnitTests/ObjC/exceptions-2: -4.72% (0.3601 => 0.3431, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.71% (0.3650 => 0.3478, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -4.66% (0.3623 => 0.3454, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -4.59% (0.3663 => 0.3495, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -4.58% (0.3578 => 0.3414, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -4.53% (0.3646 => 0.3481, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/property: -4.42% (0.3940 => 0.3766, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: -4.12% (0.3789 => 0.3633, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -3.88% (0.3914 => 0.3762, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: -3.85% (0.4003 => 0.3849, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.84% (0.8818 => 0.8568, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: -2.45% (0.6250 => 0.6097, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: -2.07% (0.5748 => 0.5629, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.01% (0.6576 => 0.6444, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: -1.80% (0.5818 => 0.5713, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -10.34% (1.2308 => 1.1035, std. dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.56% (0.3139 => 0.2933, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9473, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.41% (1.3780 => 1.3172, std. dev.: 0.0031) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -4.07% (2.5089 => 2.4067, std. dev.: 0.0015) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.67% (0.3458 => 0.3331, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.56% (1.9762 => 1.9058, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/richards_benchmark: -2.12% (1.1560 => 1.1315, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -2.12% (6.3560 => 6.2213, std. dev.: 0.0134) MultiSource/Applications/minisat/minisat: -1.93% (9.3358 => 9.1557, std. dev.: 0.0277) MultiSource/Benchmarks/mafft/pairlocalalign: -1.87% (28.2225 => 27.6942, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.84% (6.6320 => 6.5099, std. dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.76% (20.3410 => 19.9826, std. dev.: 0.0244) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9956, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.49% (3.9173 => 3.8589, std. dev.: 0.0195) MultiSource/Applications/lua/lua: -1.32% (26.5159 => 26.1649, std. dev.: 0.0213) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.87s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon May 14 19:22:39 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 14 May 2012 21:22:39 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120515022239.95D932A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/651?compare_to=650&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 651, Order: 156792, Start Time: 2012-05-15 01:26:54, End Time: 2012-05-15 02:23:25 To: 650, Order: 156788, Start Time: 2012-05-15 00:03:30, End Time: 2012-05-15 00:59:59 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (62 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (787 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.64% (2.0176 => 2.2727, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.06% (0.3130 => 0.3351, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.45% (0.2721 => 0.2842, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.49% (3.9660 => 4.1045, std. dev.: 0.0044) MultiSource/Benchmarks/nbench/nbench: 3.04% (1.0594 => 1.0916, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.04% (0.5265 => 0.5425, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.00% (0.6959 => 0.7168, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 2.96% (13.8202 => 14.2294, std. dev.: 0.0106) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.91% (0.9199 => 0.9467, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 2.85% (0.8310 => 0.8547, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.57% (1.2193 => 1.2506, std. dev.: 0.0029) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.54% (1.1364 => 1.1653, std. dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.50% (0.5637 => 0.5778, std. dev.: 0.0032) MultiSource/Applications/siod/siod: 2.35% (2.1791 => 2.2304, std. dev.: 0.0065) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.25% (1.4563 => 1.4890, std. dev.: 0.0120) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.21% (0.5577 => 0.5700, std. dev.: 0.0021) MultiSource/Benchmarks/MallocBench/gs/gs: 2.15% (3.8646 => 3.9475, std. dev.: 0.0042) MultiSource/Applications/lambda-0_1_3/lambda: 2.13% (0.7038 => 0.7188, std. dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 2.11% (16.6129 => 16.9630, std. dev.: 0.0034) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.04% (0.7460 => 0.7612, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.01% (1.3245 => 1.3511, std. dev.: 0.0039) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.98% (0.7710 => 0.7863, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.94% (13.2842 => 13.5416, std. dev.: 0.0078) MultiSource/Applications/Burg/burg: 1.86% (1.1061 => 1.1267, std. dev.: 0.0005) MultiSource/Applications/treecc/treecc: 1.85% (1.9270 => 1.9626, std. dev.: 0.0034) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.77% (1.3813 => 1.4058, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 1.72% (16.2614 => 16.5409, std. dev.: 0.0194) MultiSource/Applications/hbd/hbd: 1.64% (1.3693 => 1.3918, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.59% (1.3819 => 1.4039, std. dev.: 0.0045) MultiSource/Applications/SIBsim4/SIBsim4: 1.57% (1.2749 => 1.2949, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.56% (3.6692 => 3.7265, std. dev.: 0.0010) MultiSource/Applications/JM/lencod/lencod: 1.33% (14.8535 => 15.0505, std. dev.: 0.0080) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.21% (3.2742 => 3.3137, std. dev.: 0.0075) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.19% (2.1007 => 2.1256, std. dev.: 0.0025) MultiSource/Benchmarks/Bullet/bullet: 1.11% (33.2944 => 33.6632, std. dev.: 0.0176) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.07% (1.1333 => 1.1454, std. dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: 1.03% (6.5754 => 6.6434, std. dev.: 0.0012) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.35% (1.8175 => 2.2601, std. dev.: 0.0060) SingleSource/Benchmarks/Misc/mandel-2: 8.28% (1.2998 => 1.4074, std. dev.: 0.0125) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7298, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.85% (1.5824 => 1.6750, std. dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8142, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9881, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.66% (1.7688 => 1.8335, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: 3.61% (7.4271 => 7.6953, std. dev.: 0.0078) MultiSource/Benchmarks/nbench/nbench: 3.13% (11.2619 => 11.6146, std. dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 3.02% (8.8259 => 9.0924, std. dev.: 0.0085) MultiSource/Applications/hexxagon/hexxagon: 3.01% (12.0921 => 12.4557, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-6: 2.93% (1.9199 => 1.9762, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9393, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.38% (7.9275 => 8.1165, std. dev.: 0.0116) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.61% (0.8273 => 0.8406, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.60% (1.9290 => 1.9599, std. dev.: 0.0037) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5088, std. dev.: 0.0011) MultiSource/Applications/lemon/lemon: 1.40% (1.4298 => 1.4498, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.26% (2.0200 => 2.0454, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.20% (1.9433 => 1.9667, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: 1.14% (5.0168 => 5.0740, std. dev.: 0.0104) SingleSource/Benchmarks/Misc/flops: 1.13% (9.0760 => 9.1786, std. dev.: 0.0009) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -19.03% (0.4657 => 0.3771, std. dev.: 0.0133) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.67% (0.2670 => 0.2492, std. dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.16% (22.5627 => 21.1725, std. dev.: 0.0221) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.98% (0.3511 => 0.3301, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: -3.81% (0.3623 => 0.3485, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -3.72% (0.3601 => 0.3467, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -3.59% (0.3646 => 0.3515, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.56% (0.3650 => 0.3520, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -3.55% (0.3663 => 0.3533, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -3.49% (0.3578 => 0.3453, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -3.46% (0.3789 => 0.3658, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/property: -3.43% (0.3940 => 0.3805, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: -3.10% (0.4003 => 0.3879, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -3.09% (0.3914 => 0.3793, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.79% (0.8818 => 0.8572, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.68% (0.6576 => 0.6400, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/bigfib: -2.11% (0.6250 => 0.6118, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -10.75% (1.2308 => 1.0985, std. dev.: 0.0047) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.63% (0.3139 => 0.2931, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2650, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.05% (1.3780 => 1.3084, std. dev.: 0.0043) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9473, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -4.05% (2.5089 => 2.4073, std. dev.: 0.0020) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.67% (0.3458 => 0.3331, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.60% (1.9762 => 1.9050, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: -2.17% (1.1560 => 1.1309, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/lists: -2.14% (6.3560 => 6.2202, std. dev.: 0.0086) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.01% (20.3410 => 19.9316, std. dev.: 0.0402) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.92% (6.6320 => 6.5044, std. dev.: 0.0054) MultiSource/Applications/minisat/minisat: -1.92% (9.3358 => 9.1568, std. dev.: 0.0107) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6906, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9953, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.56% (0.9692 => 0.9541, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.45% (3.9173 => 3.8605, std. dev.: 0.0039) MultiSource/Applications/lua/lua: -1.30% (26.5159 => 26.1722, std. dev.: 0.0167) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.50s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon May 14 20:46:09 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 14 May 2012 22:46:09 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120515034609.28FE52A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/652?compare_to=651&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 652, Order: 156794, Start Time: 2012-05-15 02:50:22, End Time: 2012-05-15 03:46:55 To: 651, Order: 156792, Start Time: 2012-05-15 01:26:54, End Time: 2012-05-15 02:23:25 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (59 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (790 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.67% (2.0176 => 2.2732, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.09% (0.3130 => 0.3352, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.41% (0.2721 => 0.2841, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.44% (3.9660 => 4.1023, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.17% (0.5265 => 0.5432, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 3.08% (1.0594 => 1.0920, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.03% (0.6959 => 0.7170, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 2.97% (13.8202 => 14.2304, std. dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.89% (0.9199 => 0.9465, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 2.84% (0.8310 => 0.8546, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.64% (1.2193 => 1.2515, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.54% (1.1364 => 1.1653, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.52% (0.5637 => 0.5779, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.33% (0.5577 => 0.5707, std. dev.: 0.0020) MultiSource/Applications/siod/siod: 2.30% (2.1791 => 2.2293, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/gs/gs: 2.25% (3.8646 => 3.9514, std. dev.: 0.0063) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.24% (0.7710 => 0.7883, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.22% (1.4563 => 1.4887, std. dev.: 0.0052) MultiSource/Applications/kimwitu++/kc: 2.06% (16.6129 => 16.9552, std. dev.: 0.0184) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.99% (1.3245 => 1.3509, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.97% (13.2842 => 13.5459, std. dev.: 0.0181) MultiSource/Applications/lambda-0_1_3/lambda: 1.93% (0.7038 => 0.7174, std. dev.: 0.0007) MultiSource/Applications/treecc/treecc: 1.87% (1.9270 => 1.9631, std. dev.: 0.0011) MultiSource/Applications/Burg/burg: 1.87% (1.1061 => 1.1268, std. dev.: 0.0047) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.84% (0.7460 => 0.7597, std. dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 1.71% (16.2614 => 16.5389, std. dev.: 0.0078) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.64% (1.3819 => 1.4046, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.58% (3.6692 => 3.7270, std. dev.: 0.0027) MultiSource/Applications/hbd/hbd: 1.57% (1.3693 => 1.3908, std. dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: 1.55% (1.2749 => 1.2947, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.33% (2.1007 => 2.1287, std. dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: 1.24% (33.2944 => 33.7081, std. dev.: 0.0107) MultiSource/Applications/JM/lencod/lencod: 1.20% (14.8535 => 15.0313, std. dev.: 0.0075) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.19% (3.2742 => 3.3132, std. dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.09% (1.1333 => 1.1457, std. dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.14% (1.8175 => 2.2562, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/mandel-2: 9.03% (1.2998 => 1.4172, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7298, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6754, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9877, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.57% (1.7688 => 1.8320, std. dev.: 0.0188) SingleSource/Benchmarks/Misc/salsa20: 3.57% (7.4271 => 7.6919, std. dev.: 0.0084) MultiSource/Benchmarks/nbench/nbench: 3.16% (11.2619 => 11.6174, std. dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4540, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-6: 2.94% (1.9199 => 1.9763, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9393, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.64% (8.8259 => 9.0591, std. dev.: 0.0205) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.43% (7.9275 => 8.1200, std. dev.: 0.0102) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 1.57% (0.8273 => 0.8403, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.50% (1.4298 => 1.4512, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5141, std. dev.: 0.0035) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.29% (2.0200 => 2.0460, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.21% (1.9433 => 1.9669, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 1.13% (9.0760 => 9.1787, std. dev.: 0.0015) MultiSource/Benchmarks/sim/sim: 1.07% (5.0168 => 5.0705, std. dev.: 0.0124) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -21.00% (0.4657 => 0.3679, std. dev.: 0.0315) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.70% (0.2670 => 0.2491, std. dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.15% (22.5627 => 21.1757, std. dev.: 0.0046) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.98% (0.3511 => 0.3301, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -3.73% (0.3623 => 0.3488, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.67% (0.3650 => 0.3516, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-2: -3.67% (0.3601 => 0.3469, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -3.55% (0.3663 => 0.3533, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -3.54% (0.3646 => 0.3517, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -3.52% (0.3578 => 0.3452, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -3.50% (0.3940 => 0.3802, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -3.43% (0.3789 => 0.3659, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -3.19% (0.3914 => 0.3789, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -3.05% (0.4003 => 0.3881, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.81% (0.8818 => 0.8570, std. dev.: 0.0050) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.62% (0.6576 => 0.6404, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: -2.11% (0.6250 => 0.6118, std. dev.: 0.0044) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -10.10% (1.2308 => 1.1065, std. dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.53% (0.3139 => 0.2934, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9474, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.49% (1.3780 => 1.3161, std. dev.: 0.0064) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.91% (2.5089 => 2.4107, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.67% (1.9762 => 1.9037, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: -2.16% (1.1560 => 1.1310, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -2.12% (6.3560 => 6.2215, std. dev.: 0.0150) MultiSource/Applications/minisat/minisat: -1.96% (9.3358 => 9.1530, std. dev.: 0.0419) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.92% (6.6320 => 6.5047, std. dev.: 0.0033) MultiSource/Benchmarks/mafft/pairlocalalign: -1.87% (28.2225 => 27.6948, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.71% (20.3410 => 19.9939, std. dev.: 0.0403) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9950, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) MultiSource/Applications/lua/lua: -1.45% (26.5159 => 26.1311, std. dev.: 0.0242) SingleSource/Benchmarks/Shootout/heapsort: -1.37% (3.9173 => 3.8636, std. dev.: 0.0047) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.93s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon May 14 22:09:39 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 15 May 2012 00:09:39 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120515050939.7FAC12A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/653?compare_to=652&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 653, Order: 156801, Start Time: 2012-05-15 04:13:53, End Time: 2012-05-15 05:10:25 To: 652, Order: 156794, Start Time: 2012-05-15 02:50:22, End Time: 2012-05-15 03:46:55 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (58 on baseline) Performance Improvements: 1 (38 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 891 (792 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -2.15% (3.8424 => 3.7599, std. dev.: 0.0299) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.66% (2.0176 => 2.2731, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.00% (0.3130 => 0.3349, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.37% (0.2721 => 0.2840, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.46% (3.9660 => 4.1032, std. dev.: 0.0015) MultiSource/Benchmarks/nbench/nbench: 3.04% (1.0594 => 1.0916, std. dev.: 0.0030) MultiSource/Applications/SPASS/SPASS: 3.00% (13.8202 => 14.2349, std. dev.: 0.0127) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.90% (0.6959 => 0.7161, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.87% (0.9199 => 0.9463, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/football/football: 2.82% (0.8310 => 0.8544, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.58% (1.2193 => 1.2507, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.53% (1.1364 => 1.1651, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.45% (0.5637 => 0.5775, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 2.39% (2.1791 => 2.2311, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.26% (1.4563 => 1.4892, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/gs/gs: 2.20% (3.8646 => 3.9496, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.19% (0.5577 => 0.5699, std. dev.: 0.0013) MultiSource/Applications/kimwitu++/kc: 2.03% (16.6129 => 16.9501, std. dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.01% (1.3245 => 1.3511, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 2.00% (0.7038 => 0.7179, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.98% (13.2842 => 13.5471, std. dev.: 0.0080) MultiSource/Applications/Burg/burg: 1.93% (1.1061 => 1.1275, std. dev.: 0.0010) MultiSource/Applications/treecc/treecc: 1.90% (1.9270 => 1.9636, std. dev.: 0.0042) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.86% (0.7460 => 0.7599, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.83% (0.7710 => 0.7851, std. dev.: 0.0030) MultiSource/Applications/sqlite3/sqlite3: 1.76% (16.2614 => 16.5472, std. dev.: 0.0176) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.75% (1.3813 => 1.4055, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.65% (1.3819 => 1.4047, std. dev.: 0.0007) MultiSource/Applications/SIBsim4/SIBsim4: 1.57% (1.2749 => 1.2949, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.57% (3.6692 => 3.7267, std. dev.: 0.0011) MultiSource/Applications/hbd/hbd: 1.55% (1.3693 => 1.3905, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.37% (2.1007 => 2.1295, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.32% (3.2742 => 3.3175, std. dev.: 0.0046) MultiSource/Applications/JM/lencod/lencod: 1.22% (14.8535 => 15.0353, std. dev.: 0.0071) MultiSource/Benchmarks/Bullet/bullet: 1.18% (33.2944 => 33.6881, std. dev.: 0.0120) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.02% (1.1333 => 1.1449, std. dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.17% (1.8175 => 2.2567, std. dev.: 0.0533) SingleSource/Benchmarks/Misc/mandel-2: 8.04% (1.2998 => 1.4043, std. dev.: 0.0110) SingleSource/Benchmarks/Misc/flops-4: 6.52% (1.0640 => 1.1334, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.87% (1.5824 => 1.6753, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 3.81% (1.9144 => 1.9874, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: 3.71% (7.4271 => 7.7025, std. dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.70% (1.7688 => 1.8343, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 3.18% (11.2619 => 11.6204, std. dev.: 0.0021) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4531, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-6: 2.88% (1.9199 => 1.9752, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9393, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.68% (8.8259 => 9.0625, std. dev.: 0.0220) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.41% (7.9275 => 8.1184, std. dev.: 0.0127) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0083) MultiSource/Applications/lemon/lemon: 1.52% (1.4298 => 1.4515, std. dev.: 0.0010) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5089, std. dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.27% (2.0200 => 2.0456, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.14% (1.9433 => 1.9655, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 1.13% (9.0760 => 9.1789, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -20.21% (0.4657 => 0.3716, std. dev.: 0.0162) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.59% (0.2670 => 0.2494, std. dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.09% (22.5627 => 21.1894, std. dev.: 0.0118) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.01% (0.3511 => 0.3300, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: -3.78% (0.3623 => 0.3486, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -3.72% (0.3601 => 0.3467, std. dev.: 0.0022) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.70% (0.3650 => 0.3515, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -3.61% (0.3578 => 0.3449, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -3.60% (0.3663 => 0.3531, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -3.57% (0.3646 => 0.3516, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -3.48% (0.3789 => 0.3657, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/property: -3.45% (0.3940 => 0.3804, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: -3.19% (0.3914 => 0.3789, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -3.05% (0.4003 => 0.3881, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.82% (0.8818 => 0.8569, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: -2.16% (0.6250 => 0.6115, std. dev.: 0.0005) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -9.88% (1.2308 => 1.1092, std. dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.53% (0.3139 => 0.2934, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.85% (1.3780 => 1.3111, std. dev.: 0.0081) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9474, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -4.01% (2.5089 => 2.4082, std. dev.: 0.0012) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -3.67% (1.9762 => 1.9037, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/lists: -2.33% (6.3560 => 6.2078, std. dev.: 0.0172) SingleSource/Benchmarks/Misc/richards_benchmark: -2.14% (1.1560 => 1.1313, std. dev.: 0.0016) MultiSource/Benchmarks/mafft/pairlocalalign: -1.89% (28.2225 => 27.6898, std. dev.: 0.0007) MultiSource/Applications/minisat/minisat: -1.85% (9.3358 => 9.1628, std. dev.: 0.0100) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.85% (6.6320 => 6.5093, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9953, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.59% (20.3410 => 20.0171, std. dev.: 0.0131) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.50% (3.9173 => 3.8586, std. dev.: 0.0039) MultiSource/Applications/lua/lua: -1.36% (26.5159 => 26.1562, std. dev.: 0.0491) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.53s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon May 14 23:33:21 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 15 May 2012 01:33:21 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120515063321.975392A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/654?compare_to=653&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 654, Order: 156803, Start Time: 2012-05-15 05:37:26, End Time: 2012-05-15 06:34:08 To: 653, Order: 156801, Start Time: 2012-05-15 04:13:53, End Time: 2012-05-15 05:10:25 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (60 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (788 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.56% (2.0176 => 2.2911, std. dev.: 0.0141) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.09% (0.3130 => 0.3352, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.52% (0.2721 => 0.2844, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.55% (3.9660 => 4.1067, std. dev.: 0.0142) MultiSource/Benchmarks/nbench/nbench: 3.40% (1.0594 => 1.0954, std. dev.: 0.0027) MultiSource/Applications/SPASS/SPASS: 3.15% (13.8202 => 14.2551, std. dev.: 0.0120) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.11% (0.5265 => 0.5429, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 2.95% (0.8310 => 0.8555, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.95% (0.6959 => 0.7164, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.80% (0.9199 => 0.9457, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.67% (1.1364 => 1.1667, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.55% (1.2193 => 1.2504, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.52% (0.5637 => 0.5779, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.38% (1.4563 => 1.4909, std. dev.: 0.0018) MultiSource/Applications/siod/siod: 2.28% (2.1791 => 2.2287, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.19% (0.5577 => 0.5699, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.05% (1.3245 => 1.3516, std. dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 2.01% (16.6129 => 16.9476, std. dev.: 0.0212) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.95% (13.2842 => 13.5432, std. dev.: 0.0077) MultiSource/Applications/treecc/treecc: 1.94% (1.9270 => 1.9644, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 1.89% (3.8646 => 3.9376, std. dev.: 0.0018) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.87% (0.7710 => 0.7854, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.86% (0.7460 => 0.7599, std. dev.: 0.0006) MultiSource/Applications/Burg/burg: 1.81% (1.1061 => 1.1261, std. dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 1.80% (0.7038 => 0.7165, std. dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 1.79% (16.2614 => 16.5531, std. dev.: 0.0109) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.76% (1.3813 => 1.4056, std. dev.: 0.0066) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.76% (1.3819 => 1.4062, std. dev.: 0.0007) MultiSource/Applications/SIBsim4/SIBsim4: 1.66% (1.2749 => 1.2960, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.64% (3.6692 => 3.7295, std. dev.: 0.0138) MultiSource/Applications/hbd/hbd: 1.59% (1.3693 => 1.3911, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.44% (2.1007 => 2.1309, std. dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 1.32% (14.8535 => 15.0497, std. dev.: 0.0035) MultiSource/Applications/JM/ldecod/ldecod: 1.13% (6.5754 => 6.6497, std. dev.: 0.0119) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.07% (1.5188 => 1.5351, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.01% (1.1333 => 1.1447, std. dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.59% (1.8175 => 2.2644, std. dev.: 0.0351) SingleSource/Benchmarks/Misc/mandel-2: 7.36% (1.2998 => 1.3955, std. dev.: 0.0107) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.91% (1.5824 => 1.6759, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9877, std. dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.66% (1.7688 => 1.8335, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/salsa20: 3.60% (7.4271 => 7.6943, std. dev.: 0.0031) MultiSource/Benchmarks/nbench/nbench: 3.12% (11.2619 => 11.6138, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 3.01% (12.0921 => 12.4559, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-6: 2.85% (1.9199 => 1.9747, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9394, std. dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.47% (8.8259 => 9.0439, std. dev.: 0.0210) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.42% (7.9275 => 8.1193, std. dev.: 0.0170) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9600, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 1.60% (0.8273 => 0.8405, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.43% (1.4298 => 1.4503, std. dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5090, std. dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.26% (2.0200 => 2.0455, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0034) MultiSource/Benchmarks/sim/sim: 1.16% (5.0168 => 5.0752, std. dev.: 0.0065) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1780, std. dev.: 0.0009) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -17.14% (0.4657 => 0.3859, std. dev.: 0.0226) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.67% (0.2670 => 0.2492, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.10% (0.3511 => 0.3297, std. dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.08% (22.5627 => 21.1908, std. dev.: 0.0067) SingleSource/UnitTests/ObjC/exceptions-3: -3.70% (0.3623 => 0.3489, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.59% (0.3650 => 0.3519, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-2: -3.53% (0.3601 => 0.3474, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -3.47% (0.3663 => 0.3536, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -3.40% (0.3940 => 0.3806, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -3.40% (0.3646 => 0.3522, std. dev.: 0.0033) SingleSource/UnitTests/ObjC/trivial-interface: -3.38% (0.3578 => 0.3457, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: -3.30% (0.3789 => 0.3664, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -3.12% (0.3914 => 0.3792, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -3.10% (0.4003 => 0.3879, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.02% (0.8818 => 0.8552, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: -2.06% (0.6250 => 0.6121, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.84% (0.6576 => 0.6455, std. dev.: 0.0007) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -10.81% (1.2308 => 1.0978, std. dev.: 0.0072) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.53% (0.3139 => 0.2934, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.35% (1.3780 => 1.3043, std. dev.: 0.0067) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9474, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -4.01% (2.5089 => 2.4083, std. dev.: 0.0012) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.63% (1.9762 => 1.9045, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -2.33% (6.3560 => 6.2079, std. dev.: 0.0149) SingleSource/Benchmarks/Misc/richards_benchmark: -2.15% (1.1560 => 1.1312, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: -1.90% (9.3358 => 9.1586, std. dev.: 0.0317) MultiSource/Benchmarks/mafft/pairlocalalign: -1.87% (28.2225 => 27.6943, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.87% (6.6320 => 6.5081, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3446, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.65% (20.3410 => 20.0047, std. dev.: 0.0095) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9957, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.50% (3.9173 => 3.8585, std. dev.: 0.0093) MultiSource/Applications/lua/lua: -1.42% (26.5159 => 26.1405, std. dev.: 0.0598) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.08% (3.8887 => 3.8467, std. dev.: 0.0056) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.48s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue May 15 00:57:05 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 15 May 2012 02:57:05 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120515075705.8AF082A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/655?compare_to=654&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 655, Order: 156807, Start Time: 2012-05-15 07:02:11, End Time: 2012-05-15 07:57:51 To: 654, Order: 156803, Start Time: 2012-05-15 05:37:26, End Time: 2012-05-15 06:34:08 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== New Failures: 17 (17 on baseline) Performance Regressions: 1 (60 on baseline) Performance Improvements: 0 (26 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 874 (785 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== New Failures - Execution Time ----------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lua/lua MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/treecc/treecc MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 3.04% (3.7674 => 3.8820, std. dev.: 0.0265) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lua/lua MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/treecc/treecc MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.72% (2.0176 => 2.2743, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.03% (0.3130 => 0.3350, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.08% (0.2721 => 0.2832, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.54% (3.9660 => 4.1064, std. dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.15% (0.5265 => 0.5431, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.05% (0.6959 => 0.7171, std. dev.: 0.0018) MultiSource/Benchmarks/nbench/nbench: 3.02% (1.0594 => 1.0914, std. dev.: 0.0017) MultiSource/Applications/SPASS/SPASS: 2.95% (13.8202 => 14.2273, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.91% (0.9199 => 0.9467, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/football/football: 2.76% (0.8310 => 0.8539, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.62% (1.2193 => 1.2513, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.61% (0.5637 => 0.5784, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 2.45% (2.1791 => 2.2325, std. dev.: 0.0097) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.45% (1.1364 => 1.1642, std. dev.: 0.0019) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.40% (0.7710 => 0.7895, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.38% (0.5577 => 0.5710, std. dev.: 0.0013) MultiSource/Applications/kimwitu++/kc: 2.29% (16.6129 => 16.9939, std. dev.: 0.0104) MultiSource/Applications/Burg/burg: 2.20% (1.1061 => 1.1304, std. dev.: 0.0089) MultiSource/Benchmarks/MallocBench/gs/gs: 2.19% (3.8646 => 3.9491, std. dev.: 0.0035) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.10% (1.4563 => 1.4869, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.03% (1.3245 => 1.3514, std. dev.: 0.0025) MultiSource/Applications/treecc/treecc: 2.01% (1.9270 => 1.9657, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 2.00% (0.7038 => 0.7179, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.92% (13.2842 => 13.5393, std. dev.: 0.0106) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.81% (0.7460 => 0.7595, std. dev.: 0.0015) MultiSource/Applications/hbd/hbd: 1.73% (1.3693 => 1.3930, std. dev.: 0.0063) MultiSource/Applications/sqlite3/sqlite3: 1.60% (16.2614 => 16.5219, std. dev.: 0.0213) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.58% (3.6692 => 3.7272, std. dev.: 0.0027) MultiSource/Applications/spiff/spiff: 1.55% (0.7506 => 0.7622, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.50% (1.3819 => 1.4026, std. dev.: 0.0014) MultiSource/Applications/SIBsim4/SIBsim4: 1.40% (1.2749 => 1.2928, std. dev.: 0.0033) MultiSource/Applications/JM/lencod/lencod: 1.35% (14.8535 => 15.0544, std. dev.: 0.0176) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.32% (1.3813 => 1.3996, std. dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.22% (3.2742 => 3.3142, std. dev.: 0.0010) MultiSource/Applications/JM/ldecod/ldecod: 1.13% (6.5754 => 6.6500, std. dev.: 0.0128) MultiSource/Applications/d/make_dparser: 1.07% (3.1889 => 3.2230, std. dev.: 0.0049) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.06% (1.1333 => 1.1453, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.01% (1.5188 => 1.5341, std. dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.42% (1.8175 => 2.2613, std. dev.: 0.0154) SingleSource/Benchmarks/Misc/flops-4: 6.52% (1.0640 => 1.1334, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7298, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 5.88% (1.2998 => 1.3762, std. dev.: 0.0200) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.87% (1.5824 => 1.6753, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8147, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 3.67% (1.9144 => 1.9846, std. dev.: 0.0018) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.61% (1.7688 => 1.8326, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 3.14% (11.2619 => 11.6158, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/salsa20: 3.08% (7.4271 => 7.6559, std. dev.: 0.0241) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4538, std. dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.95% (8.8259 => 9.0866, std. dev.: 0.0073) SingleSource/Benchmarks/Misc/flops-6: 2.91% (1.9199 => 1.9757, std. dev.: 0.0006) MultiSource/Benchmarks/llubenchmark/llu: 2.89% (3.7731 => 3.8820, std. dev.: 0.0265) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9392, std. dev.: 0.0027) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.42% (7.9275 => 8.1190, std. dev.: 0.0080) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.54% (1.4298 => 1.4518, std. dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.43% (8.3908 => 8.5110, std. dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.30% (2.0200 => 2.0462, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 1.13% (9.0760 => 9.1787, std. dev.: 0.0016) MultiSource/Benchmarks/sim/sim: 1.08% (5.0168 => 5.0711, std. dev.: 0.0088) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.12% (0.2670 => 0.2480, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.86% (0.3511 => 0.3270, std. dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.10% (22.5627 => 21.1860, std. dev.: 0.0033) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.02% (0.8818 => 0.8552, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: -2.88% (0.3578 => 0.3475, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.05% (0.6576 => 0.6441, std. dev.: 0.0043) SingleSource/Benchmarks/Misc-C++/bigfib: -1.82% (0.6250 => 0.6136, std. dev.: 0.0037) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -10.30% (1.2308 => 1.1040, std. dev.: 0.0321) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.63% (0.3139 => 0.2931, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9474, std. dev.: 0.0026) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.46% (1.3780 => 1.3165, std. dev.: 0.0037) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -4.06% (2.5089 => 2.4071, std. dev.: 0.0197) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0010) MultiSource/Benchmarks/Olden/bh/bh: -3.63% (1.9762 => 1.9045, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.57% (20.3410 => 19.8181, std. dev.: 0.0764) SingleSource/Benchmarks/Misc/richards_benchmark: -2.10% (1.1560 => 1.1317, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -2.10% (6.3560 => 6.2227, std. dev.: 0.0103) MultiSource/Applications/minisat/minisat: -1.95% (9.3358 => 9.1536, std. dev.: 0.0468) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.83% (6.6320 => 6.5108, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3446, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9954, std. dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.94s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue May 15 02:21:24 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 15 May 2012 04:21:24 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120515092124.BC2C82A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/656?compare_to=655&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 656, Order: 156808, Start Time: 2012-05-15 08:25:00, End Time: 2012-05-15 09:22:11 To: 655, Order: 156807, Start Time: 2012-05-15 07:02:11, End Time: 2012-05-15 07:57:51 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== New Passes: 17 (0 on baseline) Performance Regressions: 1 (72 on baseline) Performance Improvements: 1 (28 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 873 (788 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== New Passes - Execution Time --------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lua/lua MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/treecc/treecc MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 2.17% (1.3762 => 1.4061, std. dev.: 0.0068) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -1.58% (3.8820 => 3.8208, std. dev.: 0.0051) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.53% (2.0176 => 2.2906, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.28% (0.3130 => 0.3358, std. dev.: 0.0066) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.89% (0.2721 => 0.2854, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.35% (3.9660 => 4.1384, std. dev.: 0.0046) MultiSource/Benchmarks/nbench/nbench: 3.61% (1.0594 => 1.0976, std. dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.52% (0.6959 => 0.7204, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.51% (0.5265 => 0.5450, std. dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 3.43% (13.8202 => 14.2946, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.30% (0.9199 => 0.9503, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/football/football: 3.18% (0.8310 => 0.8574, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.12% (1.2193 => 1.2573, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.97% (0.7710 => 0.7939, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.94% (0.5577 => 0.5741, std. dev.: 0.0011) MultiSource/Applications/siod/siod: 2.93% (2.1791 => 2.2429, std. dev.: 0.0038) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.92% (1.1364 => 1.1696, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.87% (0.5637 => 0.5799, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.80% (1.4563 => 1.4971, std. dev.: 0.0058) MultiSource/Applications/kimwitu++/kc: 2.72% (16.6129 => 17.0644, std. dev.: 0.0042) MultiSource/Applications/Burg/burg: 2.68% (1.1061 => 1.1357, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/gs/gs: 2.50% (3.8646 => 3.9611, std. dev.: 0.0025) MultiSource/Applications/spiff/spiff: 2.34% (0.7506 => 0.7682, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.33% (1.3245 => 1.3554, std. dev.: 0.0015) MultiSource/Applications/lambda-0_1_3/lambda: 2.33% (0.7038 => 0.7202, std. dev.: 0.0016) MultiSource/Applications/treecc/treecc: 2.31% (1.9270 => 1.9716, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/hash2: 2.31% (0.4328 => 0.4428, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.28% (1.3819 => 1.4134, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.20% (13.2842 => 13.5768, std. dev.: 0.0056) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.18% (0.7460 => 0.7623, std. dev.: 0.0062) MultiSource/Applications/hbd/hbd: 2.12% (1.3693 => 1.3983, std. dev.: 0.0065) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.11% (1.3813 => 1.4105, std. dev.: 0.0016) MultiSource/Applications/SIBsim4/SIBsim4: 2.05% (1.2749 => 1.3010, std. dev.: 0.0014) MultiSource/Applications/sqlite3/sqlite3: 1.94% (16.2614 => 16.5770, std. dev.: 0.0077) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.89% (3.6692 => 3.7385, std. dev.: 0.0125) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.70% (2.1007 => 2.1364, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.70% (3.2742 => 3.3297, std. dev.: 0.0008) MultiSource/Applications/JM/lencod/lencod: 1.63% (14.8535 => 15.0963, std. dev.: 0.0068) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.60% (1.5188 => 1.5431, std. dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.43% (1.1333 => 1.1495, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.40% (4.3801 => 4.4416, std. dev.: 0.0030) MultiSource/Applications/JM/ldecod/ldecod: 1.40% (6.5754 => 6.6677, std. dev.: 0.0022) MultiSource/Applications/d/make_dparser: 1.33% (3.1889 => 3.2313, std. dev.: 0.0062) MultiSource/Applications/ClamAV/clamscan: 1.20% (14.5298 => 14.7036, std. dev.: 0.0128) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.15% (7.2180 => 7.3007, std. dev.: 0.0069) MultiSource/Applications/lemon/lemon: 1.08% (1.0313 => 1.0424, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.02% (4.4433 => 4.4886, std. dev.: 0.0013) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 23.95% (1.8175 => 2.2528, std. dev.: 0.0158) SingleSource/Benchmarks/Misc/mandel-2: 8.18% (1.2998 => 1.4061, std. dev.: 0.0068) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7298, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6755, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8146, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9880, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.65% (1.7688 => 1.8333, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/salsa20: 3.55% (7.4271 => 7.6904, std. dev.: 0.0107) MultiSource/Benchmarks/nbench/nbench: 3.13% (11.2619 => 11.6139, std. dev.: 0.0045) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4536, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-6: 2.87% (1.9199 => 1.9750, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.76% (2.8606 => 2.9395, std. dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.72% (8.8259 => 9.0660, std. dev.: 0.0156) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.29% (7.9275 => 8.1089, std. dev.: 0.0191) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.58% (0.8273 => 0.8404, std. dev.: 0.0001) MultiSource/Benchmarks/sim/sim: 1.50% (5.0168 => 5.0923, std. dev.: 0.0022) MultiSource/Applications/lemon/lemon: 1.50% (1.4298 => 1.4513, std. dev.: 0.0010) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5087, std. dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.30% (2.0200 => 2.0463, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bisort/bisort: 1.29% (0.8239 => 0.8345, std. dev.: 0.0005) MultiSource/Benchmarks/llubenchmark/llu: 1.26% (3.7731 => 3.8208, std. dev.: 0.0051) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0035) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.15% (1.9433 => 1.9657, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/flops: 1.10% (9.0760 => 9.1757, std. dev.: 0.0022) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.10% (0.2670 => 0.2507, std. dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.93% (22.5627 => 21.2243, std. dev.: 0.0125) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.04% (0.3511 => 0.3334, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.52% (0.8818 => 0.8596, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.87% (0.6576 => 0.6453, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: -1.60% (0.6250 => 0.6150, std. dev.: 0.0007) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -9.60% (1.2308 => 1.1127, std. dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.16% (1.0460 => 0.9502, std. dev.: 0.0010) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.53% (0.3139 => 0.2934, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2650, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9474, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.73% (1.3780 => 1.3128, std. dev.: 0.0029) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -4.03% (2.5089 => 2.4077, std. dev.: 0.0015) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.64% (1.9762 => 1.9043, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout/lists: -2.25% (6.3560 => 6.2130, std. dev.: 0.0083) SingleSource/Benchmarks/Misc/richards_benchmark: -2.14% (1.1560 => 1.1313, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: -1.99% (9.3358 => 9.1502, std. dev.: 0.0343) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.88% (6.6320 => 6.5074, std. dev.: 0.0033) MultiSource/Benchmarks/mafft/pairlocalalign: -1.87% (28.2225 => 27.6942, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.85% (20.3410 => 19.9646, std. dev.: 0.0356) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9954, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.56% (0.9692 => 0.9541, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.48% (3.9173 => 3.8593, std. dev.: 0.0043) MultiSource/Applications/lua/lua: -1.40% (26.5159 => 26.1450, std. dev.: 0.0356) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.95s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue May 15 03:45:09 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 15 May 2012 05:45:09 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120515104509.820562A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/657?compare_to=656&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 657, Order: 156809, Start Time: 2012-05-15 09:49:14, End Time: 2012-05-15 10:45:56 To: 656, Order: 156808, Start Time: 2012-05-15 08:25:00, End Time: 2012-05-15 09:22:11 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (68 on baseline) Performance Improvements: 1 (29 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 891 (791 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -17.64% (0.4542 => 0.3741, std. dev.: 0.0219) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.54% (2.0176 => 2.2907, std. dev.: 0.0169) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.41% (0.3130 => 0.3362, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.81% (0.2721 => 0.2852, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.06% (3.9660 => 4.1269, std. dev.: 0.0108) MultiSource/Benchmarks/nbench/nbench: 3.55% (1.0594 => 1.0970, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.49% (0.5265 => 0.5449, std. dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 3.41% (13.8202 => 14.2918, std. dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.36% (0.6959 => 0.7193, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.34% (0.9199 => 0.9506, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/football/football: 3.19% (0.8310 => 0.8575, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.03% (1.1364 => 1.1708, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.97% (1.2193 => 1.2555, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.93% (0.5637 => 0.5802, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 2.78% (2.1791 => 2.2396, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.74% (1.4563 => 1.4962, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.62% (0.5577 => 0.5723, std. dev.: 0.0017) MultiSource/Applications/kimwitu++/kc: 2.59% (16.6129 => 17.0432, std. dev.: 0.0119) MultiSource/Benchmarks/MallocBench/gs/gs: 2.55% (3.8646 => 3.9631, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.44% (1.3245 => 1.3568, std. dev.: 0.0042) MultiSource/Applications/lambda-0_1_3/lambda: 2.34% (0.7038 => 0.7203, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.33% (1.3813 => 1.4135, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 2.31% (0.4328 => 0.4428, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 2.30% (1.9270 => 1.9713, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.28% (0.7710 => 0.7886, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.21% (13.2842 => 13.5774, std. dev.: 0.0142) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.20% (0.7460 => 0.7624, std. dev.: 0.0012) MultiSource/Applications/SIBsim4/SIBsim4: 2.04% (1.2749 => 1.3009, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.03% (1.3819 => 1.4099, std. dev.: 0.0026) MultiSource/Applications/sqlite3/sqlite3: 1.95% (16.2614 => 16.5791, std. dev.: 0.0145) MultiSource/Applications/hbd/hbd: 1.94% (1.3693 => 1.3959, std. dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.89% (3.6692 => 3.7385, std. dev.: 0.0116) MultiSource/Applications/spiff/spiff: 1.72% (0.7506 => 0.7635, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.67% (2.1007 => 2.1358, std. dev.: 0.0086) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.65% (3.2742 => 3.3283, std. dev.: 0.0019) MultiSource/Applications/JM/lencod/lencod: 1.63% (14.8535 => 15.0949, std. dev.: 0.0082) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.44% (1.5188 => 1.5407, std. dev.: 0.0070) MultiSource/Applications/JM/ldecod/ldecod: 1.43% (6.5754 => 6.6696, std. dev.: 0.0091) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.43% (1.1333 => 1.1495, std. dev.: 0.0017) MultiSource/Applications/d/make_dparser: 1.18% (3.1889 => 3.2265, std. dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.17% (7.2180 => 7.3026, std. dev.: 0.0040) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.17% (4.3801 => 4.4314, std. dev.: 0.0095) MultiSource/Applications/ClamAV/clamscan: 1.11% (14.5298 => 14.6918, std. dev.: 0.0121) MultiSource/Applications/lemon/lemon: 1.06% (1.0313 => 1.0422, std. dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.26% (1.8175 => 2.2585, std. dev.: 0.0058) SingleSource/Benchmarks/Misc/mandel-2: 7.80% (1.2998 => 1.4012, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.90% (1.5824 => 1.6758, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8147, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.79% (1.9144 => 1.9870, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: 3.77% (7.4271 => 7.7073, std. dev.: 0.0022) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.64% (1.7688 => 1.8331, std. dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 3.14% (11.2619 => 11.6157, std. dev.: 0.0040) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4552, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-6: 2.86% (1.9199 => 1.9749, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.79% (8.8259 => 9.0720, std. dev.: 0.0142) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.76% (2.8606 => 2.9396, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.32% (7.9275 => 8.1117, std. dev.: 0.0100) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 1.61% (0.8273 => 0.8406, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.42% (1.4298 => 1.4501, std. dev.: 0.0022) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5088, std. dev.: 0.0017) SingleSource/Benchmarks/Dhrystone/fldry: 1.34% (1.9290 => 1.9549, std. dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.28% (2.0200 => 2.0458, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.18% (1.9433 => 1.9663, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0035) MultiSource/Benchmarks/sim/sim: 1.17% (5.0168 => 5.0753, std. dev.: 0.0096) SingleSource/Benchmarks/Misc/flops: 1.13% (9.0760 => 9.1787, std. dev.: 0.0016) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -19.67% (0.4657 => 0.3741, std. dev.: 0.0219) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.14% (0.2670 => 0.2506, std. dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.90% (22.5627 => 21.2307, std. dev.: 0.0017) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.84% (0.3511 => 0.3306, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.55% (0.8818 => 0.8593, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.13% (0.6576 => 0.6436, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: -1.79% (0.6250 => 0.6138, std. dev.: 0.0010) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -10.53% (1.2308 => 1.1012, std. dev.: 0.0066) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.50% (0.3139 => 0.2935, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.11% (1.3780 => 1.3076, std. dev.: 0.0094) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9472, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -4.03% (2.5089 => 2.4078, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -3.65% (1.9762 => 1.9041, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: -2.13% (1.1560 => 1.1314, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.96% (6.3560 => 6.2314, std. dev.: 0.0033) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.96% (6.6320 => 6.5022, std. dev.: 0.0027) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.95% (20.3410 => 19.9443, std. dev.: 0.0188) MultiSource/Applications/minisat/minisat: -1.90% (9.3358 => 9.1585, std. dev.: 0.0331) MultiSource/Benchmarks/mafft/pairlocalalign: -1.87% (28.2225 => 27.6953, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9954, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) MultiSource/Applications/lua/lua: -1.39% (26.5159 => 26.1462, std. dev.: 0.0533) SingleSource/Benchmarks/Shootout/heapsort: -1.33% (3.9173 => 3.8652, std. dev.: 0.0009) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.19s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue May 15 05:09:01 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 15 May 2012 07:09:01 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120515120901.BE4232A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/658?compare_to=657&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 658, Order: 156812, Start Time: 2012-05-15 11:13:01, End Time: 2012-05-15 12:09:48 To: 657, Order: 156809, Start Time: 2012-05-15 09:49:14, End Time: 2012-05-15 10:45:56 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (66 on baseline) Performance Improvements: 0 (29 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 891 (793 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 1.37% (7.9370 => 8.0458, std. dev.: 0.0081) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.84% (2.0176 => 2.2766, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.64% (0.3130 => 0.3369, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.85% (0.2721 => 0.2853, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.59% (3.9660 => 4.1082, std. dev.: 0.0038) MultiSource/Benchmarks/nbench/nbench: 3.37% (1.0594 => 1.0951, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.15% (0.5265 => 0.5431, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.10% (0.6959 => 0.7175, std. dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: 3.10% (13.8202 => 14.2485, std. dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.04% (0.9199 => 0.9479, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/football/football: 3.01% (0.8310 => 0.8560, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.82% (1.1364 => 1.1684, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.75% (1.2193 => 1.2528, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.64% (0.5637 => 0.5786, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/hash2: 2.40% (0.4328 => 0.4432, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.37% (1.4563 => 1.4908, std. dev.: 0.0032) MultiSource/Applications/siod/siod: 2.36% (2.1791 => 2.2306, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.33% (0.5577 => 0.5707, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.32% (13.2842 => 13.5921, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.25% (1.3245 => 1.3543, std. dev.: 0.0017) MultiSource/Applications/kimwitu++/kc: 2.19% (16.6129 => 16.9771, std. dev.: 0.0054) MultiSource/Benchmarks/MallocBench/gs/gs: 2.10% (3.8646 => 3.9457, std. dev.: 0.0119) MultiSource/Applications/Burg/burg: 2.10% (1.1061 => 1.1293, std. dev.: 0.0026) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.09% (0.7710 => 0.7871, std. dev.: 0.0033) MultiSource/Applications/treecc/treecc: 2.02% (1.9270 => 1.9660, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.01% (1.3819 => 1.4097, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.01% (0.7460 => 0.7610, std. dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: 2.00% (0.7038 => 0.7179, std. dev.: 0.0013) MultiSource/Applications/sqlite3/sqlite3: 1.96% (16.2614 => 16.5799, std. dev.: 0.0136) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.86% (1.3813 => 1.4070, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.78% (3.6692 => 3.7344, std. dev.: 0.0040) MultiSource/Applications/hbd/hbd: 1.76% (1.3693 => 1.3934, std. dev.: 0.0067) MultiSource/Applications/SIBsim4/SIBsim4: 1.72% (1.2749 => 1.2968, std. dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.59% (2.1007 => 2.1340, std. dev.: 0.0015) MultiSource/Applications/JM/lencod/lencod: 1.49% (14.8535 => 15.0748, std. dev.: 0.0070) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.46% (3.2742 => 3.3219, std. dev.: 0.0013) MultiSource/Applications/spiff/spiff: 1.35% (0.7506 => 0.7607, std. dev.: 0.0013) MultiSource/Applications/JM/ldecod/ldecod: 1.28% (6.5754 => 6.6595, std. dev.: 0.0136) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.26% (7.2180 => 7.3088, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.24% (1.1333 => 1.1473, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.17% (1.5188 => 1.5365, std. dev.: 0.0006) MultiSource/Applications/d/make_dparser: 1.16% (3.1889 => 3.2260, std. dev.: 0.0067) MultiSource/Benchmarks/Bullet/bullet: 1.15% (33.2944 => 33.6757, std. dev.: 0.0162) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 23.97% (1.8175 => 2.2531, std. dev.: 0.0214) SingleSource/Benchmarks/Misc/mandel-2: 7.89% (1.2998 => 1.4023, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7298, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.86% (1.5824 => 1.6752, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9876, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.69% (1.7688 => 1.8341, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 3.64% (7.4271 => 7.6978, std. dev.: 0.0061) MultiSource/Benchmarks/nbench/nbench: 3.12% (11.2619 => 11.6133, std. dev.: 0.0050) MultiSource/Applications/hexxagon/hexxagon: 2.98% (12.0921 => 12.4530, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/flops-6: 2.90% (1.9199 => 1.9755, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.74% (2.8606 => 2.9390, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.67% (8.8259 => 9.0613, std. dev.: 0.0059) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.34% (7.9275 => 8.1130, std. dev.: 0.0102) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/ffbench: 1.60% (0.8273 => 0.8405, std. dev.: 0.0014) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5081, std. dev.: 0.0092) MultiSource/Applications/lemon/lemon: 1.37% (1.4298 => 1.4494, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.30% (2.0200 => 2.0462, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.27% (1.9433 => 1.9679, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/sieve: 1.19% (5.1531 => 5.2146, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1779, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.33% (0.2670 => 0.2501, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.95% (0.3511 => 0.3302, std. dev.: 0.0034) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.85% (22.5627 => 21.2419, std. dev.: 0.0062) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.57% (0.8818 => 0.8591, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.48% (0.6576 => 0.6413, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: -1.87% (0.6250 => 0.6133, std. dev.: 0.0005) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -10.46% (1.2308 => 1.1020, std. dev.: 0.0044) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.16% (1.0460 => 0.9502, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.53% (0.3139 => 0.2934, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.02% (1.3780 => 1.3088, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9472, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.97% (2.5089 => 2.4094, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.63% (1.9762 => 1.9044, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/lists: -2.20% (6.3560 => 6.2162, std. dev.: 0.0052) SingleSource/Benchmarks/Misc/richards_benchmark: -2.12% (1.1560 => 1.1315, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.93% (6.6320 => 6.5041, std. dev.: 0.0033) MultiSource/Applications/minisat/minisat: -1.91% (9.3358 => 9.1573, std. dev.: 0.0316) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6918, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/fp-convert: -1.67% (3.4016 => 3.3449, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9956, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.46% (3.9173 => 3.8600, std. dev.: 0.0047) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.42% (20.3410 => 20.0520, std. dev.: 0.0429) MultiSource/Applications/lua/lua: -1.27% (26.5159 => 26.1788, std. dev.: 0.0097) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.06% (3.8887 => 3.8476, std. dev.: 0.0054) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.43s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue May 15 06:32:38 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 15 May 2012 08:32:38 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120515133238.D5DCF2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/659?compare_to=658&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 659, Order: 156815, Start Time: 2012-05-15 12:36:50, End Time: 2012-05-15 13:33:26 To: 658, Order: 156812, Start Time: 2012-05-15 11:13:01, End Time: 2012-05-15 12:09:48 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (56 on baseline) Performance Improvements: 0 (42 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (790 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.86% (2.0176 => 2.2771, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.22% (0.3130 => 0.3356, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.67% (0.2721 => 0.2848, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.35% (3.9660 => 4.0988, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 2.92% (1.0594 => 1.0903, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.91% (0.5265 => 0.5418, std. dev.: 0.0023) MultiSource/Applications/SPASS/SPASS: 2.85% (13.8202 => 14.2137, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.83% (0.6959 => 0.7156, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.69% (0.9199 => 0.9446, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.47% (1.2193 => 1.2494, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.47% (0.5637 => 0.5776, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.46% (1.1364 => 1.1644, std. dev.: 0.0093) MultiSource/Applications/siod/siod: 2.37% (2.1791 => 2.2307, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.13% (0.5577 => 0.5696, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.11% (1.4563 => 1.4871, std. dev.: 0.0017) MultiSource/Applications/lambda-0_1_3/lambda: 2.07% (0.7038 => 0.7184, std. dev.: 0.0020) MultiSource/Applications/kimwitu++/kc: 2.02% (16.6129 => 16.9493, std. dev.: 0.0067) MultiSource/Benchmarks/MallocBench/gs/gs: 2.01% (3.8646 => 3.9423, std. dev.: 0.0072) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.01% (0.7710 => 0.7865, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.97% (1.3245 => 1.3506, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.93% (13.2842 => 13.5401, std. dev.: 0.0081) MultiSource/Applications/Burg/burg: 1.81% (1.1061 => 1.1261, std. dev.: 0.0035) MultiSource/Applications/treecc/treecc: 1.80% (1.9270 => 1.9616, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.74% (0.7460 => 0.7590, std. dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: 1.46% (16.2614 => 16.4990, std. dev.: 0.0277) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.43% (1.3819 => 1.4016, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.38% (3.6692 => 3.7200, std. dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.37% (3.2742 => 3.3192, std. dev.: 0.0115) MultiSource/Applications/SIBsim4/SIBsim4: 1.33% (1.2749 => 1.2918, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.25% (1.3813 => 1.3985, std. dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.22% (2.1007 => 2.1264, std. dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 1.13% (14.8535 => 15.0212, std. dev.: 0.0142) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.72% (1.8175 => 2.2668, std. dev.: 0.0214) SingleSource/Benchmarks/Misc/mandel-2: 8.10% (1.2998 => 1.4051, std. dev.: 0.0124) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7298, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.89% (1.5824 => 1.6756, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.87% (1.9144 => 1.9884, std. dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.65% (1.7688 => 1.8334, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: 3.58% (7.4271 => 7.6927, std. dev.: 0.0090) MultiSource/Benchmarks/nbench/nbench: 3.16% (11.2619 => 11.6182, std. dev.: 0.0020) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4546, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: 2.89% (1.9199 => 1.9754, std. dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.89% (8.8259 => 9.0810, std. dev.: 0.0288) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.76% (2.8606 => 2.9395, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.24% (7.9275 => 8.1049, std. dev.: 0.0138) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.60% (0.8273 => 0.8405, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.42% (1.4298 => 1.4501, std. dev.: 0.0016) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5089, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.29% (2.0200 => 2.0461, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.21% (1.9433 => 1.9669, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 1.11% (9.0760 => 9.1771, std. dev.: 0.0006) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -17.20% (0.4657 => 0.3856, std. dev.: 0.0108) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.55% (0.2670 => 0.2495, std. dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.35% (22.5627 => 21.1302, std. dev.: 0.0155) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.75% (0.3511 => 0.3309, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-2: -4.30% (0.3601 => 0.3446, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: -4.28% (0.3623 => 0.3468, std. dev.: 0.0030) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.16% (0.3650 => 0.3498, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-4: -4.14% (0.3646 => 0.3495, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: -4.11% (0.3578 => 0.3431, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -4.10% (0.3663 => 0.3513, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -3.93% (0.3940 => 0.3785, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -3.93% (0.3789 => 0.3640, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -3.60% (0.3914 => 0.3773, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: -3.57% (0.4003 => 0.3860, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.79% (0.8818 => 0.8572, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/bigfib: -2.34% (0.6250 => 0.6104, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: -2.21% (0.5748 => 0.5621, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.82% (0.6576 => 0.6456, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: -1.77% (0.5818 => 0.5715, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -10.53% (1.2308 => 1.1012, std. dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.53% (0.3139 => 0.2934, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2642, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9473, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.83% (1.3780 => 1.3115, std. dev.: 0.0152) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -4.02% (2.5089 => 2.4081, std. dev.: 0.0043) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.67% (1.9762 => 1.9036, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/richards_benchmark: -2.16% (1.1560 => 1.1310, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -2.13% (6.3560 => 6.2209, std. dev.: 0.0103) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -2.06% (6.6320 => 6.4955, std. dev.: 0.0071) MultiSource/Applications/minisat/minisat: -2.00% (9.3358 => 9.1494, std. dev.: 0.0245) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6909, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9959, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.49% (20.3410 => 20.0370, std. dev.: 0.0197) SingleSource/Benchmarks/Shootout/heapsort: -1.49% (3.9173 => 3.8589, std. dev.: 0.0046) MultiSource/Applications/lua/lua: -1.34% (26.5159 => 26.1608, std. dev.: 0.0412) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.05% (3.8887 => 3.8480, std. dev.: 0.0018) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.17s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue May 15 07:56:15 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 15 May 2012 09:56:15 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120515145615.956682A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/660?compare_to=659&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 660, Order: 156820, Start Time: 2012-05-15 14:00:25, End Time: 2012-05-15 14:57:02 To: 659, Order: 156815, Start Time: 2012-05-15 12:36:50, End Time: 2012-05-15 13:33:26 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (59 on baseline) Performance Improvements: 0 (42 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (787 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.91% (2.0176 => 2.2781, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.25% (0.3130 => 0.3357, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.52% (0.2721 => 0.2844, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.31% (3.9660 => 4.0971, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.98% (0.5265 => 0.5422, std. dev.: 0.0028) MultiSource/Benchmarks/nbench/nbench: 2.95% (1.0594 => 1.0907, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.86% (0.6959 => 0.7158, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/football/football: 2.84% (0.8310 => 0.8546, std. dev.: 0.0047) MultiSource/Applications/SPASS/SPASS: 2.84% (13.8202 => 14.2122, std. dev.: 0.0135) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.78% (0.9199 => 0.9455, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.48% (0.5637 => 0.5777, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.48% (1.2193 => 1.2495, std. dev.: 0.0011) MultiSource/Applications/siod/siod: 2.47% (2.1791 => 2.2329, std. dev.: 0.0035) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.40% (1.1364 => 1.1637, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.19% (0.5577 => 0.5699, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.15% (1.4563 => 1.4876, std. dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: 2.15% (0.7038 => 0.7189, std. dev.: 0.0007) MultiSource/Applications/kimwitu++/kc: 2.10% (16.6129 => 16.9619, std. dev.: 0.0138) MultiSource/Benchmarks/MallocBench/gs/gs: 2.06% (3.8646 => 3.9441, std. dev.: 0.0101) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.96% (13.2842 => 13.5442, std. dev.: 0.0153) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.86% (1.3245 => 1.3492, std. dev.: 0.0028) MultiSource/Applications/treecc/treecc: 1.86% (1.9270 => 1.9628, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 1.78% (1.1061 => 1.1258, std. dev.: 0.0036) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.76% (0.7460 => 0.7591, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.60% (0.7710 => 0.7833, std. dev.: 0.0029) MultiSource/Applications/sqlite3/sqlite3: 1.51% (16.2614 => 16.5073, std. dev.: 0.0026) MultiSource/Applications/SIBsim4/SIBsim4: 1.46% (1.2749 => 1.2935, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.37% (3.6692 => 3.7193, std. dev.: 0.0065) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.37% (3.2742 => 3.3189, std. dev.: 0.0090) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.35% (1.3813 => 1.4000, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.31% (1.3819 => 1.4000, std. dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.29% (2.1007 => 2.1279, std. dev.: 0.0045) MultiSource/Applications/JM/lencod/lencod: 1.21% (14.8535 => 15.0328, std. dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.05% (1.5188 => 1.5348, std. dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.03% (1.8175 => 2.2542, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/mandel-2: 6.79% (1.2998 => 1.3880, std. dev.: 0.0203) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6755, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8146, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9876, std. dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.67% (1.7688 => 1.8338, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/salsa20: 3.58% (7.4271 => 7.6930, std. dev.: 0.0014) MultiSource/Benchmarks/nbench/nbench: 3.13% (11.2619 => 11.6144, std. dev.: 0.0035) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4532, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/flops-6: 2.88% (1.9199 => 1.9751, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.85% (8.8259 => 9.0778, std. dev.: 0.0130) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9392, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.19% (7.9275 => 8.1013, std. dev.: 0.0214) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ffbench: 1.57% (0.8273 => 0.8403, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.48% (1.4298 => 1.4509, std. dev.: 0.0027) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5097, std. dev.: 0.0064) MultiSource/Benchmarks/sim/sim: 1.30% (5.0168 => 5.0821, std. dev.: 0.0097) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.29% (2.0200 => 2.0460, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.13% (1.9433 => 1.9652, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1775, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -19.28% (0.4657 => 0.3759, std. dev.: 0.0344) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.63% (0.2670 => 0.2493, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.39% (22.5627 => 21.1215, std. dev.: 0.0245) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.70% (0.3511 => 0.3311, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-3: -4.28% (0.3623 => 0.3468, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -4.28% (0.3601 => 0.3447, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.25% (0.3650 => 0.3495, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -4.11% (0.3646 => 0.3496, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -4.10% (0.3663 => 0.3513, std. dev.: 0.0025) SingleSource/UnitTests/ObjC/trivial-interface: -4.05% (0.3578 => 0.3433, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -3.93% (0.3789 => 0.3640, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -3.91% (0.3940 => 0.3786, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions: -3.65% (0.3914 => 0.3771, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -3.57% (0.4003 => 0.3860, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.77% (0.8818 => 0.8574, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/bigfib: -2.27% (0.6250 => 0.6108, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: -2.14% (0.5748 => 0.5625, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: -1.87% (0.5818 => 0.5709, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.73% (0.6576 => 0.6462, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference: -1.44% (0.7061 => 0.6959, std. dev.: 0.0021) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -9.95% (1.2308 => 1.1083, std. dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.16% (1.0460 => 0.9502, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.53% (0.3139 => 0.2934, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.29% (1.3780 => 1.3051, std. dev.: 0.0076) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9473, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.95% (2.5089 => 2.4098, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.73% (0.3458 => 0.3329, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -3.63% (1.9762 => 1.9044, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout/lists: -2.40% (6.3560 => 6.2032, std. dev.: 0.0173) SingleSource/Benchmarks/Misc/richards_benchmark: -2.15% (1.1560 => 1.1312, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: -1.96% (9.3358 => 9.1525, std. dev.: 0.0217) MultiSource/Benchmarks/mafft/pairlocalalign: -1.89% (28.2225 => 27.6893, std. dev.: 0.0027) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.86% (6.6320 => 6.5088, std. dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.81% (20.3410 => 19.9727, std. dev.: 0.0373) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9955, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.45% (3.9173 => 3.8606, std. dev.: 0.0032) MultiSource/Applications/lua/lua: -1.27% (26.5159 => 26.1779, std. dev.: 0.0288) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.38s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue May 15 09:19:55 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 15 May 2012 11:19:55 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120515161955.B31D22A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/661?compare_to=660&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 661, Order: 156821, Start Time: 2012-05-15 15:24:00, End Time: 2012-05-15 16:20:42 To: 660, Order: 156820, Start Time: 2012-05-15 14:00:25, End Time: 2012-05-15 14:57:02 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (60 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 891 (789 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 1.53% (1.3880 => 1.4092, std. dev.: 0.0072) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.87% (2.0176 => 2.2772, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.22% (0.3130 => 0.3356, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.41% (0.2721 => 0.2841, std. dev.: 0.0035) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.26% (3.9660 => 4.0952, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.12% (0.6959 => 0.7176, std. dev.: 0.0016) MultiSource/Benchmarks/nbench/nbench: 2.87% (1.0594 => 1.0898, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.87% (0.5265 => 0.5416, std. dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: 2.86% (13.8202 => 14.2156, std. dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.76% (0.9199 => 0.9453, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/football/football: 2.74% (0.8310 => 0.8538, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 2.50% (2.1791 => 2.2335, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.49% (1.2193 => 1.2496, std. dev.: 0.0095) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.39% (0.5637 => 0.5772, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.38% (1.1364 => 1.1635, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.37% (0.5577 => 0.5709, std. dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: 2.08% (16.6129 => 16.9591, std. dev.: 0.0030) MultiSource/Applications/lambda-0_1_3/lambda: 2.07% (0.7038 => 0.7184, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/gs/gs: 2.02% (3.8646 => 3.9425, std. dev.: 0.0108) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.00% (13.2842 => 13.5495, std. dev.: 0.0244) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.98% (0.7710 => 0.7863, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.96% (1.4563 => 1.4849, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.92% (1.3245 => 1.3499, std. dev.: 0.0029) MultiSource/Applications/treecc/treecc: 1.75% (1.9270 => 1.9607, std. dev.: 0.0018) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.69% (0.7460 => 0.7586, std. dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: 1.49% (16.2614 => 16.5029, std. dev.: 0.0156) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.40% (3.2742 => 3.3201, std. dev.: 0.0046) MultiSource/Applications/SIBsim4/SIBsim4: 1.35% (1.2749 => 1.2921, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.32% (1.3819 => 1.4002, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.32% (3.6692 => 3.7176, std. dev.: 0.0029) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.32% (1.3813 => 1.3995, std. dev.: 0.0038) MultiSource/Applications/JM/lencod/lencod: 1.20% (14.8535 => 15.0315, std. dev.: 0.0068) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.17% (2.1007 => 2.1253, std. dev.: 0.0014) MultiSource/Applications/JM/ldecod/ldecod: 1.09% (6.5754 => 6.6473, std. dev.: 0.0112) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.09% (1.5188 => 1.5354, std. dev.: 0.0007) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.47% (1.8175 => 2.2623, std. dev.: 0.0437) SingleSource/Benchmarks/Misc/mandel-2: 8.42% (1.2998 => 1.4092, std. dev.: 0.0072) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.52% (2.5629 => 2.7299, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.87% (1.5824 => 1.6753, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.80% (1.9144 => 1.9872, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.71% (1.7688 => 1.8344, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: 3.67% (7.4271 => 7.6997, std. dev.: 0.0089) MultiSource/Benchmarks/nbench/nbench: 3.12% (11.2619 => 11.6134, std. dev.: 0.0028) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4534, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-6: 2.88% (1.9199 => 1.9751, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9393, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.46% (8.8259 => 9.0433, std. dev.: 0.0370) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.45% (7.9275 => 8.1216, std. dev.: 0.0103) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.60% (0.8273 => 0.8405, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.49% (1.9290 => 1.9577, std. dev.: 0.0012) MultiSource/Applications/lemon/lemon: 1.41% (1.4298 => 1.4500, std. dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5089, std. dev.: 0.0077) MultiSource/Benchmarks/sim/sim: 1.29% (5.0168 => 5.0815, std. dev.: 0.0050) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.25% (2.0200 => 2.0453, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/bisort/bisort: 1.25% (0.8239 => 0.8342, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0032) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.15% (1.9433 => 1.9657, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/flops: 1.11% (9.0760 => 9.1768, std. dev.: 0.0013) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -17.91% (0.4657 => 0.3823, std. dev.: 0.0243) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.59% (0.2670 => 0.2494, std. dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.37% (22.5627 => 21.1261, std. dev.: 0.0053) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.78% (0.3511 => 0.3308, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-2: -4.08% (0.3601 => 0.3454, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: -4.06% (0.3623 => 0.3476, std. dev.: 0.0022) SingleSource/UnitTests/ObjC/synchronized: -3.96% (0.3663 => 0.3518, std. dev.: 0.0029) SingleSource/UnitTests/ObjC/exceptions-4: -3.92% (0.3646 => 0.3503, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.92% (0.3650 => 0.3507, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/property: -3.83% (0.3940 => 0.3789, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -3.83% (0.3789 => 0.3644, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: -3.40% (0.3914 => 0.3781, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -3.30% (0.4003 => 0.3871, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.84% (0.8818 => 0.8568, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/bigfib: -2.43% (0.6250 => 0.6098, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: -1.98% (0.5748 => 0.5634, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.61% (0.6576 => 0.6470, std. dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -10.38% (1.2308 => 1.1030, std. dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.56% (0.3139 => 0.2933, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9473, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.95% (2.5089 => 2.4098, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.66% (1.9762 => 1.9039, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/lists: -2.46% (6.3560 => 6.1995, std. dev.: 0.0145) SingleSource/Benchmarks/Misc/richards_benchmark: -2.14% (1.1560 => 1.1313, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.01% (20.3410 => 19.9324, std. dev.: 0.0357) MultiSource/Applications/minisat/minisat: -1.99% (9.3358 => 9.1500, std. dev.: 0.0433) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.90% (6.6320 => 6.5063, std. dev.: 0.0022) MultiSource/Benchmarks/mafft/pairlocalalign: -1.89% (28.2225 => 27.6899, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/fp-convert: -1.67% (3.4016 => 3.3449, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9953, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.51% (3.9173 => 3.8583, std. dev.: 0.0046) MultiSource/Applications/lua/lua: -1.38% (26.5159 => 26.1498, std. dev.: 0.0230) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.11% (3.8887 => 3.8454, std. dev.: 0.0049) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.36s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue May 15 10:43:28 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 15 May 2012 12:43:28 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120515174328.66F022A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/662?compare_to=661&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 662, Order: 156824, Start Time: 2012-05-15 16:47:39, End Time: 2012-05-15 17:44:15 To: 661, Order: 156821, Start Time: 2012-05-15 15:24:00, End Time: 2012-05-15 16:20:42 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (62 on baseline) Performance Improvements: 0 (38 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 891 (788 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 1.13% (7.9728 => 8.0629, std. dev.: 0.0064) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.88% (2.0176 => 2.2775, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.35% (0.3130 => 0.3360, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.81% (0.2721 => 0.2852, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.57% (3.9660 => 4.1076, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.34% (0.5265 => 0.5441, std. dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 3.19% (1.0594 => 1.0932, std. dev.: 0.0019) MultiSource/Applications/SPASS/SPASS: 3.19% (13.8202 => 14.2605, std. dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.00% (0.6959 => 0.7168, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.99% (0.9199 => 0.9474, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 2.95% (0.8310 => 0.8555, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.74% (1.1364 => 1.1675, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.68% (1.2193 => 1.2520, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.54% (0.5637 => 0.5780, std. dev.: 0.0007) MultiSource/Applications/siod/siod: 2.46% (2.1791 => 2.2326, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.38% (1.4563 => 1.4909, std. dev.: 0.0007) MultiSource/Applications/kimwitu++/kc: 2.35% (16.6129 => 17.0026, std. dev.: 0.0240) MultiSource/Benchmarks/MallocBench/gs/gs: 2.25% (3.8646 => 3.9516, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.19% (13.2842 => 13.5749, std. dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.13% (1.3245 => 1.3527, std. dev.: 0.0038) MultiSource/Applications/treecc/treecc: 2.04% (1.9270 => 1.9663, std. dev.: 0.0116) MultiSource/Applications/Burg/burg: 2.03% (1.1061 => 1.1286, std. dev.: 0.0031) MultiSource/Applications/lambda-0_1_3/lambda: 2.03% (0.7038 => 0.7181, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.01% (0.7710 => 0.7865, std. dev.: 0.0027) MultiSource/Applications/sqlite3/sqlite3: 1.92% (16.2614 => 16.5743, std. dev.: 0.0028) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.80% (0.7460 => 0.7594, std. dev.: 0.0022) MultiSource/Applications/SIBsim4/SIBsim4: 1.76% (1.2749 => 1.2974, std. dev.: 0.0021) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.75% (1.3813 => 1.4055, std. dev.: 0.0023) MultiSource/Applications/hbd/hbd: 1.68% (1.3693 => 1.3923, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.66% (1.3819 => 1.4048, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.63% (3.6692 => 3.7289, std. dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.46% (3.2742 => 3.3221, std. dev.: 0.0164) MultiSource/Applications/JM/lencod/lencod: 1.34% (14.8535 => 15.0524, std. dev.: 0.0186) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.32% (2.1007 => 2.1285, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.24% (1.5188 => 1.5376, std. dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 1.17% (33.2944 => 33.6826, std. dev.: 0.0136) MultiSource/Applications/JM/ldecod/ldecod: 1.16% (6.5754 => 6.6516, std. dev.: 0.0080) MultiSource/Applications/d/make_dparser: 1.07% (3.1889 => 3.2229, std. dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.06% (1.1333 => 1.1453, std. dev.: 0.0033) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 23.99% (1.8175 => 2.2536, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/mandel-2: 7.03% (1.2998 => 1.3912, std. dev.: 0.0123) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.89% (1.5824 => 1.6756, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9877, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.70% (1.7688 => 1.8342, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: 3.50% (7.4271 => 7.6868, std. dev.: 0.0101) MultiSource/Benchmarks/nbench/nbench: 3.15% (11.2619 => 11.6165, std. dev.: 0.0061) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4549, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-6: 2.89% (1.9199 => 1.9753, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9393, std. dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.52% (8.8259 => 9.0485, std. dev.: 0.0208) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.45% (7.9275 => 8.1221, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0080) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5091, std. dev.: 0.0012) MultiSource/Applications/lemon/lemon: 1.40% (1.4298 => 1.4498, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.27% (2.0200 => 2.0457, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.26% (1.9433 => 1.9678, std. dev.: 0.0085) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: 1.15% (5.0168 => 5.0743, std. dev.: 0.0103) SingleSource/Benchmarks/Misc/flops: 1.14% (9.0760 => 9.1793, std. dev.: 0.0005) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -19.48% (0.4657 => 0.3750, std. dev.: 0.0280) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.37% (0.2670 => 0.2500, std. dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.96% (22.5627 => 21.2187, std. dev.: 0.0258) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.50% (0.3511 => 0.3318, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-3: -3.48% (0.3623 => 0.3497, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.42% (0.3650 => 0.3525, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -3.36% (0.3601 => 0.3480, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -3.32% (0.3646 => 0.3525, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -3.28% (0.3663 => 0.3543, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: -3.21% (0.3578 => 0.3463, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -3.15% (0.3940 => 0.3816, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -3.11% (0.3789 => 0.3671, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -2.91% (0.3914 => 0.3800, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -2.72% (0.4003 => 0.3894, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.43% (0.8818 => 0.8604, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: -2.03% (0.6250 => 0.6123, std. dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -9.58% (1.2308 => 1.1129, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.50% (0.3139 => 0.2935, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.09% (1.3780 => 1.3078, std. dev.: 0.0062) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9473, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -4.01% (2.5089 => 2.4083, std. dev.: 0.0013) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.68% (1.9762 => 1.9034, std. dev.: 0.0039) SingleSource/Benchmarks/Misc/richards_benchmark: -2.10% (1.1560 => 1.1317, std. dev.: 0.0013) MultiSource/Applications/minisat/minisat: -2.07% (9.3358 => 9.1429, std. dev.: 0.0111) SingleSource/Benchmarks/Shootout/lists: -2.05% (6.3560 => 6.2259, std. dev.: 0.0118) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6914, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.85% (6.6320 => 6.5091, std. dev.: 0.0050) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3446, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.63% (20.3410 => 20.0097, std. dev.: 0.0137) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9959, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.56% (0.9692 => 0.9541, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/heapsort: -1.52% (3.9173 => 3.8579, std. dev.: 0.0101) MultiSource/Applications/lua/lua: -1.43% (26.5159 => 26.1371, std. dev.: 0.0645) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.32s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue May 15 12:07:16 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 15 May 2012 14:07:16 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120515190716.4CF032A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/663?compare_to=662&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 663, Order: 156830, Start Time: 2012-05-15 18:11:25, End Time: 2012-05-15 19:08:03 To: 662, Order: 156824, Start Time: 2012-05-15 16:47:39, End Time: 2012-05-15 17:44:15 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (67 on baseline) Performance Improvements: 0 (31 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (790 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.66% (2.0176 => 2.2932, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.35% (0.3130 => 0.3360, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.45% (0.2721 => 0.2842, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.82% (3.9660 => 4.1176, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.46% (0.6959 => 0.7200, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.32% (0.5265 => 0.5440, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.29% (0.9199 => 0.9502, std. dev.: 0.0015) MultiSource/Applications/SPASS/SPASS: 3.29% (13.8202 => 14.2748, std. dev.: 0.0160) MultiSource/Benchmarks/nbench/nbench: 3.28% (1.0594 => 1.0942, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/football/football: 3.16% (0.8310 => 0.8573, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.03% (1.1364 => 1.1708, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.94% (0.5637 => 0.5803, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.90% (1.2193 => 1.2546, std. dev.: 0.0028) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.84% (0.7710 => 0.7929, std. dev.: 0.0040) MultiSource/Applications/siod/siod: 2.74% (2.1791 => 2.2387, std. dev.: 0.0047) MultiSource/Applications/kimwitu++/kc: 2.67% (16.6129 => 17.0561, std. dev.: 0.0069) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.65% (1.4563 => 1.4949, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/gs/gs: 2.63% (3.8646 => 3.9664, std. dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.56% (0.5577 => 0.5720, std. dev.: 0.0036) MultiSource/Applications/lambda-0_1_3/lambda: 2.46% (0.7038 => 0.7211, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 2.36% (1.9270 => 1.9724, std. dev.: 0.0046) MultiSource/Applications/Burg/burg: 2.31% (1.1061 => 1.1317, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.27% (1.3245 => 1.3546, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.25% (13.2842 => 13.5826, std. dev.: 0.0055) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.13% (0.7460 => 0.7619, std. dev.: 0.0015) MultiSource/Applications/sqlite3/sqlite3: 1.96% (16.2614 => 16.5809, std. dev.: 0.0081) MultiSource/Applications/hbd/hbd: 1.94% (1.3693 => 1.3958, std. dev.: 0.0088) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.80% (1.3813 => 1.4062, std. dev.: 0.0014) MultiSource/Applications/SIBsim4/SIBsim4: 1.79% (1.2749 => 1.2977, std. dev.: 0.0054) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.79% (3.6692 => 3.7348, std. dev.: 0.0062) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.74% (1.3819 => 1.4059, std. dev.: 0.0025) MultiSource/Applications/JM/lencod/lencod: 1.59% (14.8535 => 15.0890, std. dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.53% (3.2742 => 3.3242, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.51% (2.1007 => 2.1324, std. dev.: 0.0013) MultiSource/Applications/spiff/spiff: 1.51% (0.7506 => 0.7619, std. dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.38% (1.1333 => 1.1489, std. dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: 1.36% (6.5754 => 6.6650, std. dev.: 0.0048) MultiSource/Benchmarks/Bullet/bullet: 1.33% (33.2944 => 33.7380, std. dev.: 0.0076) MultiSource/Applications/d/make_dparser: 1.23% (3.1889 => 3.2280, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.20% (1.5188 => 1.5371, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.06% (4.3801 => 4.4264, std. dev.: 0.0119) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.01% (7.2180 => 7.2910, std. dev.: 0.0034) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.12% (1.8175 => 2.2558, std. dev.: 0.0121) SingleSource/Benchmarks/Misc/mandel-2: 8.25% (1.2998 => 1.4070, std. dev.: 0.0093) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.89% (1.5824 => 1.6756, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8143, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.87% (1.9144 => 1.9884, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.62% (1.7688 => 1.8328, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/salsa20: 3.52% (7.4271 => 7.6882, std. dev.: 0.0055) MultiSource/Benchmarks/nbench/nbench: 3.12% (11.2619 => 11.6137, std. dev.: 0.0042) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4538, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/flops-6: 2.87% (1.9199 => 1.9750, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.74% (2.8606 => 2.9389, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.73% (8.8259 => 9.0672, std. dev.: 0.0126) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.47% (7.9275 => 8.1236, std. dev.: 0.0093) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.58% (0.8273 => 0.8404, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.48% (1.4298 => 1.4509, std. dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5103, std. dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.28% (2.0200 => 2.0458, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.22% (1.9433 => 1.9671, std. dev.: 0.0005) MultiSource/Benchmarks/sim/sim: 1.20% (5.0168 => 5.0769, std. dev.: 0.0105) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.13% (9.0760 => 9.1787, std. dev.: 0.0006) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -20.87% (0.4657 => 0.3685, std. dev.: 0.0193) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.19% (0.2670 => 0.2478, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.24% (0.3511 => 0.3292, std. dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.03% (22.5627 => 21.2027, std. dev.: 0.0201) SingleSource/UnitTests/ObjC/exceptions-3: -2.87% (0.3623 => 0.3519, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.81% (0.8818 => 0.8570, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -2.54% (0.3940 => 0.3840, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.24% (0.6576 => 0.6429, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: -1.94% (0.6250 => 0.6129, std. dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -10.64% (1.2308 => 1.0999, std. dev.: 0.0057) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.56% (0.3139 => 0.2933, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9475, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.75% (1.3780 => 1.3126, std. dev.: 0.0066) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -4.06% (2.5089 => 2.4070, std. dev.: 0.0019) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.73% (0.3458 => 0.3329, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: -3.63% (1.9762 => 1.9045, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: -2.13% (1.1560 => 1.1314, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -2.06% (6.3560 => 6.2251, std. dev.: 0.0099) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.94% (20.3410 => 19.9454, std. dev.: 0.0366) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6922, std. dev.: 0.0020) MultiSource/Applications/minisat/minisat: -1.83% (9.3358 => 9.1653, std. dev.: 0.0094) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.82% (6.6320 => 6.5110, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3446, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9956, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.56% (0.9692 => 0.9541, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.38% (3.9173 => 3.8634, std. dev.: 0.0012) MultiSource/Applications/lua/lua: -1.33% (26.5159 => 26.1625, std. dev.: 0.0237) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.60s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue May 15 13:30:52 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 15 May 2012 15:30:52 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120515203052.DE9CF2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/664?compare_to=663&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 664, Order: 156841, Start Time: 2012-05-15 19:34:59, End Time: 2012-05-15 20:31:40 To: 663, Order: 156830, Start Time: 2012-05-15 18:11:25, End Time: 2012-05-15 19:08:03 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (60 on baseline) Performance Improvements: 0 (29 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (799 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.08% (2.0176 => 2.2815, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.22% (0.3130 => 0.3356, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.48% (0.2721 => 0.2843, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.56% (3.9660 => 4.1071, std. dev.: 0.0024) MultiSource/Benchmarks/nbench/nbench: 3.39% (1.0594 => 1.0953, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.32% (0.5265 => 0.5440, std. dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 3.12% (13.8202 => 14.2513, std. dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.05% (0.6959 => 0.7171, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.04% (0.9199 => 0.9479, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/football/football: 2.96% (0.8310 => 0.8556, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.84% (0.7710 => 0.7929, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.78% (1.1364 => 1.1680, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.76% (1.2193 => 1.2529, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.66% (0.5637 => 0.5787, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 2.40% (3.8646 => 3.9573, std. dev.: 0.0113) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.37% (0.5577 => 0.5709, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.36% (1.4563 => 1.4906, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.26% (1.3245 => 1.3544, std. dev.: 0.0106) MultiSource/Applications/siod/siod: 2.24% (2.1791 => 2.2280, std. dev.: 0.0061) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.20% (13.2842 => 13.5763, std. dev.: 0.0054) MultiSource/Applications/kimwitu++/kc: 2.16% (16.6129 => 16.9715, std. dev.: 0.0082) MultiSource/Applications/Burg/burg: 2.13% (1.1061 => 1.1297, std. dev.: 0.0056) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.01% (1.3813 => 1.4090, std. dev.: 0.0009) MultiSource/Applications/treecc/treecc: 1.99% (1.9270 => 1.9653, std. dev.: 0.0052) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.98% (0.7460 => 0.7608, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.85% (1.3819 => 1.4074, std. dev.: 0.0028) MultiSource/Applications/SIBsim4/SIBsim4: 1.80% (1.2749 => 1.2979, std. dev.: 0.0077) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.59% (3.6692 => 3.7277, std. dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.47% (3.2742 => 3.3222, std. dev.: 0.0010) MultiSource/Applications/JM/lencod/lencod: 1.45% (14.8535 => 15.0694, std. dev.: 0.0040) MultiSource/Applications/spiff/spiff: 1.37% (0.7506 => 0.7609, std. dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.30% (2.1007 => 2.1280, std. dev.: 0.0015) MultiSource/Applications/JM/ldecod/ldecod: 1.23% (6.5754 => 6.6565, std. dev.: 0.0104) MultiSource/Benchmarks/Bullet/bullet: 1.12% (33.2944 => 33.6682, std. dev.: 0.0120) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.12% (7.2180 => 7.2986, std. dev.: 0.0091) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.10% (1.1333 => 1.1458, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.00% (1.5188 => 1.5340, std. dev.: 0.0007) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 23.96% (1.8175 => 2.2530, std. dev.: 0.0050) SingleSource/Benchmarks/Misc/mandel-2: 7.50% (1.2998 => 1.3973, std. dev.: 0.0119) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.86% (1.5824 => 1.6751, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8146, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9879, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.64% (1.7688 => 1.8331, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/salsa20: 3.61% (7.4271 => 7.6954, std. dev.: 0.0038) MultiSource/Benchmarks/nbench/nbench: 3.18% (11.2619 => 11.6197, std. dev.: 0.0039) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4534, std. dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.90% (8.8259 => 9.0816, std. dev.: 0.0237) SingleSource/Benchmarks/Misc/flops-6: 2.88% (1.9199 => 1.9751, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9394, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.57% (7.9275 => 8.1313, std. dev.: 0.0076) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.54% (0.8273 => 0.8400, std. dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5099, std. dev.: 0.0088) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.30% (2.0200 => 2.0462, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: 1.17% (5.0168 => 5.0756, std. dev.: 0.0071) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1775, std. dev.: 0.0013) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -18.87% (0.4657 => 0.3778, std. dev.: 0.0213) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.69% (0.3511 => 0.3276, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.63% (0.2670 => 0.2493, std. dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.03% (22.5627 => 21.2030, std. dev.: 0.0098) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.78% (0.8818 => 0.8573, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: -1.82% (0.6250 => 0.6136, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.78% (0.6576 => 0.6459, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -9.74% (1.2308 => 1.1109, std. dev.: 0.0170) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.16% (1.0460 => 0.9502, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.53% (0.3139 => 0.2934, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2650, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.95% (1.3780 => 1.3098, std. dev.: 0.0053) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9475, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -4.01% (2.5089 => 2.4082, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.73% (0.3458 => 0.3329, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -3.70% (1.9762 => 1.9031, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: -2.16% (1.1560 => 1.1310, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -2.15% (6.3560 => 6.2191, std. dev.: 0.0077) MultiSource/Applications/minisat/minisat: -2.12% (9.3358 => 9.1376, std. dev.: 0.0439) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.90% (20.3410 => 19.9546, std. dev.: 0.0142) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6916, std. dev.: 0.0014) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.88% (6.6320 => 6.5074, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9958, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) MultiSource/Applications/lua/lua: -1.39% (26.5159 => 26.1463, std. dev.: 0.0456) SingleSource/Benchmarks/Shootout/heapsort: -1.35% (3.9173 => 3.8644, std. dev.: 0.0026) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.20s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue May 15 14:54:28 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 15 May 2012 16:54:28 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120515215428.B3FD22A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/665?compare_to=664&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 665, Order: 156850, Start Time: 2012-05-15 20:58:44, End Time: 2012-05-15 21:55:16 To: 664, Order: 156841, Start Time: 2012-05-15 19:34:59, End Time: 2012-05-15 20:31:40 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (64 on baseline) Performance Improvements: 0 (29 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (795 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.85% (2.0176 => 2.2971, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.35% (0.3130 => 0.3360, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.15% (0.2721 => 0.2834, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.58% (3.9660 => 4.1079, std. dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.21% (0.5265 => 0.5434, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 3.21% (1.0594 => 1.0934, std. dev.: 0.0046) MultiSource/Applications/SPASS/SPASS: 3.03% (13.8202 => 14.2392, std. dev.: 0.0216) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.95% (0.6959 => 0.7164, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 2.93% (0.4328 => 0.4455, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.92% (0.9199 => 0.9468, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 2.79% (0.8310 => 0.8542, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.79% (0.5637 => 0.5794, std. dev.: 0.0028) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.62% (1.1364 => 1.1662, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.58% (1.2193 => 1.2508, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.58% (1.4563 => 1.4939, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.46% (0.5577 => 0.5714, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.27% (13.2842 => 13.5856, std. dev.: 0.0061) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.13% (0.7710 => 0.7874, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.12% (1.3245 => 1.3526, std. dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: 2.12% (16.6129 => 16.9653, std. dev.: 0.0147) MultiSource/Applications/hbd/hbd: 2.07% (1.3693 => 1.3976, std. dev.: 0.0016) MultiSource/Benchmarks/MallocBench/gs/gs: 2.04% (3.8646 => 3.9435, std. dev.: 0.0009) MultiSource/Applications/siod/siod: 2.01% (2.1791 => 2.2230, std. dev.: 0.0074) MultiSource/Applications/treecc/treecc: 1.97% (1.9270 => 1.9650, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 1.92% (1.1061 => 1.1273, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.86% (0.7460 => 0.7599, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 1.81% (16.2614 => 16.5561, std. dev.: 0.0076) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.77% (1.3813 => 1.4057, std. dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: 1.73% (0.7038 => 0.7160, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.72% (1.3819 => 1.4057, std. dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.67% (0.6283 => 0.6388, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.64% (3.6692 => 3.7293, std. dev.: 0.0009) MultiSource/Applications/minisat/minisat: 1.60% (0.6744 => 0.6852, std. dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 1.40% (14.8535 => 15.0617, std. dev.: 0.0108) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.33% (2.1007 => 2.1287, std. dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: 1.25% (33.2944 => 33.7107, std. dev.: 0.0081) MultiSource/Applications/d/make_dparser: 1.19% (3.1889 => 3.2267, std. dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: 1.16% (6.5754 => 6.6514, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.02% (3.2742 => 3.3076, std. dev.: 0.0030) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.58% (1.8175 => 2.2643, std. dev.: 0.0338) SingleSource/Benchmarks/Misc/mandel-2: 6.96% (1.2998 => 1.3903, std. dev.: 0.0149) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6755, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9875, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.73% (1.7688 => 1.8348, std. dev.: 0.0052) SingleSource/Benchmarks/Misc/salsa20: 3.57% (7.4271 => 7.6920, std. dev.: 0.0049) MultiSource/Benchmarks/nbench/nbench: 3.17% (11.2619 => 11.6192, std. dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4537, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-6: 2.89% (1.9199 => 1.9753, std. dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9393, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.73% (8.8259 => 9.0670, std. dev.: 0.0150) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.45% (7.9275 => 8.1217, std. dev.: 0.0103) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.62% (0.8273 => 0.8407, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.44% (8.3908 => 8.5117, std. dev.: 0.0004) MultiSource/Applications/lemon/lemon: 1.36% (1.4298 => 1.4492, std. dev.: 0.0023) MultiSource/Benchmarks/Olden/bisort/bisort: 1.31% (0.8239 => 0.8347, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.26% (2.0200 => 2.0455, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.22% (1.9433 => 1.9671, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.11% (9.0760 => 9.1770, std. dev.: 0.0018) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -19.63% (0.4657 => 0.3743, std. dev.: 0.0146) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.49% (0.2670 => 0.2470, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.55% (0.3511 => 0.3281, std. dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.74% (22.5627 => 21.2673, std. dev.: 0.0101) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.50% (0.8818 => 0.8509, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.95% (0.6576 => 0.6448, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.20% (0.9108 => 0.8999, std. dev.: 0.0005) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -10.68% (1.2308 => 1.0994, std. dev.: 0.0068) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.50% (0.3139 => 0.2935, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9473, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.93% (2.5089 => 2.4103, std. dev.: 0.0029) MultiSource/Benchmarks/Olden/bh/bh: -3.64% (1.9762 => 1.9043, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.61% (0.3458 => 0.3333, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: -2.15% (1.1560 => 1.1311, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -2.11% (6.3560 => 6.2221, std. dev.: 0.0081) MultiSource/Applications/minisat/minisat: -1.97% (9.3358 => 9.1517, std. dev.: 0.0170) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6909, std. dev.: 0.0018) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.86% (6.6320 => 6.5084, std. dev.: 0.0052) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.82% (20.3410 => 19.9708, std. dev.: 0.0365) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9959, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.43% (3.9173 => 3.8614, std. dev.: 0.0024) MultiSource/Applications/lua/lua: -1.35% (26.5159 => 26.1589, std. dev.: 0.0141) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.06% (3.8887 => 3.8473, std. dev.: 0.0107) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.21s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue May 15 16:17:57 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 15 May 2012 18:17:57 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120515231757.BDEE32A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/666?compare_to=665&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 666, Order: 156860, Start Time: 2012-05-15 22:22:16, End Time: 2012-05-15 23:18:45 To: 665, Order: 156850, Start Time: 2012-05-15 20:58:44, End Time: 2012-05-15 21:55:16 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (59 on baseline) Performance Improvements: 1 (38 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 890 (791 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 1.70% (1.3903 => 1.4139, std. dev.: 0.0025) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -3.92% (3.9057 => 3.7525, std. dev.: 0.0230) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.48% (2.0176 => 2.2895, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.03% (0.3130 => 0.3350, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.26% (0.2721 => 0.2837, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.39% (3.9660 => 4.1005, std. dev.: 0.0093) MultiSource/Benchmarks/nbench/nbench: 3.08% (1.0594 => 1.0920, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.04% (0.5265 => 0.5425, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.82% (0.9199 => 0.9458, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/football/football: 2.80% (0.8310 => 0.8543, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 2.78% (13.8202 => 14.2040, std. dev.: 0.0092) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.76% (0.6959 => 0.7151, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.71% (0.5637 => 0.5790, std. dev.: 0.0020) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.51% (1.1364 => 1.1649, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.50% (1.4563 => 1.4927, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.45% (1.2193 => 1.2492, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.22% (0.7710 => 0.7881, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.19% (0.5577 => 0.5699, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.05% (13.2842 => 13.5568, std. dev.: 0.0106) MultiSource/Applications/kimwitu++/kc: 1.95% (16.6129 => 16.9366, std. dev.: 0.0093) MultiSource/Applications/siod/siod: 1.91% (2.1791 => 2.2208, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/gs/gs: 1.87% (3.8646 => 3.9369, std. dev.: 0.0131) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.86% (1.3245 => 1.3491, std. dev.: 0.0018) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.84% (0.7460 => 0.7597, std. dev.: 0.0005) MultiSource/Applications/treecc/treecc: 1.76% (1.9270 => 1.9609, std. dev.: 0.0007) MultiSource/Applications/Burg/burg: 1.75% (1.1061 => 1.1255, std. dev.: 0.0058) MultiSource/Applications/lambda-0_1_3/lambda: 1.68% (0.7038 => 0.7156, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.67% (1.3813 => 1.4044, std. dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 1.67% (16.2614 => 16.5322, std. dev.: 0.0236) MultiSource/Applications/hbd/hbd: 1.65% (1.3693 => 1.3919, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.49% (1.3819 => 1.4025, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.47% (3.6692 => 3.7230, std. dev.: 0.0085) MultiSource/Applications/SIBsim4/SIBsim4: 1.34% (1.2749 => 1.2920, std. dev.: 0.0040) MultiSource/Applications/JM/lencod/lencod: 1.24% (14.8535 => 15.0370, std. dev.: 0.0080) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.11% (3.2742 => 3.3105, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.07% (2.1007 => 2.1232, std. dev.: 0.0012) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 23.97% (1.8175 => 2.2532, std. dev.: 0.0120) SingleSource/Benchmarks/Misc/mandel-2: 8.78% (1.2998 => 1.4139, std. dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.52% (2.5629 => 2.7299, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6755, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8146, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-5: 3.86% (1.9144 => 1.9883, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: 3.71% (7.4271 => 7.7026, std. dev.: 0.0051) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.71% (1.7688 => 1.8344, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 3.17% (11.2619 => 11.6188, std. dev.: 0.0021) MultiSource/Applications/hexxagon/hexxagon: 3.01% (12.0921 => 12.4555, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.91% (8.8259 => 9.0828, std. dev.: 0.0113) SingleSource/Benchmarks/Misc/flops-6: 2.86% (1.9199 => 1.9749, std. dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9393, std. dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.32% (7.9275 => 8.1115, std. dev.: 0.0130) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.55% (0.8273 => 0.8401, std. dev.: 0.0015) MultiSource/Applications/lemon/lemon: 1.54% (1.4298 => 1.4518, std. dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5096, std. dev.: 0.0011) MultiSource/Benchmarks/sim/sim: 1.27% (5.0168 => 5.0803, std. dev.: 0.0094) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.26% (2.0200 => 2.0455, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0034) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.15% (1.9433 => 1.9657, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 1.10% (9.0760 => 9.1761, std. dev.: 0.0016) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -21.07% (0.4657 => 0.3676, std. dev.: 0.0057) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.49% (0.2670 => 0.2470, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.72% (0.3511 => 0.3275, std. dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.13% (22.5627 => 21.1801, std. dev.: 0.0047) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.36% (0.8818 => 0.8522, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-2: -3.03% (0.3601 => 0.3492, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -2.99% (0.3940 => 0.3822, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -2.96% (0.3646 => 0.3538, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -2.95% (0.3663 => 0.3555, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -2.90% (0.3650 => 0.3544, std. dev.: 0.0027) SingleSource/UnitTests/ObjC/for-in: -2.82% (0.3789 => 0.3682, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -2.79% (0.3578 => 0.3478, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -2.65% (0.4003 => 0.3897, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: -2.55% (0.3914 => 0.3814, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.55% (0.6576 => 0.6408, std. dev.: 0.0011) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -10.82% (1.2308 => 1.0976, std. dev.: 0.0082) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.16% (1.0460 => 0.9502, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.56% (0.3139 => 0.2933, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-3: -6.21% (2.4152 => 2.2652, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.99% (1.3780 => 1.3093, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9472, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -3.95% (2.5089 => 2.4097, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.73% (0.3458 => 0.3329, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -3.67% (1.9762 => 1.9036, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: -2.15% (1.1560 => 1.1312, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -2.07% (6.3560 => 6.2244, std. dev.: 0.0046) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.98% (6.6320 => 6.5009, std. dev.: 0.0039) MultiSource/Applications/minisat/minisat: -1.95% (9.3358 => 9.1533, std. dev.: 0.0305) MultiSource/Benchmarks/mafft/pairlocalalign: -1.89% (28.2225 => 27.6905, std. dev.: 0.0025) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.79% (20.3410 => 19.9764, std. dev.: 0.0326) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3446, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9956, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.41% (3.9173 => 3.8619, std. dev.: 0.0038) MultiSource/Applications/lua/lua: -1.29% (26.5159 => 26.1734, std. dev.: 0.0318) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.00% (3.8887 => 3.8497, std. dev.: 0.0015) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.31s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue May 15 17:41:32 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 15 May 2012 19:41:32 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120516004132.8D8F22A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/667?compare_to=666&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 667, Order: 156875, Start Time: 2012-05-15 23:45:44, End Time: 2012-05-16 00:42:20 To: 666, Order: 156860, Start Time: 2012-05-15 22:22:16, End Time: 2012-05-15 23:18:45 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (59 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (789 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.11% (2.0176 => 2.3022, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.16% (0.3130 => 0.3354, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.15% (0.2721 => 0.2834, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.53% (3.9660 => 4.1060, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.04% (0.5265 => 0.5425, std. dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 3.03% (1.0594 => 1.0915, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.96% (0.6959 => 0.7165, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.96% (0.9199 => 0.9471, std. dev.: 0.0090) MultiSource/Applications/SPASS/SPASS: 2.90% (13.8202 => 14.2207, std. dev.: 0.0134) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.80% (0.5637 => 0.5795, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.69% (1.1364 => 1.1670, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: 2.65% (0.8310 => 0.8530, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.57% (1.2193 => 1.2506, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.32% (0.7710 => 0.7889, std. dev.: 0.0028) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.32% (1.4563 => 1.4901, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.22% (13.2842 => 13.5795, std. dev.: 0.0106) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.19% (0.5577 => 0.5699, std. dev.: 0.0013) MultiSource/Applications/siod/siod: 2.05% (2.1791 => 2.2238, std. dev.: 0.0067) MultiSource/Benchmarks/MallocBench/gs/gs: 1.93% (3.8646 => 3.9393, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.93% (1.3245 => 1.3501, std. dev.: 0.0086) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.93% (0.7460 => 0.7604, std. dev.: 0.0035) MultiSource/Applications/kimwitu++/kc: 1.91% (16.6129 => 16.9303, std. dev.: 0.0075) MultiSource/Applications/Burg/burg: 1.90% (1.1061 => 1.1271, std. dev.: 0.0058) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.85% (1.3813 => 1.4069, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.78% (1.3819 => 1.4065, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 1.76% (1.9270 => 1.9610, std. dev.: 0.0039) MultiSource/Applications/sqlite3/sqlite3: 1.75% (16.2614 => 16.5456, std. dev.: 0.0419) MultiSource/Applications/lambda-0_1_3/lambda: 1.75% (0.7038 => 0.7161, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 1.75% (1.3693 => 1.3932, std. dev.: 0.0022) MultiSource/Applications/SIBsim4/SIBsim4: 1.53% (1.2749 => 1.2944, std. dev.: 0.0069) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.44% (3.6692 => 3.7220, std. dev.: 0.0012) MultiSource/Applications/JM/lencod/lencod: 1.29% (14.8535 => 15.0457, std. dev.: 0.0094) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.13% (2.1007 => 2.1244, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.06% (3.2742 => 3.3089, std. dev.: 0.0059) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.08% (1.8175 => 2.2551, std. dev.: 0.0254) SingleSource/Benchmarks/Misc/mandel-2: 6.92% (1.2998 => 1.3898, std. dev.: 0.0163) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7298, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.87% (1.5824 => 1.6753, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8146, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.78% (1.9144 => 1.9867, std. dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.66% (1.7688 => 1.8335, std. dev.: 0.0063) SingleSource/Benchmarks/Misc/salsa20: 3.60% (7.4271 => 7.6943, std. dev.: 0.0075) MultiSource/Benchmarks/nbench/nbench: 3.18% (11.2619 => 11.6198, std. dev.: 0.0043) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 3.04% (8.8259 => 9.0945, std. dev.: 0.0171) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4551, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: 2.89% (1.9199 => 1.9754, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9392, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.56% (7.9275 => 8.1302, std. dev.: 0.0044) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.56% (0.8273 => 0.8402, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: 1.44% (1.4298 => 1.4504, std. dev.: 0.0012) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5089, std. dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.29% (2.0200 => 2.0461, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.22% (1.9433 => 1.9670, std. dev.: 0.0061) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1774, std. dev.: 0.0019) MultiSource/Benchmarks/sim/sim: 1.02% (5.0168 => 5.0681, std. dev.: 0.0134) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -18.02% (0.4657 => 0.3818, std. dev.: 0.0307) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.19% (0.2670 => 0.2478, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.49% (0.3511 => 0.3283, std. dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.19% (22.5627 => 21.1671, std. dev.: 0.0183) SingleSource/UnitTests/ObjC/exceptions-3: -3.70% (0.3623 => 0.3489, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.67% (0.3650 => 0.3516, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/synchronized: -3.58% (0.3663 => 0.3532, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -3.55% (0.3601 => 0.3473, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.50% (0.8818 => 0.8509, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/trivial-interface: -3.49% (0.3578 => 0.3453, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -3.48% (0.3646 => 0.3519, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -3.35% (0.3940 => 0.3808, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -3.22% (0.3789 => 0.3667, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: -3.15% (0.4003 => 0.3877, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -3.14% (0.3914 => 0.3791, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.51% (0.6576 => 0.6411, std. dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/bigfib: -2.08% (0.6250 => 0.6120, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.32% (0.9108 => 0.8988, std. dev.: 0.0006) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -10.14% (1.2308 => 1.1060, std. dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.53% (0.3139 => 0.2934, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.98% (1.3780 => 1.3094, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9475, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -4.08% (2.5089 => 2.4066, std. dev.: 0.0016) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.63% (1.9762 => 1.9045, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout/lists: -2.14% (6.3560 => 6.2199, std. dev.: 0.0053) SingleSource/Benchmarks/Misc/richards_benchmark: -2.10% (1.1560 => 1.1317, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.96% (20.3410 => 19.9416, std. dev.: 0.0384) MultiSource/Applications/minisat/minisat: -1.89% (9.3358 => 9.1597, std. dev.: 0.0128) MultiSource/Benchmarks/mafft/pairlocalalign: -1.89% (28.2225 => 27.6905, std. dev.: 0.0033) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.86% (6.6320 => 6.5085, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9955, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.46% (3.9173 => 3.8600, std. dev.: 0.0194) MultiSource/Applications/lua/lua: -1.31% (26.5159 => 26.1682, std. dev.: 0.0200) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.17s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue May 15 19:05:05 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 15 May 2012 21:05:05 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120516020505.3764E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/668?compare_to=667&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 668, Order: 156881, Start Time: 2012-05-16 01:09:20, End Time: 2012-05-16 02:05:52 To: 667, Order: 156875, Start Time: 2012-05-15 23:45:44, End Time: 2012-05-16 00:42:20 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (60 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (788 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.07% (2.0176 => 2.3014, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.28% (0.3130 => 0.3358, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.30% (0.2721 => 0.2838, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.76% (3.9660 => 4.1153, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.13% (0.5265 => 0.5430, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 3.08% (1.0594 => 1.0920, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.97% (0.9199 => 0.9472, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.90% (0.6959 => 0.7161, std. dev.: 0.0028) MultiSource/Applications/SPASS/SPASS: 2.86% (13.8202 => 14.2153, std. dev.: 0.0196) MultiSource/Benchmarks/Prolangs-C/football/football: 2.84% (0.8310 => 0.8546, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.84% (0.5637 => 0.5797, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.67% (0.7710 => 0.7916, std. dev.: 0.0039) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.63% (1.1364 => 1.1663, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.58% (1.2193 => 1.2507, std. dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/hash2: 2.52% (0.4328 => 0.4437, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.36% (13.2842 => 13.5982, std. dev.: 0.0117) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.36% (1.4563 => 1.4907, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.17% (0.5577 => 0.5698, std. dev.: 0.0013) MultiSource/Applications/kimwitu++/kc: 2.16% (16.6129 => 16.9721, std. dev.: 0.0143) MultiSource/Applications/siod/siod: 2.13% (2.1791 => 2.2255, std. dev.: 0.0090) MultiSource/Applications/Burg/burg: 2.09% (1.1061 => 1.1292, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.08% (1.3245 => 1.3520, std. dev.: 0.0041) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.01% (0.7460 => 0.7610, std. dev.: 0.0036) MultiSource/Benchmarks/MallocBench/gs/gs: 1.98% (3.8646 => 3.9410, std. dev.: 0.0039) MultiSource/Applications/treecc/treecc: 1.92% (1.9270 => 1.9640, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.90% (3.6692 => 3.7390, std. dev.: 0.0059) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.88% (1.3813 => 1.4073, std. dev.: 0.0013) MultiSource/Applications/lambda-0_1_3/lambda: 1.88% (0.7038 => 0.7170, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 1.87% (1.3693 => 1.3949, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.86% (1.3819 => 1.4076, std. dev.: 0.0022) MultiSource/Applications/sqlite3/sqlite3: 1.67% (16.2614 => 16.5324, std. dev.: 0.0113) MultiSource/Applications/SIBsim4/SIBsim4: 1.35% (1.2749 => 1.2921, std. dev.: 0.0008) MultiSource/Applications/JM/lencod/lencod: 1.31% (14.8535 => 15.0488, std. dev.: 0.0050) MultiSource/Applications/JM/ldecod/ldecod: 1.13% (6.5754 => 6.6496, std. dev.: 0.0084) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.02% (2.1007 => 2.1222, std. dev.: 0.0016) MultiSource/Benchmarks/Bullet/bullet: 1.01% (33.2944 => 33.6322, std. dev.: 0.0120) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.19% (1.8175 => 2.2572, std. dev.: 0.0562) SingleSource/Benchmarks/Misc/mandel-2: 6.82% (1.2998 => 1.3885, std. dev.: 0.0103) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.91% (1.5824 => 1.6759, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.87% (1.9144 => 1.9885, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.67% (1.7688 => 1.8337, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: 3.59% (7.4271 => 7.6936, std. dev.: 0.0014) MultiSource/Benchmarks/nbench/nbench: 3.11% (11.2619 => 11.6125, std. dev.: 0.0014) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4544, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-6: 2.91% (1.9199 => 1.9757, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.80% (8.8259 => 9.0726, std. dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.76% (2.8606 => 2.9395, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.26% (7.9275 => 8.1065, std. dev.: 0.0172) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9603, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.60% (0.8273 => 0.8405, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.43% (1.4298 => 1.4502, std. dev.: 0.0007) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5099, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.31% (2.0200 => 2.0464, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0021) MultiSource/Benchmarks/sim/sim: 1.16% (5.0168 => 5.0752, std. dev.: 0.0108) SingleSource/Benchmarks/Misc/flops: 1.11% (9.0760 => 9.1766, std. dev.: 0.0012) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -18.40% (0.4657 => 0.3800, std. dev.: 0.0046) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.19% (0.2670 => 0.2478, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.44% (0.3511 => 0.3285, std. dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.98% (22.5627 => 21.2124, std. dev.: 0.0101) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.70% (0.3650 => 0.3515, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -3.70% (0.3623 => 0.3489, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -3.64% (0.3601 => 0.3470, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -3.63% (0.3940 => 0.3797, std. dev.: 0.0044) SingleSource/UnitTests/ObjC/exceptions-4: -3.59% (0.3646 => 0.3515, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -3.55% (0.3578 => 0.3451, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -3.55% (0.3663 => 0.3533, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -3.46% (0.3789 => 0.3658, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.36% (0.8818 => 0.8522, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/parameter-passing: -3.20% (0.4003 => 0.3875, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -3.12% (0.3914 => 0.3792, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.28% (0.6576 => 0.6426, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/bigfib: -1.82% (0.6250 => 0.6136, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -9.94% (1.2308 => 1.1084, std. dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.16% (1.0460 => 0.9502, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.56% (0.3139 => 0.2933, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.09% (1.3780 => 1.3079, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9473, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -3.99% (2.5089 => 2.4089, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.76% (0.3458 => 0.3328, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: -3.61% (1.9762 => 1.9048, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/richards_benchmark: -2.16% (1.1560 => 1.1310, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -2.15% (6.3560 => 6.2196, std. dev.: 0.0070) MultiSource/Applications/minisat/minisat: -2.02% (9.3358 => 9.1471, std. dev.: 0.0190) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.93% (6.6320 => 6.5040, std. dev.: 0.0036) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6921, std. dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.86% (20.3410 => 19.9620, std. dev.: 0.0370) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9951, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.52% (3.9173 => 3.8579, std. dev.: 0.0042) MultiSource/Applications/lua/lua: -1.35% (26.5159 => 26.1587, std. dev.: 0.0159) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.13% (3.8887 => 3.8448, std. dev.: 0.0095) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.64s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue May 15 20:28:35 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 15 May 2012 22:28:35 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120516032835.65D032A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/669?compare_to=668&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 669, Order: 156896, Start Time: 2012-05-16 02:32:52, End Time: 2012-05-16 03:29:23 To: 668, Order: 156881, Start Time: 2012-05-16 01:09:20, End Time: 2012-05-16 02:05:52 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (62 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (786 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.09% (2.0176 => 2.3018, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.28% (0.3130 => 0.3358, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.34% (0.2721 => 0.2839, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.61% (3.9660 => 4.1093, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.29% (0.5265 => 0.5438, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.25% (0.6959 => 0.7185, std. dev.: 0.0068) MultiSource/Benchmarks/nbench/nbench: 3.16% (1.0594 => 1.0929, std. dev.: 0.0054) MultiSource/Applications/SPASS/SPASS: 2.94% (13.8202 => 14.2271, std. dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.91% (0.5637 => 0.5801, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.89% (0.9199 => 0.9465, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: 2.86% (0.8310 => 0.8548, std. dev.: 0.0043) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.74% (1.1364 => 1.1675, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 2.73% (0.4328 => 0.4446, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.66% (1.2193 => 1.2517, std. dev.: 0.0055) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.40% (1.4563 => 1.4913, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.38% (13.2842 => 13.6001, std. dev.: 0.0051) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.28% (0.7710 => 0.7886, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.22% (0.5577 => 0.5701, std. dev.: 0.0011) MultiSource/Applications/kimwitu++/kc: 2.21% (16.6129 => 16.9799, std. dev.: 0.0069) MultiSource/Applications/siod/siod: 2.19% (2.1791 => 2.2269, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.10% (1.3245 => 1.3523, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 2.09% (3.8646 => 3.9455, std. dev.: 0.0056) MultiSource/Applications/treecc/treecc: 2.02% (1.9270 => 1.9659, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 1.99% (1.1061 => 1.1281, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.97% (0.7460 => 0.7607, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.95% (1.3819 => 1.4089, std. dev.: 0.0008) MultiSource/Applications/lambda-0_1_3/lambda: 1.89% (0.7038 => 0.7171, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 1.87% (1.3693 => 1.3949, std. dev.: 0.0028) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.81% (1.3813 => 1.4063, std. dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: 1.67% (16.2614 => 16.5334, std. dev.: 0.0198) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.62% (3.6692 => 3.7288, std. dev.: 0.0078) MultiSource/Applications/JM/lencod/lencod: 1.42% (14.8535 => 15.0640, std. dev.: 0.0076) MultiSource/Applications/SIBsim4/SIBsim4: 1.37% (1.2749 => 1.2924, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 1.16% (6.5754 => 6.6518, std. dev.: 0.0076) MultiSource/Applications/d/make_dparser: 1.09% (3.1889 => 3.2236, std. dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.04% (7.2180 => 7.2928, std. dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.02% (2.1007 => 2.1221, std. dev.: 0.0080) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.02% (1.8175 => 2.2540, std. dev.: 0.0531) SingleSource/Benchmarks/Misc/mandel-2: 7.06% (1.2998 => 1.3916, std. dev.: 0.0121) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6755, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9875, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.73% (1.7688 => 1.8347, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: 3.57% (7.4271 => 7.6922, std. dev.: 0.0087) MultiSource/Benchmarks/nbench/nbench: 3.12% (11.2619 => 11.6133, std. dev.: 0.0019) MultiSource/Applications/hexxagon/hexxagon: 2.98% (12.0921 => 12.4524, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-6: 2.86% (1.9199 => 1.9748, std. dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.85% (8.8259 => 9.0778, std. dev.: 0.0195) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9394, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.26% (7.9275 => 8.1070, std. dev.: 0.0156) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9603, std. dev.: 0.0078) MultiSource/Applications/lemon/lemon: 1.45% (1.4298 => 1.4505, std. dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5093, std. dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.29% (2.0200 => 2.0461, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: 1.16% (5.0168 => 5.0752, std. dev.: 0.0116) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.15% (1.9433 => 1.9657, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1778, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 1.02% (4.5928 => 4.6395, std. dev.: 0.0053) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -18.87% (0.4657 => 0.3778, std. dev.: 0.0157) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.12% (0.2670 => 0.2480, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.41% (0.3511 => 0.3286, std. dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.92% (22.5627 => 21.2278, std. dev.: 0.0077) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.35% (0.8818 => 0.8523, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-3: -3.31% (0.3623 => 0.3503, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.21% (0.3650 => 0.3533, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-2: -3.14% (0.3601 => 0.3488, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -3.06% (0.3663 => 0.3551, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -3.02% (0.3578 => 0.3470, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -2.99% (0.3646 => 0.3537, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -2.82% (0.3940 => 0.3829, std. dev.: 0.0021) SingleSource/UnitTests/ObjC/for-in: -2.80% (0.3789 => 0.3683, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -2.75% (0.4003 => 0.3893, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -2.66% (0.3914 => 0.3810, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.17% (0.6576 => 0.6433, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: -1.78% (0.6250 => 0.6139, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.12% (0.9108 => 0.9006, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -10.64% (1.2308 => 1.0998, std. dev.: 0.0057) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.56% (0.3139 => 0.2933, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9474, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.68% (1.3780 => 1.3135, std. dev.: 0.0090) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -4.01% (2.5089 => 2.4084, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.73% (0.3458 => 0.3329, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.62% (1.9762 => 1.9046, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.26% (20.3410 => 19.8807, std. dev.: 0.0545) SingleSource/Benchmarks/Misc/richards_benchmark: -2.12% (1.1560 => 1.1315, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout/lists: -2.07% (6.3560 => 6.2247, std. dev.: 0.0061) MultiSource/Applications/minisat/minisat: -1.99% (9.3358 => 9.1498, std. dev.: 0.0065) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6908, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.85% (6.6320 => 6.5093, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3446, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9955, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.56% (0.9692 => 0.9541, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.39% (3.9173 => 3.8630, std. dev.: 0.0052) MultiSource/Applications/lua/lua: -1.25% (26.5159 => 26.1835, std. dev.: 0.0264) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.20s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue May 15 21:52:08 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 15 May 2012 23:52:08 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120516045208.696262A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/670?compare_to=669&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 670, Order: 156897, Start Time: 2012-05-16 03:56:23, End Time: 2012-05-16 04:52:56 To: 669, Order: 156896, Start Time: 2012-05-16 02:32:52, End Time: 2012-05-16 03:29:23 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (62 on baseline) Performance Improvements: 0 (41 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 890 (785 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 1.63% (3.7640 => 3.8254, std. dev.: 0.0172) SingleSource/Benchmarks/Misc/mandel-2: 1.24% (1.3916 => 1.4088, std. dev.: 0.0029) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.91% (2.0176 => 2.2983, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.09% (0.3130 => 0.3352, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.15% (0.2721 => 0.2834, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.58% (3.9660 => 4.1081, std. dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.06% (0.5265 => 0.5426, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.03% (0.6959 => 0.7170, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 2.95% (1.0594 => 1.0907, std. dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/hash2: 2.91% (0.4328 => 0.4454, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 2.89% (13.8202 => 14.2197, std. dev.: 0.0092) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.84% (0.9199 => 0.9460, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.77% (0.5637 => 0.5793, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: 2.74% (0.8310 => 0.8538, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.55% (1.1364 => 1.1654, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.47% (1.2193 => 1.2494, std. dev.: 0.0048) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.27% (0.7710 => 0.7885, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.26% (1.4563 => 1.4892, std. dev.: 0.0026) MultiSource/Applications/kimwitu++/kc: 2.24% (16.6129 => 16.9842, std. dev.: 0.0165) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.22% (13.2842 => 13.5795, std. dev.: 0.0186) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.12% (0.5577 => 0.5695, std. dev.: 0.0015) MultiSource/Applications/siod/siod: 2.00% (2.1791 => 2.2227, std. dev.: 0.0057) MultiSource/Benchmarks/MallocBench/gs/gs: 1.94% (3.8646 => 3.9396, std. dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.93% (1.3245 => 1.3500, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.92% (0.7460 => 0.7603, std. dev.: 0.0005) MultiSource/Applications/treecc/treecc: 1.91% (1.9270 => 1.9639, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 1.89% (1.1061 => 1.1270, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.84% (1.3813 => 1.4067, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.84% (1.3819 => 1.4073, std. dev.: 0.0011) MultiSource/Applications/hbd/hbd: 1.80% (1.3693 => 1.3939, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 1.72% (0.7038 => 0.7159, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 1.68% (16.2614 => 16.5338, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.49% (3.6692 => 3.7238, std. dev.: 0.0089) MultiSource/Applications/SIBsim4/SIBsim4: 1.31% (1.2749 => 1.2916, std. dev.: 0.0010) MultiSource/Applications/JM/lencod/lencod: 1.21% (14.8535 => 15.0328, std. dev.: 0.0066) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.20% (2.1007 => 2.1259, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 1.06% (1.2292 => 1.2422, std. dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.34% (1.8175 => 2.2598, std. dev.: 0.0465) SingleSource/Benchmarks/Misc/mandel-2: 8.39% (1.2998 => 1.4088, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6754, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9878, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.64% (1.7688 => 1.8332, std. dev.: 0.0063) SingleSource/Benchmarks/Misc/salsa20: 3.59% (7.4271 => 7.6938, std. dev.: 0.0047) MultiSource/Benchmarks/nbench/nbench: 3.14% (11.2619 => 11.6156, std. dev.: 0.0025) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4549, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-6: 2.85% (1.9199 => 1.9746, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9393, std. dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.74% (8.8259 => 9.0674, std. dev.: 0.0086) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.58% (7.9275 => 8.1323, std. dev.: 0.0087) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.62% (0.8273 => 0.8407, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: 1.60% (1.9290 => 1.9598, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: 1.48% (1.4298 => 1.4510, std. dev.: 0.0031) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5093, std. dev.: 0.0031) MultiSource/Benchmarks/llubenchmark/llu: 1.39% (3.7731 => 3.8254, std. dev.: 0.0172) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.27% (2.0200 => 2.0457, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.25% (1.9433 => 1.9676, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0035) MultiSource/Benchmarks/sim/sim: 1.13% (5.0168 => 5.0733, std. dev.: 0.0118) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1774, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 1.00% (4.5928 => 4.6388, std. dev.: 0.0010) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -20.14% (0.4657 => 0.3719, std. dev.: 0.0116) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.19% (0.2670 => 0.2478, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.47% (0.3511 => 0.3284, std. dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.12% (22.5627 => 21.1822, std. dev.: 0.0117) SingleSource/UnitTests/ObjC/exceptions-2: -3.97% (0.3601 => 0.3458, std. dev.: 0.0053) SingleSource/UnitTests/ObjC/exceptions-3: -3.95% (0.3623 => 0.3480, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.86% (0.3650 => 0.3509, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/synchronized: -3.82% (0.3663 => 0.3523, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -3.81% (0.3646 => 0.3507, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -3.78% (0.3940 => 0.3791, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -3.69% (0.3789 => 0.3649, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -3.69% (0.3578 => 0.3446, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.66% (0.8818 => 0.8495, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -3.32% (0.3914 => 0.3784, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: -3.30% (0.4003 => 0.3871, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.19% (0.6576 => 0.6432, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/bigfib: -1.66% (0.6250 => 0.6146, std. dev.: 0.0005) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -10.42% (1.2308 => 1.1026, std. dev.: 0.0066) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.16% (1.0460 => 0.9502, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.56% (0.3139 => 0.2933, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2639, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9474, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -3.99% (2.5089 => 2.4087, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.87% (1.3780 => 1.3247, std. dev.: 0.0012) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.73% (0.3458 => 0.3329, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.65% (1.9762 => 1.9040, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -2.23% (6.3560 => 6.2145, std. dev.: 0.0108) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.19% (20.3410 => 19.8964, std. dev.: 0.0568) SingleSource/Benchmarks/Misc/richards_benchmark: -2.12% (1.1560 => 1.1315, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: -1.95% (9.3358 => 9.1540, std. dev.: 0.0316) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.88% (6.6320 => 6.5073, std. dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: -1.87% (28.2225 => 27.6951, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9953, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.38% (3.9173 => 3.8632, std. dev.: 0.0035) MultiSource/Applications/lua/lua: -1.20% (26.5159 => 26.1988, std. dev.: 0.0035) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.09% (2.5254 => 2.4979, std. dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.03% (3.8887 => 3.8487, std. dev.: 0.0045) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.23s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue May 15 23:15:37 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 16 May 2012 01:15:37 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120516061537.44B282A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/671?compare_to=670&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 671, Order: 156901, Start Time: 2012-05-16 05:19:55, End Time: 2012-05-16 06:16:24 To: 670, Order: 156897, Start Time: 2012-05-16 03:56:23, End Time: 2012-05-16 04:52:56 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (55 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (793 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.05% (2.0176 => 2.2809, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.00% (0.3130 => 0.3349, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.26% (0.2721 => 0.2837, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.48% (3.9660 => 4.1040, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.13% (0.5265 => 0.5430, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 2.95% (1.0594 => 1.0907, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.89% (0.6959 => 0.7160, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.80% (0.9199 => 0.9457, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 2.79% (13.8202 => 14.2060, std. dev.: 0.0160) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.68% (0.5637 => 0.5788, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.54% (1.1364 => 1.1653, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.47% (1.2193 => 1.2494, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 2.38% (0.4328 => 0.4431, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.34% (1.4563 => 1.4904, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.15% (13.2842 => 13.5694, std. dev.: 0.0158) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.13% (0.5577 => 0.5696, std. dev.: 0.0015) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.06% (0.7710 => 0.7869, std. dev.: 0.0034) MultiSource/Applications/siod/siod: 1.98% (2.1791 => 2.2222, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.93% (1.3245 => 1.3500, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/gs/gs: 1.90% (3.8646 => 3.9382, std. dev.: 0.0010) MultiSource/Applications/kimwitu++/kc: 1.85% (16.6129 => 16.9199, std. dev.: 0.0028) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.78% (0.7460 => 0.7593, std. dev.: 0.0026) MultiSource/Applications/sqlite3/sqlite3: 1.78% (16.2614 => 16.5511, std. dev.: 0.0192) MultiSource/Applications/Burg/burg: 1.78% (1.1061 => 1.1258, std. dev.: 0.0033) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.74% (1.3813 => 1.4054, std. dev.: 0.0011) MultiSource/Applications/treecc/treecc: 1.74% (1.9270 => 1.9605, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.74% (1.3819 => 1.4059, std. dev.: 0.0021) MultiSource/Applications/hbd/hbd: 1.72% (1.3693 => 1.3928, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.46% (3.6692 => 3.7227, std. dev.: 0.0043) MultiSource/Applications/SIBsim4/SIBsim4: 1.35% (1.2749 => 1.2921, std. dev.: 0.0014) MultiSource/Applications/JM/lencod/lencod: 1.28% (14.8535 => 15.0429, std. dev.: 0.0143) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.02% (2.1007 => 2.1222, std. dev.: 0.0075) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.36% (1.8175 => 2.2602, std. dev.: 0.0421) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7298, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.90% (1.5824 => 1.6758, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 3.79% (1.9144 => 1.9870, std. dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.62% (1.7688 => 1.8328, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/salsa20: 3.59% (7.4271 => 7.6936, std. dev.: 0.0044) MultiSource/Benchmarks/nbench/nbench: 3.13% (11.2619 => 11.6142, std. dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4531, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-6: 2.94% (1.9199 => 1.9764, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.81% (8.8259 => 9.0743, std. dev.: 0.0286) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.76% (2.8606 => 2.9395, std. dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.37% (7.9275 => 8.1157, std. dev.: 0.0163) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.55% (0.8273 => 0.8401, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: 1.48% (1.9290 => 1.9575, std. dev.: 0.0013) MultiSource/Applications/lemon/lemon: 1.43% (1.4298 => 1.4502, std. dev.: 0.0006) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5094, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.28% (2.0200 => 2.0459, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.18% (1.9433 => 1.9662, std. dev.: 0.0055) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 1.11% (9.0760 => 9.1766, std. dev.: 0.0018) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -20.12% (0.4657 => 0.3720, std. dev.: 0.0054) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.97% (0.2670 => 0.2484, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.41% (0.3511 => 0.3286, std. dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.13% (22.5627 => 21.1796, std. dev.: 0.0124) SingleSource/UnitTests/ObjC/exceptions-3: -3.26% (0.3623 => 0.3505, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.23% (0.3650 => 0.3532, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.21% (0.8818 => 0.8535, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -3.11% (0.3601 => 0.3489, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: -3.10% (0.3940 => 0.3818, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -3.05% (0.3578 => 0.3469, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -3.00% (0.3663 => 0.3553, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -2.99% (0.3646 => 0.3537, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -2.96% (0.3789 => 0.3677, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -2.75% (0.4003 => 0.3893, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: -2.73% (0.3914 => 0.3807, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: -1.92% (0.6250 => 0.6130, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.90% (0.6576 => 0.6451, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -10.68% (1.2308 => 1.0993, std. dev.: 0.0136) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.56% (0.3139 => 0.2933, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.15% (1.3780 => 1.3071, std. dev.: 0.0240) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9473, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -3.95% (2.5089 => 2.4098, std. dev.: 0.0035) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.59% (1.9762 => 1.9052, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -2.53% (6.3560 => 6.1950, std. dev.: 0.0157) SingleSource/Benchmarks/Misc/richards_benchmark: -2.12% (1.1560 => 1.1315, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: -1.93% (9.3358 => 9.1556, std. dev.: 0.0145) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.92% (6.6320 => 6.5045, std. dev.: 0.0055) MultiSource/Benchmarks/mafft/pairlocalalign: -1.89% (28.2225 => 27.6898, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3446, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9956, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.58% (20.3410 => 20.0203, std. dev.: 0.0156) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.43% (3.9173 => 3.8614, std. dev.: 0.0099) MultiSource/Applications/lua/lua: -1.28% (26.5159 => 26.1771, std. dev.: 0.0536) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.09% (3.8887 => 3.8465, std. dev.: 0.0023) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.45s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed May 16 01:46:35 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 16 May 2012 03:46:35 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120516084635.C89382A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/672?compare_to=671&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 672, Order: 156906, Start Time: 2012-05-16 07:50:34, End Time: 2012-05-16 08:47:23 To: 671, Order: 156901, Start Time: 2012-05-16 05:19:55, End Time: 2012-05-16 06:16:24 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (63 on baseline) Performance Improvements: 1 (38 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 890 (787 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 3.05% (1.3692 => 1.4109, std. dev.: 0.0078) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -2.42% (3.8659 => 3.7722, std. dev.: 0.0228) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.23% (2.0176 => 2.2845, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.35% (0.3130 => 0.3360, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.23% (0.2721 => 0.2836, std. dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.48% (3.9660 => 4.1039, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.19% (0.5265 => 0.5433, std. dev.: 0.0040) MultiSource/Benchmarks/nbench/nbench: 3.18% (1.0594 => 1.0931, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.05% (0.9199 => 0.9480, std. dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.03% (0.6959 => 0.7170, std. dev.: 0.0020) MultiSource/Applications/SPASS/SPASS: 2.97% (13.8202 => 14.2307, std. dev.: 0.0174) MultiSource/Benchmarks/Prolangs-C/football/football: 2.91% (0.8310 => 0.8552, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.82% (0.5637 => 0.5796, std. dev.: 0.0032) MultiSource/Applications/siod/siod: 2.63% (2.1791 => 2.2365, std. dev.: 0.0081) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.63% (1.1364 => 1.1663, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.55% (1.2193 => 1.2504, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.52% (1.4563 => 1.4930, std. dev.: 0.0017) MultiSource/Applications/kimwitu++/kc: 2.50% (16.6129 => 17.0289, std. dev.: 0.0049) MultiSource/Benchmarks/MallocBench/gs/gs: 2.23% (3.8646 => 3.9508, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.19% (0.5577 => 0.5699, std. dev.: 0.0021) MultiSource/Applications/lambda-0_1_3/lambda: 2.15% (0.7038 => 0.7189, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.14% (1.3245 => 1.3528, std. dev.: 0.0010) MultiSource/Applications/treecc/treecc: 2.12% (1.9270 => 1.9678, std. dev.: 0.0075) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.10% (0.7460 => 0.7617, std. dev.: 0.0018) MultiSource/Applications/Burg/burg: 2.08% (1.1061 => 1.1291, std. dev.: 0.0024) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.01% (0.7710 => 0.7865, std. dev.: 0.0049) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.01% (13.2842 => 13.5511, std. dev.: 0.0053) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.92% (1.3813 => 1.4078, std. dev.: 0.0016) MultiSource/Applications/sqlite3/sqlite3: 1.81% (16.2614 => 16.5555, std. dev.: 0.0035) MultiSource/Applications/hbd/hbd: 1.76% (1.3693 => 1.3934, std. dev.: 0.0035) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.74% (1.3819 => 1.4059, std. dev.: 0.0027) MultiSource/Applications/spiff/spiff: 1.72% (0.7506 => 0.7635, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.45% (3.6692 => 3.7223, std. dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.35% (2.1007 => 2.1291, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.22% (3.2742 => 3.3140, std. dev.: 0.0025) MultiSource/Applications/JM/lencod/lencod: 1.21% (14.8535 => 15.0331, std. dev.: 0.0169) MultiSource/Applications/d/make_dparser: 1.14% (3.1889 => 3.2253, std. dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.03% (1.5188 => 1.5345, std. dev.: 0.0011) MultiSource/Applications/JM/ldecod/ldecod: 1.03% (6.5754 => 6.6429, std. dev.: 0.0046) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.04% (1.8175 => 2.2545, std. dev.: 0.0310) SingleSource/Benchmarks/Misc/mandel-2: 8.55% (1.2998 => 1.4109, std. dev.: 0.0078) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7298, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6754, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9878, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.70% (1.7688 => 1.8342, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/salsa20: 3.56% (7.4271 => 7.6915, std. dev.: 0.0078) MultiSource/Benchmarks/nbench/nbench: 3.16% (11.2619 => 11.6181, std. dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4534, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: 2.91% (1.9199 => 1.9757, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9394, std. dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.60% (8.8259 => 9.0550, std. dev.: 0.0191) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.46% (7.9275 => 8.1227, std. dev.: 0.0068) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.62% (0.8273 => 0.8407, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.52% (1.4298 => 1.4515, std. dev.: 0.0008) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5081, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/bisort/bisort: 1.30% (0.8239 => 0.8346, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.29% (2.0200 => 2.0461, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1774, std. dev.: 0.0010) MultiSource/Benchmarks/sim/sim: 1.09% (5.0168 => 5.0715, std. dev.: 0.0106) MultiSource/Applications/sqlite3/sqlite3: 1.08% (4.5928 => 4.6424, std. dev.: 0.0041) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.27% (0.2670 => 0.2476, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.15% (0.3511 => 0.3295, std. dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.87% (22.5627 => 21.2379, std. dev.: 0.0121) SingleSource/UnitTests/ObjC/exceptions-3: -4.11% (0.3623 => 0.3474, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.11% (0.3650 => 0.3500, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions-2: -4.03% (0.3601 => 0.3456, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -3.96% (0.3663 => 0.3518, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -3.95% (0.3646 => 0.3502, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -3.94% (0.3578 => 0.3437, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -3.80% (0.3789 => 0.3645, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -3.71% (0.3940 => 0.3794, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -3.42% (0.3914 => 0.3780, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -3.35% (0.4003 => 0.3869, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.19% (0.8818 => 0.8537, std. dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/bigfib: -1.98% (0.6250 => 0.6126, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.78% (0.6576 => 0.6459, std. dev.: 0.0010) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -10.07% (1.2308 => 1.1068, std. dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.59% (0.3139 => 0.2932, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.38% (1.3780 => 1.3038, std. dev.: 0.0072) SingleSource/Benchmarks/Misc/perlin: -4.83% (6.2497 => 5.9476, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -4.03% (2.5089 => 2.4078, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.73% (0.3458 => 0.3329, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.65% (1.9762 => 1.9040, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: -2.15% (1.1560 => 1.1312, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -2.06% (6.3560 => 6.2253, std. dev.: 0.0053) MultiSource/Applications/minisat/minisat: -2.00% (9.3358 => 9.1495, std. dev.: 0.0035) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.98% (20.3410 => 19.9377, std. dev.: 0.0320) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.93% (6.6320 => 6.5043, std. dev.: 0.0046) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6917, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3446, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9955, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.39% (3.9173 => 3.8630, std. dev.: 0.0112) MultiSource/Applications/lua/lua: -1.23% (26.5159 => 26.1898, std. dev.: 0.0300) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.39s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed May 16 03:10:22 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 16 May 2012 05:10:22 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120516101022.18DE42A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/673?compare_to=672&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 673, Order: 156913, Start Time: 2012-05-16 09:14:23, End Time: 2012-05-16 10:11:07 To: 672, Order: 156906, Start Time: 2012-05-16 07:50:34, End Time: 2012-05-16 08:47:23 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (60 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 891 (789 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 3.12% (3.7722 => 3.8899, std. dev.: 0.0214) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.99% (2.0176 => 2.2796, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.35% (0.3130 => 0.3360, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.19% (0.2721 => 0.2835, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.56% (3.9660 => 4.1073, std. dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.25% (0.6959 => 0.7185, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.17% (0.5265 => 0.5432, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 3.08% (1.0594 => 1.0920, std. dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 2.96% (13.8202 => 14.2295, std. dev.: 0.0134) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.95% (0.9199 => 0.9470, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.91% (0.5637 => 0.5801, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/football/football: 2.86% (0.8310 => 0.8548, std. dev.: 0.0031) MultiSource/Applications/kimwitu++/kc: 2.61% (16.6129 => 17.0466, std. dev.: 0.0196) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.54% (1.1364 => 1.1653, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.51% (1.2193 => 1.2499, std. dev.: 0.0014) MultiSource/Applications/siod/siod: 2.49% (2.1791 => 2.2333, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.47% (0.5577 => 0.5715, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.28% (1.4563 => 1.4895, std. dev.: 0.0020) MultiSource/Benchmarks/MallocBench/gs/gs: 2.21% (3.8646 => 3.9502, std. dev.: 0.0036) MultiSource/Applications/Burg/burg: 2.13% (1.1061 => 1.1297, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 2.13% (0.7038 => 0.7188, std. dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.09% (1.3245 => 1.3522, std. dev.: 0.0026) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.08% (1.3813 => 1.4100, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.06% (0.7710 => 0.7869, std. dev.: 0.0013) MultiSource/Applications/treecc/treecc: 1.99% (1.9270 => 1.9653, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.98% (13.2842 => 13.5466, std. dev.: 0.0059) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.96% (0.7460 => 0.7606, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.90% (1.3819 => 1.4081, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.54% (3.6692 => 3.7256, std. dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: 1.47% (16.2614 => 16.5010, std. dev.: 0.0064) MultiSource/Applications/hbd/hbd: 1.42% (1.3693 => 1.3887, std. dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.29% (2.1007 => 2.1279, std. dev.: 0.0081) MultiSource/Applications/JM/lencod/lencod: 1.12% (14.8535 => 15.0195, std. dev.: 0.0094) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.01% (1.5188 => 1.5342, std. dev.: 0.0010) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 23.98% (1.8175 => 2.2534, std. dev.: 0.0558) SingleSource/Benchmarks/Misc/mandel-2: 8.12% (1.2998 => 1.4053, std. dev.: 0.0053) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7298, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6754, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9877, std. dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.65% (1.7688 => 1.8334, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: 3.57% (7.4271 => 7.6921, std. dev.: 0.0046) MultiSource/Benchmarks/nbench/nbench: 3.12% (11.2619 => 11.6138, std. dev.: 0.0007) MultiSource/Benchmarks/llubenchmark/llu: 3.10% (3.7731 => 3.8899, std. dev.: 0.0214) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4535, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: 2.88% (1.9199 => 1.9751, std. dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.77% (8.8259 => 9.0707, std. dev.: 0.0085) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9393, std. dev.: 0.0023) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.38% (7.9275 => 8.1158, std. dev.: 0.0159) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9601, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.58% (0.8273 => 0.8404, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.46% (1.4298 => 1.4507, std. dev.: 0.0007) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5091, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.23% (2.0200 => 2.0449, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.19% (1.9433 => 1.9665, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1774, std. dev.: 0.0006) MultiSource/Benchmarks/sim/sim: 1.04% (5.0168 => 5.0690, std. dev.: 0.0161) MultiSource/Applications/sqlite3/sqlite3: 1.01% (4.5928 => 4.6390, std. dev.: 0.0008) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -19.88% (0.4657 => 0.3731, std. dev.: 0.0323) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.45% (0.2670 => 0.2471, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.44% (0.3511 => 0.3285, std. dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.10% (22.5627 => 21.1862, std. dev.: 0.0040) SingleSource/UnitTests/ObjC/exceptions-3: -4.14% (0.3623 => 0.3473, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -4.00% (0.3601 => 0.3457, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.97% (0.3650 => 0.3505, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/trivial-interface: -3.91% (0.3578 => 0.3438, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-4: -3.87% (0.3646 => 0.3505, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -3.85% (0.3663 => 0.3522, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -3.77% (0.3789 => 0.3646, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -3.68% (0.3940 => 0.3795, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -3.45% (0.3914 => 0.3779, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -3.35% (0.4003 => 0.3869, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.27% (0.8818 => 0.8530, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/bigfib: -2.03% (0.6250 => 0.6123, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.93% (0.6576 => 0.6449, std. dev.: 0.0010) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -9.99% (1.2308 => 1.1078, std. dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.16% (1.0460 => 0.9502, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.53% (0.3139 => 0.2934, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.17% (1.3780 => 1.3067, std. dev.: 0.0066) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9475, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -4.04% (2.5089 => 2.4075, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.68% (1.9762 => 1.9035, std. dev.: 0.0043) SingleSource/Benchmarks/Shootout/lists: -2.28% (6.3560 => 6.2114, std. dev.: 0.0141) SingleSource/Benchmarks/Misc/richards_benchmark: -2.15% (1.1560 => 1.1311, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.97% (20.3410 => 19.9405, std. dev.: 0.0257) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6933, std. dev.: 0.0024) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.87% (6.6320 => 6.5078, std. dev.: 0.0051) MultiSource/Applications/minisat/minisat: -1.82% (9.3358 => 9.1658, std. dev.: 0.0125) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9954, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.51% (3.9173 => 3.8581, std. dev.: 0.0062) MultiSource/Applications/lua/lua: -1.25% (26.5159 => 26.1839, std. dev.: 0.0149) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.00% (3.8887 => 3.8497, std. dev.: 0.0030) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.35s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed May 16 06:51:32 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 16 May 2012 08:51:32 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120516135132.3E07E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/674?compare_to=673&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 674, Order: 156914, Start Time: 2012-05-16 12:55:36, End Time: 2012-05-16 13:52:19 To: 673, Order: 156913, Start Time: 2012-05-16 09:14:23, End Time: 2012-05-16 10:11:07 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (63 on baseline) Performance Improvements: 1 (39 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 891 (786 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -3.24% (3.8899 => 3.7640, std. dev.: 0.0385) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.07% (2.0176 => 2.2812, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.41% (0.3130 => 0.3362, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.15% (0.2721 => 0.2834, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.49% (0.6959 => 0.7202, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.47% (3.9660 => 4.1037, std. dev.: 0.0072) MultiSource/Benchmarks/nbench/nbench: 3.29% (1.0594 => 1.0943, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.27% (0.5265 => 0.5437, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.08% (0.9199 => 0.9482, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 2.98% (13.8202 => 14.2324, std. dev.: 0.0138) MultiSource/Benchmarks/Prolangs-C/football/football: 2.89% (0.8310 => 0.8550, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.82% (0.5637 => 0.5796, std. dev.: 0.0016) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.80% (0.7710 => 0.7926, std. dev.: 0.0008) MultiSource/Applications/siod/siod: 2.70% (2.1791 => 2.2380, std. dev.: 0.0036) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.60% (1.1364 => 1.1660, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.58% (1.2193 => 1.2508, std. dev.: 0.0012) MultiSource/Applications/kimwitu++/kc: 2.56% (16.6129 => 17.0382, std. dev.: 0.0128) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.33% (0.5577 => 0.5707, std. dev.: 0.0016) MultiSource/Applications/Burg/burg: 2.32% (1.1061 => 1.1318, std. dev.: 0.0038) MultiSource/Benchmarks/MallocBench/gs/gs: 2.31% (3.8646 => 3.9537, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.25% (1.4563 => 1.4891, std. dev.: 0.0032) MultiSource/Applications/treecc/treecc: 2.25% (1.9270 => 1.9704, std. dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.25% (1.3245 => 1.3543, std. dev.: 0.0013) MultiSource/Applications/lambda-0_1_3/lambda: 2.19% (0.7038 => 0.7192, std. dev.: 0.0043) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.18% (0.7460 => 0.7623, std. dev.: 0.0034) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.06% (1.3813 => 1.4098, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.02% (13.2842 => 13.5528, std. dev.: 0.0098) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.95% (1.3819 => 1.4089, std. dev.: 0.0036) MultiSource/Applications/sqlite3/sqlite3: 1.51% (16.2614 => 16.5075, std. dev.: 0.0078) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.46% (3.6692 => 3.7226, std. dev.: 0.0032) MultiSource/Applications/hbd/hbd: 1.44% (1.3693 => 1.3890, std. dev.: 0.0069) MultiSource/Applications/spiff/spiff: 1.36% (0.7506 => 0.7608, std. dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.36% (2.1007 => 2.1292, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.34% (3.2742 => 3.3181, std. dev.: 0.0009) MultiSource/Applications/SIBsim4/SIBsim4: 1.18% (1.2749 => 1.2899, std. dev.: 0.0020) MultiSource/Applications/JM/lencod/lencod: 1.15% (14.8535 => 15.0244, std. dev.: 0.0166) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.08% (1.5188 => 1.5352, std. dev.: 0.0008) MultiSource/Applications/JM/ldecod/ldecod: 1.01% (6.5754 => 6.6420, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.01% (1.1333 => 1.1447, std. dev.: 0.0011) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 23.99% (1.8175 => 2.2536, std. dev.: 0.0072) SingleSource/Benchmarks/Misc/mandel-2: 7.52% (1.2998 => 1.3976, std. dev.: 0.0143) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6755, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9877, std. dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.71% (1.7688 => 1.8344, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: 3.57% (7.4271 => 7.6925, std. dev.: 0.0047) MultiSource/Benchmarks/nbench/nbench: 3.12% (11.2619 => 11.6130, std. dev.: 0.0033) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4541, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-6: 2.92% (1.9199 => 1.9760, std. dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.85% (8.8259 => 9.0776, std. dev.: 0.0131) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9394, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.21% (7.9275 => 8.1026, std. dev.: 0.0172) SingleSource/Benchmarks/Dhrystone/fldry: 1.60% (1.9290 => 1.9599, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/ffbench: 1.55% (0.8273 => 0.8401, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 1.54% (5.0168 => 5.0940, std. dev.: 0.0064) MultiSource/Applications/lemon/lemon: 1.46% (1.4298 => 1.4507, std. dev.: 0.0043) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5081, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.27% (2.0200 => 2.0456, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.15% (1.9433 => 1.9656, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 1.11% (9.0760 => 9.1764, std. dev.: 0.0011) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -19.24% (0.4657 => 0.3761, std. dev.: 0.0321) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.42% (0.2670 => 0.2472, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.35% (0.3511 => 0.3288, std. dev.: 0.0011) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.98% (22.5627 => 21.2127, std. dev.: 0.0039) SingleSource/UnitTests/ObjC/exceptions-3: -4.14% (0.3623 => 0.3473, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.08% (0.3650 => 0.3501, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -4.03% (0.3601 => 0.3456, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -3.99% (0.3663 => 0.3517, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -3.89% (0.3646 => 0.3504, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: -3.86% (0.3578 => 0.3440, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -3.83% (0.3789 => 0.3644, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: -3.76% (0.3940 => 0.3792, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -3.45% (0.3914 => 0.3779, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -3.37% (0.4003 => 0.3868, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.23% (0.8818 => 0.8533, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.01% (0.6576 => 0.6444, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/bigfib: -1.89% (0.6250 => 0.6132, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -9.95% (1.2308 => 1.1083, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0008) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.56% (0.3139 => 0.2933, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2650, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.93% (1.3780 => 1.3100, std. dev.: 0.0079) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9474, std. dev.: 0.0004) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -4.01% (2.5089 => 2.4083, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.60% (1.9762 => 1.9051, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: -2.14% (1.1560 => 1.1313, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -2.06% (6.3560 => 6.2248, std. dev.: 0.0036) MultiSource/Applications/minisat/minisat: -1.92% (9.3358 => 9.1565, std. dev.: 0.0152) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6912, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.86% (6.6320 => 6.5085, std. dev.: 0.0055) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.75% (20.3410 => 19.9842, std. dev.: 0.0071) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9956, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.46% (3.9173 => 3.8603, std. dev.: 0.0171) MultiSource/Applications/lua/lua: -1.14% (26.5159 => 26.2131, std. dev.: 0.0093) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.32s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed May 16 08:15:07 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 16 May 2012 10:15:07 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120516151507.032EC2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/675?compare_to=674&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 675, Order: 156916, Start Time: 2012-05-16 14:19:16, End Time: 2012-05-16 15:15:55 To: 674, Order: 156914, Start Time: 2012-05-16 12:55:36, End Time: 2012-05-16 13:52:19 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (59 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (790 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.43% (2.0176 => 2.2683, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.87% (0.3130 => 0.3345, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.12% (0.2721 => 0.2833, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.38% (3.9660 => 4.0999, std. dev.: 0.0085) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.09% (0.6959 => 0.7174, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.02% (0.5265 => 0.5424, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.84% (0.9199 => 0.9460, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 2.71% (1.0594 => 1.0881, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/football/football: 2.68% (0.8310 => 0.8533, std. dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 2.68% (13.8202 => 14.1904, std. dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.63% (0.5637 => 0.5785, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.45% (1.4563 => 1.4920, std. dev.: 0.0017) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.41% (1.1364 => 1.1638, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.39% (1.2193 => 1.2484, std. dev.: 0.0014) MultiSource/Applications/siod/siod: 2.29% (2.1791 => 2.2291, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.19% (1.3813 => 1.4116, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/gs/gs: 2.16% (3.8646 => 3.9481, std. dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.10% (0.5577 => 0.5694, std. dev.: 0.0017) MultiSource/Applications/kimwitu++/kc: 2.04% (16.6129 => 16.9519, std. dev.: 0.0167) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.00% (0.7710 => 0.7864, std. dev.: 0.0042) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.00% (1.3819 => 1.4095, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.97% (1.3245 => 1.3506, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.93% (13.2842 => 13.5404, std. dev.: 0.0158) MultiSource/Applications/Burg/burg: 1.91% (1.1061 => 1.1272, std. dev.: 0.0031) MultiSource/Applications/treecc/treecc: 1.87% (1.9270 => 1.9631, std. dev.: 0.0032) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.78% (0.7460 => 0.7593, std. dev.: 0.0041) MultiSource/Applications/lambda-0_1_3/lambda: 1.71% (0.7038 => 0.7158, std. dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 1.41% (16.2614 => 16.4905, std. dev.: 0.0191) MultiSource/Applications/hbd/hbd: 1.25% (1.3693 => 1.3864, std. dev.: 0.0044) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.21% (3.6692 => 3.7135, std. dev.: 0.0116) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.11% (2.1007 => 2.1240, std. dev.: 0.0020) MultiSource/Applications/SIBsim4/SIBsim4: 1.10% (1.2749 => 1.2889, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.08% (3.2742 => 3.3097, std. dev.: 0.0007) MultiSource/Applications/JM/lencod/lencod: 1.03% (14.8535 => 15.0071, std. dev.: 0.0079) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.38% (1.8175 => 2.2606, std. dev.: 0.0487) SingleSource/Benchmarks/Misc/mandel-2: 8.01% (1.2998 => 1.4039, std. dev.: 0.0053) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7298, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.86% (1.5824 => 1.6752, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8146, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9881, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.66% (1.7688 => 1.8335, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: 3.51% (7.4271 => 7.6878, std. dev.: 0.0067) MultiSource/Benchmarks/nbench/nbench: 3.13% (11.2619 => 11.6149, std. dev.: 0.0033) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4542, std. dev.: 0.0038) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.97% (8.8259 => 9.0883, std. dev.: 0.0101) SingleSource/Benchmarks/Misc/flops-6: 2.92% (1.9199 => 1.9759, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9394, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.44% (7.9275 => 8.1207, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9603, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.61% (0.8273 => 0.8406, std. dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5093, std. dev.: 0.0005) MultiSource/Applications/lemon/lemon: 1.41% (1.4298 => 1.4499, std. dev.: 0.0040) MultiSource/Benchmarks/sim/sim: 1.31% (5.0168 => 5.0823, std. dev.: 0.0083) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.24% (2.0200 => 2.0451, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0039) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.13% (1.9433 => 1.9653, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: 1.13% (9.0760 => 9.1784, std. dev.: 0.0013) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.08% (0.2670 => 0.2481, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.49% (0.3511 => 0.3283, std. dev.: 0.0011) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.26% (22.5627 => 21.1505, std. dev.: 0.0029) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.56% (0.3650 => 0.3520, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-3: -3.56% (0.3623 => 0.3494, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: -3.39% (0.3601 => 0.3479, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -3.36% (0.3663 => 0.3540, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -3.30% (0.3578 => 0.3460, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: -3.29% (0.3646 => 0.3526, std. dev.: 0.0038) SingleSource/UnitTests/ObjC/property: -3.27% (0.3940 => 0.3811, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.20% (0.8818 => 0.8536, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/for-in: -3.11% (0.3789 => 0.3671, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -2.96% (0.3914 => 0.3798, std. dev.: 0.0033) SingleSource/UnitTests/ObjC/parameter-passing: -2.92% (0.4003 => 0.3886, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: -2.38% (0.6250 => 0.6101, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.14% (0.6576 => 0.6435, std. dev.: 0.0025) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.15% (0.9108 => 0.9003, std. dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -9.87% (1.2308 => 1.1093, std. dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.56% (0.3139 => 0.2933, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.95% (1.3780 => 1.3098, std. dev.: 0.0129) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9473, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -4.08% (2.5089 => 2.4066, std. dev.: 0.0015) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.67% (0.3458 => 0.3331, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.65% (1.9762 => 1.9040, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -2.20% (6.3560 => 6.2161, std. dev.: 0.0137) SingleSource/Benchmarks/Misc/richards_benchmark: -2.15% (1.1560 => 1.1312, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.97% (6.6320 => 6.5014, std. dev.: 0.0047) MultiSource/Benchmarks/mafft/pairlocalalign: -1.87% (28.2225 => 27.6948, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: -1.79% (9.3358 => 9.1691, std. dev.: 0.0224) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.78% (20.3410 => 19.9784, std. dev.: 0.0299) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3446, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9954, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.51% (3.9173 => 3.8582, std. dev.: 0.0039) MultiSource/Applications/lua/lua: -1.32% (26.5159 => 26.1670, std. dev.: 0.0163) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.34s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed May 16 09:38:37 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 16 May 2012 11:38:37 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120516163837.A25892A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/676?compare_to=675&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 676, Order: 156917, Start Time: 2012-05-16 15:42:50, End Time: 2012-05-16 16:39:26 To: 675, Order: 156916, Start Time: 2012-05-16 14:19:16, End Time: 2012-05-16 15:15:55 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (61 on baseline) Performance Improvements: 1 (39 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 891 (788 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -3.54% (0.3786 => 0.3652, std. dev.: 0.0045) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.36% (2.0176 => 2.2670, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.12% (0.3130 => 0.3353, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.97% (0.2721 => 0.2829, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.48% (3.9660 => 4.1039, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.17% (0.5265 => 0.5432, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.12% (0.6959 => 0.7176, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.96% (0.9199 => 0.9471, std. dev.: 0.0029) MultiSource/Benchmarks/nbench/nbench: 2.95% (1.0594 => 1.0906, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 2.92% (13.8202 => 14.2236, std. dev.: 0.0165) MultiSource/Benchmarks/Prolangs-C/football/football: 2.79% (0.8310 => 0.8542, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.64% (0.5637 => 0.5786, std. dev.: 0.0018) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.60% (1.1364 => 1.1660, std. dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.57% (1.2193 => 1.2506, std. dev.: 0.0068) MultiSource/Applications/siod/siod: 2.46% (2.1791 => 2.2326, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/gs/gs: 2.40% (3.8646 => 3.9574, std. dev.: 0.0038) MultiSource/Applications/kimwitu++/kc: 2.40% (16.6129 => 17.0112, std. dev.: 0.0090) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.39% (1.4563 => 1.4911, std. dev.: 0.0078) MultiSource/Applications/Burg/burg: 2.24% (1.1061 => 1.1309, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.24% (0.5577 => 0.5702, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.23% (1.3245 => 1.3540, std. dev.: 0.0024) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.20% (0.7710 => 0.7880, std. dev.: 0.0030) MultiSource/Applications/lambda-0_1_3/lambda: 2.03% (0.7038 => 0.7181, std. dev.: 0.0006) MultiSource/Applications/treecc/treecc: 2.02% (1.9270 => 1.9659, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.87% (13.2842 => 13.5324, std. dev.: 0.0071) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.86% (0.7460 => 0.7599, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.86% (1.3813 => 1.4070, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.74% (1.3819 => 1.4060, std. dev.: 0.0022) MultiSource/Applications/sqlite3/sqlite3: 1.53% (16.2614 => 16.5101, std. dev.: 0.0116) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.41% (2.1007 => 2.1304, std. dev.: 0.0009) MultiSource/Applications/hbd/hbd: 1.38% (1.3693 => 1.3882, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.31% (3.6692 => 3.7173, std. dev.: 0.0036) MultiSource/Applications/SIBsim4/SIBsim4: 1.30% (1.2749 => 1.2915, std. dev.: 0.0008) MultiSource/Applications/JM/lencod/lencod: 1.17% (14.8535 => 15.0275, std. dev.: 0.0137) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.10% (3.2742 => 3.3103, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.06% (1.5188 => 1.5349, std. dev.: 0.0049) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 23.47% (1.8175 => 2.2440, std. dev.: 0.0507) SingleSource/Benchmarks/Misc/mandel-2: 7.34% (1.2998 => 1.3952, std. dev.: 0.0069) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.86% (1.5824 => 1.6751, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.80% (1.9144 => 1.9872, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.72% (1.7688 => 1.8346, std. dev.: 0.0059) SingleSource/Benchmarks/Misc/salsa20: 3.58% (7.4271 => 7.6932, std. dev.: 0.0073) MultiSource/Benchmarks/nbench/nbench: 3.11% (11.2619 => 11.6126, std. dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: 2.98% (12.0921 => 12.4527, std. dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.78% (8.8259 => 9.0713, std. dev.: 0.0161) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.74% (2.8606 => 2.9391, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: 2.63% (1.9199 => 1.9703, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.15% (7.9275 => 8.0976, std. dev.: 0.0159) SingleSource/Benchmarks/Dhrystone/fldry: 1.60% (1.9290 => 1.9599, std. dev.: 0.0084) SingleSource/Benchmarks/Misc/ffbench: 1.56% (0.8273 => 0.8402, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.45% (1.4298 => 1.4505, std. dev.: 0.0046) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5099, std. dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.27% (2.0200 => 2.0456, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.24% (1.9433 => 1.9674, std. dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 1.18% (5.0168 => 5.0762, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.10% (9.0760 => 9.1761, std. dev.: 0.0017) MultiSource/Applications/sqlite3/sqlite3: 1.01% (4.5928 => 4.6390, std. dev.: 0.0109) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -21.58% (0.4657 => 0.3652, std. dev.: 0.0045) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.23% (0.2670 => 0.2477, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.38% (0.3511 => 0.3287, std. dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.13% (22.5627 => 21.1800, std. dev.: 0.0118) SingleSource/UnitTests/ObjC/exceptions-3: -4.06% (0.3623 => 0.3476, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.00% (0.3650 => 0.3504, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -3.94% (0.3601 => 0.3459, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -3.89% (0.3646 => 0.3504, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: -3.86% (0.3578 => 0.3440, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/synchronized: -3.79% (0.3663 => 0.3524, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -3.72% (0.3789 => 0.3648, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -3.63% (0.3940 => 0.3797, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -3.45% (0.3914 => 0.3779, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -3.32% (0.4003 => 0.3870, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.16% (0.8818 => 0.8539, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/bigfib: -2.11% (0.6250 => 0.6118, std. dev.: 0.0047) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.08% (0.6576 => 0.6439, std. dev.: 0.0010) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -10.56% (1.2308 => 1.1008, std. dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.56% (0.3139 => 0.2933, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.84% (1.3780 => 1.3113, std. dev.: 0.0044) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9474, std. dev.: 0.0003) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -4.03% (2.5089 => 2.4078, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.73% (0.3458 => 0.3329, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.63% (1.9762 => 1.9045, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/richards_benchmark: -2.13% (1.1560 => 1.1314, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.97% (6.3560 => 6.2305, std. dev.: 0.0036) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.89% (6.6320 => 6.5067, std. dev.: 0.0015) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6916, std. dev.: 0.0010) MultiSource/Applications/minisat/minisat: -1.87% (9.3358 => 9.1609, std. dev.: 0.0053) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9957, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.51% (20.3410 => 20.0329, std. dev.: 0.0100) SingleSource/Benchmarks/Shootout/heapsort: -1.48% (3.9173 => 3.8594, std. dev.: 0.0111) MultiSource/Applications/lua/lua: -1.20% (26.5159 => 26.1974, std. dev.: 0.0123) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.48s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed May 16 11:02:09 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 16 May 2012 13:02:09 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120516180209.574432A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/677?compare_to=676&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 677, Order: 156923, Start Time: 2012-05-16 17:06:27, End Time: 2012-05-16 18:02:58 To: 676, Order: 156917, Start Time: 2012-05-16 15:42:50, End Time: 2012-05-16 16:39:26 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (60 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (788 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.34% (2.0176 => 2.2868, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.09% (0.3130 => 0.3352, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.15% (0.2721 => 0.2834, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.37% (3.9660 => 4.0996, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.99% (0.6959 => 0.7167, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.96% (0.5265 => 0.5421, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 2.88% (1.0594 => 1.0899, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 2.83% (13.8202 => 14.2109, std. dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.82% (0.9199 => 0.9458, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/football/football: 2.70% (0.8310 => 0.8534, std. dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.53% (1.1364 => 1.1651, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.52% (0.5637 => 0.5779, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.30% (1.2193 => 1.2473, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.22% (1.4563 => 1.4887, std. dev.: 0.0007) MultiSource/Applications/siod/siod: 2.22% (2.1791 => 2.2274, std. dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.19% (0.5577 => 0.5699, std. dev.: 0.0021) MultiSource/Applications/kimwitu++/kc: 2.17% (16.6129 => 16.9729, std. dev.: 0.0246) MultiSource/Applications/lambda-0_1_3/lambda: 2.02% (0.7038 => 0.7180, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.01% (1.3245 => 1.3511, std. dev.: 0.0001) MultiSource/Applications/Burg/burg: 2.01% (1.1061 => 1.1283, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.91% (13.2842 => 13.5379, std. dev.: 0.0144) MultiSource/Benchmarks/MallocBench/gs/gs: 1.91% (3.8646 => 3.9383, std. dev.: 0.0079) MultiSource/Applications/treecc/treecc: 1.89% (1.9270 => 1.9635, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.88% (0.7460 => 0.7600, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.70% (0.7710 => 0.7841, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.62% (1.3813 => 1.4037, std. dev.: 0.0039) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.58% (1.3819 => 1.4037, std. dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: 1.50% (16.2614 => 16.5051, std. dev.: 0.0045) MultiSource/Applications/hbd/hbd: 1.48% (1.3693 => 1.3896, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.38% (3.6692 => 3.7200, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.31% (2.1007 => 2.1282, std. dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: 1.18% (1.2749 => 1.2899, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.06% (3.2742 => 3.3088, std. dev.: 0.0067) MultiSource/Applications/JM/lencod/lencod: 1.05% (14.8535 => 15.0092, std. dev.: 0.0046) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.14% (1.8175 => 2.2563, std. dev.: 0.0209) SingleSource/Benchmarks/Misc/mandel-2: 7.45% (1.2998 => 1.3966, std. dev.: 0.0095) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6754, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9879, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.73% (1.7688 => 1.8347, std. dev.: 0.0073) SingleSource/Benchmarks/Misc/salsa20: 3.60% (7.4271 => 7.6947, std. dev.: 0.0046) MultiSource/Benchmarks/nbench/nbench: 3.12% (11.2619 => 11.6138, std. dev.: 0.0014) MultiSource/Applications/hexxagon/hexxagon: 3.01% (12.0921 => 12.4560, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: 2.89% (1.9199 => 1.9754, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9392, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.50% (8.8259 => 9.0464, std. dev.: 0.0372) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.46% (7.9275 => 8.1222, std. dev.: 0.0152) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.60% (0.8273 => 0.8405, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5099, std. dev.: 0.0049) MultiSource/Applications/lemon/lemon: 1.38% (1.4298 => 1.4495, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.30% (2.0200 => 2.0462, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: 1.27% (1.9290 => 1.9535, std. dev.: 0.0032) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.24% (1.9433 => 1.9674, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 1.13% (9.0760 => 9.1784, std. dev.: 0.0005) MultiSource/Benchmarks/sim/sim: 1.05% (5.0168 => 5.0693, std. dev.: 0.0146) MultiSource/Applications/sqlite3/sqlite3: 1.00% (4.5928 => 4.6389, std. dev.: 0.0052) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -21.24% (0.4657 => 0.3668, std. dev.: 0.0067) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.15% (0.2670 => 0.2479, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.49% (0.3511 => 0.3283, std. dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.14% (22.5627 => 21.1776, std. dev.: 0.0192) SingleSource/UnitTests/ObjC/exceptions-3: -3.89% (0.3623 => 0.3482, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -3.89% (0.3601 => 0.3461, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: -3.79% (0.3663 => 0.3524, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -3.76% (0.3646 => 0.3509, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -3.75% (0.3578 => 0.3444, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.73% (0.3650 => 0.3514, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/for-in: -3.64% (0.3789 => 0.3651, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.64% (0.8818 => 0.8497, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/property: -3.63% (0.3940 => 0.3797, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: -3.30% (0.3914 => 0.3785, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -3.27% (0.4003 => 0.3872, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.52% (0.6576 => 0.6410, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: -2.06% (0.6250 => 0.6121, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.28% (0.9108 => 0.8991, std. dev.: 0.0005) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -9.86% (1.2308 => 1.1094, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.56% (0.3139 => 0.2933, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.12% (1.3780 => 1.3074, std. dev.: 0.0065) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9473, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -3.98% (2.5089 => 2.4090, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: -3.64% (1.9762 => 1.9043, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.59% (0.3458 => 0.3334, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -2.11% (1.1560 => 1.1316, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.10% (20.3410 => 19.9143, std. dev.: 0.0824) SingleSource/Benchmarks/Shootout/lists: -2.00% (6.3560 => 6.2286, std. dev.: 0.0050) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.91% (6.6320 => 6.5050, std. dev.: 0.0044) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6929, std. dev.: 0.0009) MultiSource/Applications/minisat/minisat: -1.81% (9.3358 => 9.1665, std. dev.: 0.0353) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9952, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.56% (0.9692 => 0.9541, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.54% (3.9173 => 3.8571, std. dev.: 0.0178) MultiSource/Applications/lua/lua: -1.28% (26.5159 => 26.1759, std. dev.: 0.0210) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.34s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed May 16 12:25:35 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 16 May 2012 14:25:35 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120516192535.EBAF92A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/678?compare_to=677&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 678, Order: 156930, Start Time: 2012-05-16 18:29:53, End Time: 2012-05-16 19:26:24 To: 677, Order: 156923, Start Time: 2012-05-16 17:06:27, End Time: 2012-05-16 18:02:58 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (58 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (790 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.41% (2.0176 => 2.2881, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.12% (0.3130 => 0.3353, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.12% (0.2721 => 0.2833, std. dev.: 0.0016) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.63% (3.9660 => 4.1098, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.13% (0.5265 => 0.5430, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.12% (0.6959 => 0.7176, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 3.00% (1.0594 => 1.0912, std. dev.: 0.0026) MultiSource/Applications/SPASS/SPASS: 2.92% (13.8202 => 14.2232, std. dev.: 0.0163) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.87% (0.9199 => 0.9463, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.66% (0.5637 => 0.5787, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.59% (1.1364 => 1.1658, std. dev.: 0.0022) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.57% (0.7710 => 0.7908, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/hash2: 2.40% (0.4328 => 0.4432, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.39% (1.2193 => 1.2485, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.36% (1.4563 => 1.4906, std. dev.: 0.0033) MultiSource/Applications/siod/siod: 2.35% (2.1791 => 2.2302, std. dev.: 0.0172) MultiSource/Applications/kimwitu++/kc: 2.33% (16.6129 => 17.0007, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.22% (0.5577 => 0.5701, std. dev.: 0.0010) MultiSource/Applications/Burg/burg: 2.21% (1.1061 => 1.1306, std. dev.: 0.0024) MultiSource/Benchmarks/MallocBench/gs/gs: 2.05% (3.8646 => 3.9440, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.96% (1.3245 => 1.3505, std. dev.: 0.0005) MultiSource/Applications/treecc/treecc: 1.95% (1.9270 => 1.9646, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.90% (13.2842 => 13.5368, std. dev.: 0.0139) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.85% (0.7460 => 0.7598, std. dev.: 0.0007) MultiSource/Applications/hbd/hbd: 1.69% (1.3693 => 1.3925, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.63% (1.3819 => 1.4044, std. dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: 1.57% (16.2614 => 16.5169, std. dev.: 0.0347) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.54% (1.3813 => 1.4026, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.42% (2.1007 => 2.1306, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.40% (3.6692 => 3.7204, std. dev.: 0.0035) MultiSource/Applications/SIBsim4/SIBsim4: 1.26% (1.2749 => 1.2910, std. dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 1.11% (14.8535 => 15.0184, std. dev.: 0.0157) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.06% (3.2742 => 3.3089, std. dev.: 0.0011) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.28% (1.8175 => 2.2587, std. dev.: 0.0420) SingleSource/Benchmarks/Misc/mandel-2: 6.58% (1.2998 => 1.3853, std. dev.: 0.0200) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.86% (1.5824 => 1.6752, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.81% (1.9144 => 1.9874, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: 3.67% (7.4271 => 7.6998, std. dev.: 0.0051) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.65% (1.7688 => 1.8333, std. dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 3.16% (11.2619 => 11.6176, std. dev.: 0.0026) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 3.12% (8.8259 => 9.1009, std. dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 3.01% (12.0921 => 12.4557, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: 2.79% (1.9199 => 1.9735, std. dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9393, std. dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.33% (7.9275 => 8.1121, std. dev.: 0.0124) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9603, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/ffbench: 1.58% (0.8273 => 0.8404, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.39% (1.4298 => 1.4497, std. dev.: 0.0010) MultiSource/Benchmarks/NPB-serial/is/is: 1.39% (8.3908 => 8.5071, std. dev.: 0.0040) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.27% (2.0200 => 2.0457, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) MultiSource/Benchmarks/sim/sim: 1.14% (5.0168 => 5.0740, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 1.13% (9.0760 => 9.1786, std. dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: 1.00% (4.5928 => 4.6389, std. dev.: 0.0021) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -19.65% (0.4657 => 0.3742, std. dev.: 0.0328) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.12% (0.2670 => 0.2480, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.35% (0.3511 => 0.3288, std. dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.00% (22.5627 => 21.2093, std. dev.: 0.0107) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.61% (0.8818 => 0.8500, std. dev.: 0.0022) SingleSource/UnitTests/ObjC/exceptions-3: -3.39% (0.3623 => 0.3500, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.34% (0.3650 => 0.3528, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-2: -3.30% (0.3601 => 0.3482, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -3.28% (0.3663 => 0.3543, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -3.26% (0.3646 => 0.3527, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -3.24% (0.3578 => 0.3462, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: -3.12% (0.3940 => 0.3817, std. dev.: 0.0020) SingleSource/UnitTests/ObjC/for-in: -3.04% (0.3789 => 0.3674, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -2.91% (0.3914 => 0.3800, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -2.77% (0.4003 => 0.3892, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.40% (0.6576 => 0.6418, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/bigfib: -1.87% (0.6250 => 0.6133, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.26% (0.9108 => 0.8993, std. dev.: 0.0005) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -9.83% (1.2308 => 1.1098, std. dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.59% (0.3139 => 0.2932, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.05% (1.3780 => 1.3084, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9472, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -3.97% (2.5089 => 2.4092, std. dev.: 0.0038) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.59% (1.9762 => 1.9053, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/richards_benchmark: -2.15% (1.1560 => 1.1312, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.11% (20.3410 => 19.9109, std. dev.: 0.0902) SingleSource/Benchmarks/Shootout/lists: -2.07% (6.3560 => 6.2242, std. dev.: 0.0087) MultiSource/Applications/minisat/minisat: -2.01% (9.3358 => 9.1482, std. dev.: 0.0050) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6916, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.87% (6.6320 => 6.5083, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9954, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.56% (0.9692 => 0.9541, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.53% (3.9173 => 3.8574, std. dev.: 0.0113) MultiSource/Applications/lua/lua: -1.27% (26.5159 => 26.1793, std. dev.: 0.0236) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.45s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed May 16 13:49:18 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 16 May 2012 15:49:18 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120516204918.8C5132A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/679?compare_to=678&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 679, Order: 156935, Start Time: 2012-05-16 19:53:30, End Time: 2012-05-16 20:50:02 To: 678, Order: 156930, Start Time: 2012-05-16 18:29:53, End Time: 2012-05-16 19:26:24 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (60 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 891 (788 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 2.00% (1.3853 => 1.4130, std. dev.: 0.0011) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.45% (2.0176 => 2.2688, std. dev.: 0.0161) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.06% (0.3130 => 0.3351, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.93% (0.2721 => 0.2828, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.35% (3.9660 => 4.0989, std. dev.: 0.0097) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.10% (0.6959 => 0.7175, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.10% (0.5265 => 0.5428, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.02% (0.9199 => 0.9477, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 3.02% (1.0594 => 1.0914, std. dev.: 0.0020) MultiSource/Applications/SPASS/SPASS: 2.96% (13.8202 => 14.2294, std. dev.: 0.0089) MultiSource/Benchmarks/Prolangs-C/football/football: 2.83% (0.8310 => 0.8545, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.77% (0.5637 => 0.5793, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.75% (0.7710 => 0.7922, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.52% (1.2193 => 1.2500, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.52% (1.1364 => 1.1650, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/hash2: 2.40% (0.4328 => 0.4432, std. dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 2.38% (16.6129 => 17.0084, std. dev.: 0.0237) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.31% (0.5577 => 0.5706, std. dev.: 0.0008) MultiSource/Applications/siod/siod: 2.29% (2.1791 => 2.2289, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.20% (1.4563 => 1.4884, std. dev.: 0.0049) MultiSource/Applications/lambda-0_1_3/lambda: 2.09% (0.7038 => 0.7185, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 2.08% (3.8646 => 3.9448, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 2.02% (1.1061 => 1.1284, std. dev.: 0.0025) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.01% (0.7460 => 0.7610, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.01% (1.3245 => 1.3511, std. dev.: 0.0008) MultiSource/Applications/treecc/treecc: 1.96% (1.9270 => 1.9647, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.91% (13.2842 => 13.5378, std. dev.: 0.0069) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.73% (1.3813 => 1.4052, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.72% (1.3819 => 1.4056, std. dev.: 0.0008) MultiSource/Applications/hbd/hbd: 1.61% (1.3693 => 1.3914, std. dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: 1.52% (16.2614 => 16.5082, std. dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.40% (2.1007 => 2.1302, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.40% (3.6692 => 3.7207, std. dev.: 0.0084) MultiSource/Applications/SIBsim4/SIBsim4: 1.31% (1.2749 => 1.2916, std. dev.: 0.0049) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.21% (3.2742 => 3.3139, std. dev.: 0.0153) MultiSource/Applications/JM/lencod/lencod: 1.21% (14.8535 => 15.0331, std. dev.: 0.0049) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.14% (1.8175 => 2.2562, std. dev.: 0.0220) SingleSource/Benchmarks/Misc/mandel-2: 8.71% (1.2998 => 1.4130, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.89% (1.5824 => 1.6756, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9878, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.69% (1.7688 => 1.8341, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/salsa20: 3.63% (7.4271 => 7.6970, std. dev.: 0.0030) MultiSource/Benchmarks/nbench/nbench: 3.12% (11.2619 => 11.6137, std. dev.: 0.0056) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4552, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-6: 2.94% (1.9199 => 1.9764, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9393, std. dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.60% (8.8259 => 9.0553, std. dev.: 0.0294) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.37% (7.9275 => 8.1151, std. dev.: 0.0085) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.61% (0.8273 => 0.8406, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.60% (1.9290 => 1.9599, std. dev.: 0.0011) MultiSource/Applications/lemon/lemon: 1.49% (1.4298 => 1.4511, std. dev.: 0.0028) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5102, std. dev.: 0.0036) MultiSource/Benchmarks/Olden/bisort/bisort: 1.29% (0.8239 => 0.8345, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.28% (2.0200 => 2.0458, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1778, std. dev.: 0.0008) MultiSource/Benchmarks/sim/sim: 1.03% (5.0168 => 5.0684, std. dev.: 0.0135) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -18.14% (0.4657 => 0.3812, std. dev.: 0.0305) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.57% (0.2670 => 0.2468, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.64% (0.3511 => 0.3278, std. dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.26% (22.5627 => 21.1512, std. dev.: 0.0211) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.45% (0.3650 => 0.3524, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-2: -3.42% (0.3601 => 0.3478, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: -3.39% (0.3623 => 0.3500, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: -3.33% (0.3663 => 0.3541, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: -3.32% (0.3646 => 0.3525, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: -3.24% (0.3578 => 0.3462, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/for-in: -3.19% (0.3789 => 0.3668, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/property: -3.12% (0.3940 => 0.3817, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.12% (0.8818 => 0.8543, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions: -2.81% (0.3914 => 0.3804, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/parameter-passing: -2.70% (0.4003 => 0.3895, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.33% (0.6576 => 0.6423, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: -1.92% (0.6250 => 0.6130, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -10.32% (1.2308 => 1.1038, std. dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.56% (0.3139 => 0.2933, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9471, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.45% (1.3780 => 1.3167, std. dev.: 0.0027) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -4.06% (2.5089 => 2.4070, std. dev.: 0.0015) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.67% (1.9762 => 1.9036, std. dev.: 0.0039) SingleSource/Benchmarks/Misc/richards_benchmark: -2.15% (1.1560 => 1.1312, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -2.02% (6.3560 => 6.2273, std. dev.: 0.0072) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.99% (20.3410 => 19.9367, std. dev.: 0.0696) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6911, std. dev.: 0.0023) MultiSource/Applications/minisat/minisat: -1.88% (9.3358 => 9.1603, std. dev.: 0.0032) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.84% (6.6320 => 6.5100, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3446, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9951, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.17% (3.9173 => 3.8715, std. dev.: 0.0015) MultiSource/Applications/lua/lua: -1.05% (26.5159 => 26.2383, std. dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.00% (3.8887 => 3.8498, std. dev.: 0.0034) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.56s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed May 16 15:12:49 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 16 May 2012 17:12:49 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120516221249.0486C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/680?compare_to=679&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 680, Order: 156942, Start Time: 2012-05-16 21:17:07, End Time: 2012-05-16 22:13:37 To: 679, Order: 156935, Start Time: 2012-05-16 19:53:30, End Time: 2012-05-16 20:50:02 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (63 on baseline) Performance Improvements: 0 (41 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (784 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.90% (2.0176 => 2.2778, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.16% (0.3130 => 0.3354, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.08% (0.2721 => 0.2832, std. dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.63% (3.9660 => 4.1101, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.21% (0.5265 => 0.5434, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.10% (0.6959 => 0.7175, std. dev.: 0.0018) MultiSource/Benchmarks/nbench/nbench: 3.08% (1.0594 => 1.0920, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 3.06% (13.8202 => 14.2432, std. dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.99% (0.9199 => 0.9474, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/football/football: 2.79% (0.8310 => 0.8542, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.79% (0.5637 => 0.5794, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.76% (0.5577 => 0.5731, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.67% (1.2193 => 1.2518, std. dev.: 0.0023) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.54% (1.1364 => 1.1653, std. dev.: 0.0009) MultiSource/Applications/kimwitu++/kc: 2.43% (16.6129 => 17.0164, std. dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/hash2: 2.43% (0.4328 => 0.4433, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.40% (1.4563 => 1.4912, std. dev.: 0.0019) MultiSource/Applications/siod/siod: 2.31% (2.1791 => 2.2294, std. dev.: 0.0064) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.26% (0.7710 => 0.7884, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.20% (1.3245 => 1.3537, std. dev.: 0.0069) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.14% (0.7460 => 0.7620, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/gs/gs: 2.13% (3.8646 => 3.9471, std. dev.: 0.0100) MultiSource/Applications/lambda-0_1_3/lambda: 2.09% (0.7038 => 0.7185, std. dev.: 0.0005) MultiSource/Applications/Burg/burg: 2.06% (1.1061 => 1.1289, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.06% (13.2842 => 13.5573, std. dev.: 0.0160) MultiSource/Applications/treecc/treecc: 1.95% (1.9270 => 1.9645, std. dev.: 0.0013) MultiSource/Applications/hbd/hbd: 1.86% (1.3693 => 1.3948, std. dev.: 0.0029) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.83% (1.3813 => 1.4066, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.76% (1.3819 => 1.4062, std. dev.: 0.0016) MultiSource/Applications/sqlite3/sqlite3: 1.70% (16.2614 => 16.5378, std. dev.: 0.0286) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.51% (3.6692 => 3.7245, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.45% (2.1007 => 2.1312, std. dev.: 0.0008) MultiSource/Applications/spiff/spiff: 1.33% (0.7506 => 0.7606, std. dev.: 0.0019) MultiSource/Applications/SIBsim4/SIBsim4: 1.31% (1.2749 => 1.2916, std. dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 1.21% (14.8535 => 15.0339, std. dev.: 0.0117) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.11% (1.5188 => 1.5357, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.08% (1.1333 => 1.1455, std. dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 1.01% (6.5754 => 6.6421, std. dev.: 0.0111) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.00% (3.2742 => 3.3070, std. dev.: 0.0088) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 25.06% (1.8175 => 2.2730, std. dev.: 0.0402) SingleSource/Benchmarks/Misc/mandel-2: 7.57% (1.2998 => 1.3982, std. dev.: 0.0187) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.90% (1.5824 => 1.6758, std. dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8149, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.80% (1.9144 => 1.9872, std. dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.62% (1.7688 => 1.8328, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: 3.62% (7.4271 => 7.6958, std. dev.: 0.0062) MultiSource/Benchmarks/nbench/nbench: 3.13% (11.2619 => 11.6140, std. dev.: 0.0041) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4539, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-6: 2.86% (1.9199 => 1.9748, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.82% (8.8259 => 9.0744, std. dev.: 0.0114) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9393, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.27% (7.9275 => 8.1076, std. dev.: 0.0192) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.61% (0.8273 => 0.8406, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 1.50% (5.0168 => 5.0920, std. dev.: 0.0028) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5103, std. dev.: 0.0076) MultiSource/Applications/lemon/lemon: 1.33% (1.4298 => 1.4488, std. dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.29% (2.0200 => 2.0460, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1777, std. dev.: 0.0031) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -19.15% (0.4657 => 0.3765, std. dev.: 0.0043) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.30% (0.2670 => 0.2475, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.64% (0.3511 => 0.3278, std. dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.09% (22.5627 => 21.1879, std. dev.: 0.0046) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.31% (0.8818 => 0.8526, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-3: -3.09% (0.3623 => 0.3511, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -3.03% (0.3601 => 0.3492, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -2.99% (0.3646 => 0.3537, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -2.96% (0.3650 => 0.3542, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/synchronized: -2.95% (0.3663 => 0.3555, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: -2.82% (0.3578 => 0.3477, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -2.74% (0.3940 => 0.3832, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -2.72% (0.3789 => 0.3686, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: -2.57% (0.4003 => 0.3900, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -2.55% (0.3914 => 0.3814, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.14% (0.6576 => 0.6435, std. dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/bigfib: -1.68% (0.6250 => 0.6145, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.12% (0.9108 => 0.9006, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -10.00% (1.2308 => 1.1077, std. dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.16% (1.0460 => 0.9502, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.44% (0.3139 => 0.2937, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/flops-3: -6.28% (2.4152 => 2.2636, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9473, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.70% (1.3780 => 1.3133, std. dev.: 0.0058) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -4.03% (2.5089 => 2.4079, std. dev.: 0.0014) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.59% (1.9762 => 1.9052, std. dev.: 0.0087) SingleSource/Benchmarks/Shootout/lists: -2.32% (6.3560 => 6.2086, std. dev.: 0.0132) SingleSource/Benchmarks/Misc/richards_benchmark: -2.13% (1.1560 => 1.1314, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: -1.97% (9.3358 => 9.1522, std. dev.: 0.0279) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.94% (20.3410 => 19.9468, std. dev.: 0.0260) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.92% (6.6320 => 6.5046, std. dev.: 0.0032) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6915, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3444, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9956, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.37% (3.9173 => 3.8638, std. dev.: 0.0076) MultiSource/Applications/lua/lua: -1.32% (26.5159 => 26.1646, std. dev.: 0.0168) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.03% (3.8887 => 3.8487, std. dev.: 0.0003) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.48s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed May 16 16:36:23 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 16 May 2012 18:36:23 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120516233623.51EB62A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/681?compare_to=680&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 681, Order: 156955, Start Time: 2012-05-16 22:40:33, End Time: 2012-05-16 23:37:12 To: 680, Order: 156942, Start Time: 2012-05-16 21:17:07, End Time: 2012-05-16 22:13:37 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (71 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (778 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.50% (2.0176 => 2.2899, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.67% (0.3130 => 0.3370, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.45% (0.2721 => 0.2842, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.86% (3.9660 => 4.1190, std. dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.76% (0.6959 => 0.7221, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.59% (0.5265 => 0.5454, std. dev.: 0.0027) MultiSource/Applications/SPASS/SPASS: 3.57% (13.8202 => 14.3130, std. dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.37% (0.9199 => 0.9509, std. dev.: 0.0037) MultiSource/Benchmarks/nbench/nbench: 3.36% (1.0594 => 1.0950, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/football/football: 3.18% (0.8310 => 0.8574, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.07% (1.1364 => 1.1713, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.07% (0.5637 => 0.5810, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.94% (1.2193 => 1.2552, std. dev.: 0.0009) MultiSource/Applications/siod/siod: 2.82% (2.1791 => 2.2406, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.71% (0.5577 => 0.5728, std. dev.: 0.0008) MultiSource/Applications/kimwitu++/kc: 2.68% (16.6129 => 17.0587, std. dev.: 0.0173) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.61% (1.4563 => 1.4943, std. dev.: 0.0027) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.54% (0.7710 => 0.7906, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/hash2: 2.54% (0.4328 => 0.4438, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 2.52% (3.8646 => 3.9618, std. dev.: 0.0041) MultiSource/Applications/treecc/treecc: 2.50% (1.9270 => 1.9751, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.49% (1.3245 => 1.3575, std. dev.: 0.0040) MultiSource/Applications/lambda-0_1_3/lambda: 2.47% (0.7038 => 0.7212, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.39% (0.7460 => 0.7638, std. dev.: 0.0026) MultiSource/Applications/Burg/burg: 2.30% (1.1061 => 1.1315, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.26% (13.2842 => 13.5846, std. dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.25% (0.4791 => 0.4899, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 2.25% (1.3693 => 1.4001, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.06% (1.3819 => 1.4104, std. dev.: 0.0029) MultiSource/Applications/sqlite3/sqlite3: 2.05% (16.2614 => 16.5942, std. dev.: 0.0060) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.78% (3.6692 => 3.7344, std. dev.: 0.0045) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.76% (1.3813 => 1.4056, std. dev.: 0.0014) MultiSource/Applications/SIBsim4/SIBsim4: 1.73% (1.2749 => 1.2969, std. dev.: 0.0013) MultiSource/Applications/spiff/spiff: 1.72% (0.7506 => 0.7635, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.69% (2.1007 => 2.1363, std. dev.: 0.0071) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.67% (0.6283 => 0.6388, std. dev.: 0.0020) MultiSource/Applications/minisat/minisat: 1.63% (0.6744 => 0.6854, std. dev.: 0.0011) MultiSource/Applications/JM/lencod/lencod: 1.53% (14.8535 => 15.0805, std. dev.: 0.0062) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.45% (3.2742 => 3.3216, std. dev.: 0.0099) MultiSource/Applications/d/make_dparser: 1.38% (3.1889 => 3.2328, std. dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.34% (1.5188 => 1.5392, std. dev.: 0.0011) MultiSource/Applications/JM/ldecod/ldecod: 1.31% (6.5754 => 6.6615, std. dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.31% (1.1333 => 1.1481, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.23% (7.2180 => 7.3070, std. dev.: 0.0048) MultiSource/Applications/lemon/lemon: 1.07% (1.0313 => 1.0423, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 1.00% (1.2292 => 1.2415, std. dev.: 0.0020) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.12% (1.8175 => 2.2559, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/mandel-2: 8.36% (1.2998 => 1.4084, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.90% (1.5824 => 1.6757, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.87% (1.9144 => 1.9884, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.70% (1.7688 => 1.8343, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: 3.60% (7.4271 => 7.6944, std. dev.: 0.0087) MultiSource/Benchmarks/nbench/nbench: 3.16% (11.2619 => 11.6180, std. dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4547, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-6: 2.94% (1.9199 => 1.9764, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.86% (8.8259 => 9.0784, std. dev.: 0.0068) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.74% (2.8606 => 2.9390, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.48% (7.9275 => 8.1238, std. dev.: 0.0061) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9601, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 1.61% (0.8273 => 0.8406, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.43% (1.4298 => 1.4503, std. dev.: 0.0071) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.41% (1.9433 => 1.9707, std. dev.: 0.0039) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5087, std. dev.: 0.0005) MultiSource/Benchmarks/sim/sim: 1.25% (5.0168 => 5.0797, std. dev.: 0.0082) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.25% (2.0200 => 2.0453, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 1.11% (9.0760 => 9.1764, std. dev.: 0.0008) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -20.25% (0.4657 => 0.3714, std. dev.: 0.0036) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.27% (0.2670 => 0.2476, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.47% (0.3511 => 0.3284, std. dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.69% (22.5627 => 21.2778, std. dev.: 0.0126) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.15% (0.3650 => 0.3535, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-3: -3.15% (0.3623 => 0.3509, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -3.14% (0.3601 => 0.3488, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -3.06% (0.3663 => 0.3551, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -3.02% (0.3578 => 0.3470, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -3.02% (0.3646 => 0.3536, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.95% (0.8818 => 0.8558, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/property: -2.87% (0.3940 => 0.3827, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -2.82% (0.3789 => 0.3682, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -2.63% (0.3914 => 0.3811, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -2.60% (0.4003 => 0.3899, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.16% (0.6576 => 0.6434, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: -1.60% (0.6250 => 0.6150, std. dev.: 0.0005) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -9.99% (1.2308 => 1.1079, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0007) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.59% (0.3139 => 0.2932, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2640, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9473, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.56% (1.3780 => 1.3152, std. dev.: 0.0026) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.94% (2.5089 => 2.4100, std. dev.: 0.0031) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.62% (1.9762 => 1.9046, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout/lists: -2.25% (6.3560 => 6.2127, std. dev.: 0.0101) SingleSource/Benchmarks/Misc/richards_benchmark: -2.11% (1.1560 => 1.1316, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -2.00% (6.6320 => 6.4994, std. dev.: 0.0055) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6916, std. dev.: 0.0017) MultiSource/Applications/minisat/minisat: -1.82% (9.3358 => 9.1661, std. dev.: 0.0168) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3446, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.61% (20.3410 => 20.0134, std. dev.: 0.0214) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9953, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.56% (0.9692 => 0.9541, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.52% (3.9173 => 3.8577, std. dev.: 0.0192) MultiSource/Applications/lua/lua: -1.42% (26.5159 => 26.1403, std. dev.: 0.0496) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.45s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed May 16 17:59:53 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 16 May 2012 19:59:53 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120517005953.290CC2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/682?compare_to=681&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 682, Order: 156960, Start Time: 2012-05-17 00:04:06, End Time: 2012-05-17 01:00:41 To: 681, Order: 156955, Start Time: 2012-05-16 22:40:33, End Time: 2012-05-16 23:37:12 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (67 on baseline) Performance Improvements: 0 (38 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (783 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.29% (2.0176 => 2.2858, std. dev.: 0.0141) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.41% (0.3130 => 0.3362, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.34% (0.2721 => 0.2839, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.67% (3.9660 => 4.1116, std. dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.49% (0.6959 => 0.7202, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.48% (0.5265 => 0.5448, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 3.21% (1.0594 => 1.0934, std. dev.: 0.0014) MultiSource/Applications/SPASS/SPASS: 3.20% (13.8202 => 14.2630, std. dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.17% (0.9199 => 0.9491, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 3.09% (0.8310 => 0.8567, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.00% (0.5637 => 0.5806, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.91% (1.1364 => 1.1695, std. dev.: 0.0057) MultiSource/Applications/siod/siod: 2.82% (2.1791 => 2.2405, std. dev.: 0.0154) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.78% (1.2193 => 1.2532, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.71% (1.4563 => 1.4958, std. dev.: 0.0057) MultiSource/Applications/kimwitu++/kc: 2.68% (16.6129 => 17.0573, std. dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.46% (0.5577 => 0.5714, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/gs/gs: 2.43% (3.8646 => 3.9585, std. dev.: 0.0076) MultiSource/Applications/Burg/burg: 2.42% (1.1061 => 1.1329, std. dev.: 0.0021) MultiSource/Applications/lambda-0_1_3/lambda: 2.40% (0.7038 => 0.7207, std. dev.: 0.0020) MultiSource/Applications/treecc/treecc: 2.38% (1.9270 => 1.9729, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.34% (1.3245 => 1.3555, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 2.33% (0.4328 => 0.4429, std. dev.: 0.0035) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.28% (0.7710 => 0.7886, std. dev.: 0.0052) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.23% (0.7460 => 0.7626, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.21% (13.2842 => 13.5779, std. dev.: 0.0285) MultiSource/Applications/sqlite3/sqlite3: 2.00% (16.2614 => 16.5870, std. dev.: 0.0208) MultiSource/Applications/hbd/hbd: 2.00% (1.3693 => 1.3967, std. dev.: 0.0095) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.80% (1.3813 => 1.4061, std. dev.: 0.0044) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.70% (1.3819 => 1.4054, std. dev.: 0.0036) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.68% (3.6692 => 3.7307, std. dev.: 0.0110) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.61% (0.6283 => 0.6384, std. dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 1.58% (1.2749 => 1.2950, std. dev.: 0.0008) MultiSource/Applications/minisat/minisat: 1.56% (0.6744 => 0.6849, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.50% (2.1007 => 2.1322, std. dev.: 0.0017) MultiSource/Applications/spiff/spiff: 1.48% (0.7506 => 0.7617, std. dev.: 0.0037) MultiSource/Applications/JM/lencod/lencod: 1.38% (14.8535 => 15.0590, std. dev.: 0.0144) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.26% (1.5188 => 1.5380, std. dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.21% (7.2180 => 7.3051, std. dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.20% (3.2742 => 3.3135, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.17% (1.1333 => 1.1466, std. dev.: 0.0050) MultiSource/Applications/JM/ldecod/ldecod: 1.16% (6.5754 => 6.6515, std. dev.: 0.0140) MultiSource/Applications/d/make_dparser: 1.15% (3.1889 => 3.2256, std. dev.: 0.0019) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.16% (1.8175 => 2.2566, std. dev.: 0.0350) SingleSource/Benchmarks/Misc/mandel-2: 8.08% (1.2998 => 1.4048, std. dev.: 0.0096) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7298, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.90% (1.5824 => 1.6758, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9882, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.75% (1.7688 => 1.8352, std. dev.: 0.0170) SingleSource/Benchmarks/Misc/salsa20: 3.66% (7.4271 => 7.6990, std. dev.: 0.0062) MultiSource/Benchmarks/nbench/nbench: 3.14% (11.2619 => 11.6152, std. dev.: 0.0041) MultiSource/Applications/hexxagon/hexxagon: 2.98% (12.0921 => 12.4530, std. dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.97% (8.8259 => 9.0882, std. dev.: 0.0104) SingleSource/Benchmarks/Misc/flops-6: 2.90% (1.9199 => 1.9755, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9392, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.28% (7.9275 => 8.1084, std. dev.: 0.0143) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9601, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/ffbench: 1.54% (0.8273 => 0.8400, std. dev.: 0.0004) MultiSource/Applications/lemon/lemon: 1.44% (1.4298 => 1.4504, std. dev.: 0.0008) MultiSource/Benchmarks/NPB-serial/is/is: 1.39% (8.3908 => 8.5077, std. dev.: 0.0037) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.28% (2.0200 => 2.0459, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2135, std. dev.: 0.0035) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.17% (1.9433 => 1.9660, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: 1.10% (9.0760 => 9.1761, std. dev.: 0.0016) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -21.41% (0.4657 => 0.3660, std. dev.: 0.0102) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.30% (0.2670 => 0.2475, std. dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.35% (0.3511 => 0.3288, std. dev.: 0.0040) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.85% (22.5627 => 21.2434, std. dev.: 0.0069) SingleSource/UnitTests/ObjC/exceptions-3: -3.53% (0.3623 => 0.3495, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -3.42% (0.3601 => 0.3478, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -3.40% (0.3646 => 0.3522, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.40% (0.3650 => 0.3526, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -3.33% (0.3663 => 0.3541, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.27% (0.8818 => 0.8530, std. dev.: 0.0016) SingleSource/UnitTests/ObjC/trivial-interface: -3.24% (0.3578 => 0.3462, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -3.19% (0.3789 => 0.3668, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -3.07% (0.3940 => 0.3819, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -2.94% (0.3914 => 0.3799, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.55% (0.6576 => 0.6408, std. dev.: 0.0014) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -10.09% (1.2308 => 1.1066, std. dev.: 0.0054) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.53% (0.3139 => 0.2934, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9473, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -4.07% (2.5089 => 2.4068, std. dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.88% (1.3780 => 1.3245, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.73% (0.3458 => 0.3329, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.64% (1.9762 => 1.9042, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout/lists: -2.36% (6.3560 => 6.2061, std. dev.: 0.0133) SingleSource/Benchmarks/Misc/richards_benchmark: -2.12% (1.1560 => 1.1315, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.99% (20.3410 => 19.9355, std. dev.: 0.0505) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.94% (6.6320 => 6.5031, std. dev.: 0.0038) MultiSource/Applications/minisat/minisat: -1.91% (9.3358 => 9.1579, std. dev.: 0.0357) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6918, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9956, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.44% (3.9173 => 3.8608, std. dev.: 0.0045) MultiSource/Applications/lua/lua: -1.29% (26.5159 => 26.1726, std. dev.: 0.0234) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.04% (3.8887 => 3.8481, std. dev.: 0.0053) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.58s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed May 16 19:23:28 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 16 May 2012 21:23:28 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120517022328.5A6FA2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/683?compare_to=682&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 683, Order: 156968, Start Time: 2012-05-17 01:27:40, End Time: 2012-05-17 02:24:17 To: 682, Order: 156960, Start Time: 2012-05-17 00:04:06, End Time: 2012-05-17 01:00:41 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (64 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (785 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.74% (2.0176 => 2.2948, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.32% (0.3130 => 0.3359, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.34% (0.2721 => 0.2839, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.70% (3.9660 => 4.1127, std. dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.42% (0.6959 => 0.7197, std. dev.: 0.0026) MultiSource/Benchmarks/nbench/nbench: 3.23% (1.0594 => 1.0936, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 3.21% (13.8202 => 14.2640, std. dev.: 0.0099) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.21% (0.5265 => 0.5434, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.13% (0.9199 => 0.9487, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/football/football: 3.12% (0.8310 => 0.8569, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.81% (1.1364 => 1.1683, std. dev.: 0.0008) MultiSource/Applications/siod/siod: 2.76% (2.1791 => 2.2393, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.71% (1.2193 => 1.2524, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.63% (0.5637 => 0.5785, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.56% (1.4563 => 1.4936, std. dev.: 0.0013) MultiSource/Applications/kimwitu++/kc: 2.56% (16.6129 => 17.0375, std. dev.: 0.0116) MultiSource/Applications/lambda-0_1_3/lambda: 2.54% (0.7038 => 0.7217, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: 2.38% (3.8646 => 3.9567, std. dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.28% (0.4791 => 0.4900, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.26% (0.5577 => 0.5703, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.24% (1.3245 => 1.3542, std. dev.: 0.0070) MultiSource/Applications/Burg/burg: 2.20% (1.1061 => 1.1304, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.20% (13.2842 => 13.5760, std. dev.: 0.0025) MultiSource/Applications/treecc/treecc: 2.17% (1.9270 => 1.9688, std. dev.: 0.0102) MultiSource/Applications/sqlite3/sqlite3: 2.08% (16.2614 => 16.5990, std. dev.: 0.0292) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.01% (0.7460 => 0.7610, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.00% (0.7710 => 0.7864, std. dev.: 0.0009) MultiSource/Applications/hbd/hbd: 1.86% (1.3693 => 1.3948, std. dev.: 0.0060) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.71% (2.1007 => 2.1367, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.68% (1.3819 => 1.4051, std. dev.: 0.0018) MultiSource/Applications/SIBsim4/SIBsim4: 1.64% (1.2749 => 1.2958, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.62% (0.6283 => 0.6385, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.53% (3.6692 => 3.7253, std. dev.: 0.0066) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.51% (1.3813 => 1.4022, std. dev.: 0.0017) MultiSource/Applications/minisat/minisat: 1.51% (0.6744 => 0.6846, std. dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 1.35% (14.8535 => 15.0539, std. dev.: 0.0110) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.33% (1.5188 => 1.5390, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.32% (3.2742 => 3.3175, std. dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.17% (1.1333 => 1.1466, std. dev.: 0.0010) MultiSource/Applications/d/make_dparser: 1.13% (3.1889 => 3.2250, std. dev.: 0.0011) MultiSource/Applications/JM/ldecod/ldecod: 1.12% (6.5754 => 6.6493, std. dev.: 0.0035) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.26% (1.8175 => 2.2584, std. dev.: 0.0169) SingleSource/Benchmarks/Misc/mandel-2: 7.30% (1.2998 => 1.3947, std. dev.: 0.0090) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.89% (1.5824 => 1.6756, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8146, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 3.81% (1.9144 => 1.9873, std. dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.72% (1.7688 => 1.8346, std. dev.: 0.0059) SingleSource/Benchmarks/Misc/salsa20: 3.66% (7.4271 => 7.6989, std. dev.: 0.0065) MultiSource/Benchmarks/nbench/nbench: 3.17% (11.2619 => 11.6190, std. dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: 3.01% (12.0921 => 12.4559, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/flops-6: 2.82% (1.9199 => 1.9740, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9393, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.67% (8.8259 => 9.0612, std. dev.: 0.0198) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.23% (7.9275 => 8.1042, std. dev.: 0.0174) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.60% (0.8273 => 0.8405, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.52% (1.4298 => 1.4515, std. dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5085, std. dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.28% (2.0200 => 2.0459, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1777, std. dev.: 0.0012) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -21.97% (0.4657 => 0.3634, std. dev.: 0.0071) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.19% (0.2670 => 0.2478, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.44% (0.3511 => 0.3285, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.79% (22.5627 => 21.2569, std. dev.: 0.0134) SingleSource/UnitTests/ObjC/exceptions-3: -4.58% (0.3623 => 0.3457, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -4.53% (0.3601 => 0.3438, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.52% (0.3650 => 0.3485, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/trivial-interface: -4.44% (0.3578 => 0.3419, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -4.44% (0.3646 => 0.3484, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -4.42% (0.3663 => 0.3501, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -4.25% (0.3789 => 0.3628, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/property: -4.11% (0.3940 => 0.3778, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -3.93% (0.3914 => 0.3760, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -3.77% (0.4003 => 0.3852, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.21% (0.8818 => 0.8535, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.89% (0.6576 => 0.6386, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: -1.95% (0.6250 => 0.6128, std. dev.: 0.0006) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -10.41% (1.2308 => 1.1027, std. dev.: 0.0060) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.53% (0.3139 => 0.2934, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2641, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9474, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.46% (1.3780 => 1.3165, std. dev.: 0.0067) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -3.96% (2.5089 => 2.4096, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -3.63% (1.9762 => 1.9045, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -2.28% (6.3560 => 6.2110, std. dev.: 0.0130) SingleSource/Benchmarks/Misc/richards_benchmark: -2.15% (1.1560 => 1.1312, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: -1.96% (9.3358 => 9.1531, std. dev.: 0.0140) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.95% (20.3410 => 19.9446, std. dev.: 0.0376) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6908, std. dev.: 0.0033) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.88% (6.6320 => 6.5072, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3444, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9958, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.39% (3.9173 => 3.8627, std. dev.: 0.0139) MultiSource/Applications/lua/lua: -1.32% (26.5159 => 26.1667, std. dev.: 0.0131) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.49s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed May 16 22:05:36 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 17 May 2012 00:05:36 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120517050536.787F52A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/684?compare_to=683&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 684, Order: 156973, Start Time: 2012-05-17 04:09:51, End Time: 2012-05-17 05:06:25 To: 683, Order: 156968, Start Time: 2012-05-17 01:27:40, End Time: 2012-05-17 02:24:17 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (63 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 891 (785 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 1.53% (7.9445 => 8.0661, std. dev.: 0.0101) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.69% (2.0176 => 2.2939, std. dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.25% (0.3130 => 0.3357, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.56% (0.2721 => 0.2845, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.73% (3.9660 => 4.1138, std. dev.: 0.0042) MultiSource/Benchmarks/nbench/nbench: 3.33% (1.0594 => 1.0947, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.25% (0.6959 => 0.7185, std. dev.: 0.0019) MultiSource/Applications/SPASS/SPASS: 3.17% (13.8202 => 14.2581, std. dev.: 0.0141) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.10% (0.5265 => 0.5428, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/football/football: 3.01% (0.8310 => 0.8560, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.98% (0.9199 => 0.9473, std. dev.: 0.0016) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.81% (1.1364 => 1.1683, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.77% (0.5637 => 0.5793, std. dev.: 0.0012) MultiSource/Applications/siod/siod: 2.72% (2.1791 => 2.2384, std. dev.: 0.0176) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.70% (1.2193 => 1.2522, std. dev.: 0.0014) MultiSource/Applications/kimwitu++/kc: 2.54% (16.6129 => 17.0341, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.42% (1.4563 => 1.4916, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/gs/gs: 2.35% (3.8646 => 3.9554, std. dev.: 0.0028) MultiSource/Applications/lambda-0_1_3/lambda: 2.32% (0.7038 => 0.7201, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.24% (1.3245 => 1.3542, std. dev.: 0.0016) MultiSource/Applications/treecc/treecc: 2.20% (1.9270 => 1.9694, std. dev.: 0.0012) MultiSource/Applications/Burg/burg: 2.19% (1.1061 => 1.1303, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.19% (0.5577 => 0.5699, std. dev.: 0.0022) MultiSource/Applications/sqlite3/sqlite3: 2.16% (16.2614 => 16.6133, std. dev.: 0.0254) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.09% (13.2842 => 13.5623, std. dev.: 0.0191) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.04% (0.7460 => 0.7612, std. dev.: 0.0008) MultiSource/Applications/hbd/hbd: 1.81% (1.3693 => 1.3941, std. dev.: 0.0090) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.78% (0.7710 => 0.7847, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.59% (3.6692 => 3.7277, std. dev.: 0.0047) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.57% (1.3813 => 1.4030, std. dev.: 0.0011) MultiSource/Applications/SIBsim4/SIBsim4: 1.55% (1.2749 => 1.2946, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.54% (2.1007 => 2.1330, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.44% (1.3819 => 1.4018, std. dev.: 0.0014) MultiSource/Applications/JM/lencod/lencod: 1.35% (14.8535 => 15.0543, std. dev.: 0.0126) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.32% (3.2742 => 3.3173, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.26% (1.5188 => 1.5379, std. dev.: 0.0005) MultiSource/Applications/d/make_dparser: 1.18% (3.1889 => 3.2264, std. dev.: 0.0121) MultiSource/Applications/JM/ldecod/ldecod: 1.12% (6.5754 => 6.6489, std. dev.: 0.0056) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.09% (1.1333 => 1.1456, std. dev.: 0.0037) MultiSource/Applications/lemon/lemon: 1.08% (1.0313 => 1.0424, std. dev.: 0.0013) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 23.98% (1.8175 => 2.2533, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/mandel-2: 7.43% (1.2998 => 1.3964, std. dev.: 0.0081) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.89% (1.5824 => 1.6756, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9879, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.74% (1.7688 => 1.8349, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: 3.60% (7.4271 => 7.6943, std. dev.: 0.0092) MultiSource/Benchmarks/nbench/nbench: 3.13% (11.2619 => 11.6148, std. dev.: 0.0040) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4531, std. dev.: 0.0025) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.96% (8.8259 => 9.0870, std. dev.: 0.0065) SingleSource/Benchmarks/Misc/flops-6: 2.94% (1.9199 => 1.9763, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.76% (2.8606 => 2.9395, std. dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.34% (7.9275 => 8.1128, std. dev.: 0.0058) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/ffbench: 1.57% (0.8273 => 0.8403, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.52% (1.4298 => 1.4515, std. dev.: 0.0026) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5094, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.30% (1.9433 => 1.9685, std. dev.: 0.0086) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.29% (2.0200 => 2.0460, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1780, std. dev.: 0.0007) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -22.29% (0.4657 => 0.3619, std. dev.: 0.0052) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.04% (0.2670 => 0.2482, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.41% (0.3511 => 0.3286, std. dev.: 0.0067) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.80% (22.5627 => 21.2546, std. dev.: 0.0063) SingleSource/UnitTests/ObjC/exceptions-3: -4.58% (0.3623 => 0.3457, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.55% (0.3650 => 0.3484, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-2: -4.50% (0.3601 => 0.3439, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -4.48% (0.3663 => 0.3499, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: -4.44% (0.3578 => 0.3419, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-4: -4.44% (0.3646 => 0.3484, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: -4.22% (0.3789 => 0.3629, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/property: -4.16% (0.3940 => 0.3776, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions: -3.96% (0.3914 => 0.3759, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/parameter-passing: -3.72% (0.4003 => 0.3854, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.27% (0.8818 => 0.8530, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.81% (0.6576 => 0.6391, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/bigfib: -1.97% (0.6250 => 0.6127, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -9.72% (1.2308 => 1.1112, std. dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.53% (0.3139 => 0.2934, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.06% (1.3780 => 1.3083, std. dev.: 0.0073) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9474, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -4.05% (2.5089 => 2.4073, std. dev.: 0.0037) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.73% (0.3458 => 0.3329, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.65% (1.9762 => 1.9040, std. dev.: 0.0047) SingleSource/Benchmarks/Shootout/lists: -2.18% (6.3560 => 6.2176, std. dev.: 0.0067) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -2.15% (6.6320 => 6.4895, std. dev.: 0.0080) SingleSource/Benchmarks/Misc/richards_benchmark: -2.12% (1.1560 => 1.1315, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: -1.93% (9.3358 => 9.1555, std. dev.: 0.0029) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6906, std. dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.71% (20.3410 => 19.9939, std. dev.: 0.0345) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9953, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.31% (3.9173 => 3.8659, std. dev.: 0.0104) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.12% (3.8887 => 3.8452, std. dev.: 0.0034) MultiSource/Applications/lua/lua: -1.04% (26.5159 => 26.2393, std. dev.: 0.0173) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.66s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed May 16 23:29:02 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 17 May 2012 01:29:02 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120517062902.F2DDE2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/685?compare_to=684&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 685, Order: 156977, Start Time: 2012-05-17 05:33:19, End Time: 2012-05-17 06:29:52 To: 684, Order: 156973, Start Time: 2012-05-17 04:09:51, End Time: 2012-05-17 05:06:25 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (61 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (787 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.96% (2.0176 => 2.2791, std. dev.: 0.0112) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.25% (0.3130 => 0.3357, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.34% (0.2721 => 0.2839, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.48% (3.9660 => 4.1042, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.25% (0.6959 => 0.7185, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.23% (0.5265 => 0.5435, std. dev.: 0.0016) MultiSource/Applications/SPASS/SPASS: 2.99% (13.8202 => 14.2337, std. dev.: 0.0076) MultiSource/Benchmarks/nbench/nbench: 2.93% (1.0594 => 1.0904, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.92% (0.9199 => 0.9468, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 2.79% (0.8310 => 0.8542, std. dev.: 0.0011) MultiSource/Applications/kimwitu++/kc: 2.77% (16.6129 => 17.0727, std. dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.70% (0.5637 => 0.5789, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.65% (1.1364 => 1.1665, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.60% (1.2193 => 1.2510, std. dev.: 0.0024) MultiSource/Applications/siod/siod: 2.47% (2.1791 => 2.2329, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: 2.40% (3.8646 => 3.9574, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.34% (1.4563 => 1.4904, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.33% (0.5577 => 0.5707, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 2.26% (0.7038 => 0.7197, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.15% (1.3245 => 1.3530, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.06% (13.2842 => 13.5585, std. dev.: 0.0088) MultiSource/Applications/Burg/burg: 2.06% (1.1061 => 1.1289, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 1.99% (1.9270 => 1.9653, std. dev.: 0.0017) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.98% (0.7460 => 0.7608, std. dev.: 0.0025) MultiSource/Applications/sqlite3/sqlite3: 1.96% (16.2614 => 16.5795, std. dev.: 0.0098) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.80% (0.7710 => 0.7849, std. dev.: 0.0043) MultiSource/Applications/hbd/hbd: 1.70% (1.3693 => 1.3926, std. dev.: 0.0017) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.60% (1.3813 => 1.4034, std. dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.43% (2.1007 => 2.1307, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.40% (1.3819 => 1.4012, std. dev.: 0.0022) MultiSource/Applications/SIBsim4/SIBsim4: 1.32% (1.2749 => 1.2917, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.26% (3.6692 => 3.7154, std. dev.: 0.0076) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.19% (1.5188 => 1.5369, std. dev.: 0.0007) MultiSource/Applications/JM/lencod/lencod: 1.05% (14.8535 => 15.0089, std. dev.: 0.0057) MultiSource/Applications/d/make_dparser: 1.03% (3.1889 => 3.2218, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.01% (3.2742 => 3.3074, std. dev.: 0.0033) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.49% (1.8175 => 2.2626, std. dev.: 0.0140) SingleSource/Benchmarks/Misc/mandel-2: 8.34% (1.2998 => 1.4082, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7298, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.87% (1.5824 => 1.6753, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8146, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9881, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.71% (1.7688 => 1.8345, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: 3.55% (7.4271 => 7.6906, std. dev.: 0.0093) MultiSource/Benchmarks/nbench/nbench: 3.14% (11.2619 => 11.6158, std. dev.: 0.0026) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4538, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.90% (8.8259 => 9.0821, std. dev.: 0.0069) SingleSource/Benchmarks/Misc/flops-6: 2.89% (1.9199 => 1.9753, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9393, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.28% (7.9275 => 8.1081, std. dev.: 0.0110) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9600, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 1.60% (0.8273 => 0.8405, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.49% (1.4298 => 1.4511, std. dev.: 0.0028) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5090, std. dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.29% (2.0200 => 2.0460, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 1.21% (5.0168 => 5.0773, std. dev.: 0.0078) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.18% (1.9433 => 1.9662, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/flops: 1.13% (9.0760 => 9.1787, std. dev.: 0.0013) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -22.20% (0.4657 => 0.3623, std. dev.: 0.0343) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.57% (0.2670 => 0.2468, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.44% (0.3511 => 0.3285, std. dev.: 0.0011) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.94% (22.5627 => 21.2227, std. dev.: 0.0100) SingleSource/UnitTests/ObjC/exceptions-3: -4.64% (0.3623 => 0.3455, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -4.53% (0.3601 => 0.3438, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -4.48% (0.3663 => 0.3499, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -4.39% (0.3578 => 0.3421, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -4.36% (0.3646 => 0.3487, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.36% (0.3650 => 0.3491, std. dev.: 0.0021) SingleSource/UnitTests/ObjC/for-in: -4.17% (0.3789 => 0.3631, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -3.99% (0.3914 => 0.3758, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -3.96% (0.3940 => 0.3784, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: -3.75% (0.4003 => 0.3853, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.50% (0.8818 => 0.8509, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.69% (0.6576 => 0.6399, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: -1.84% (0.6250 => 0.6135, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.14% (0.9108 => 0.9004, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -9.68% (1.2308 => 1.1116, std. dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.53% (0.3139 => 0.2934, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/flops-3: -6.27% (2.4152 => 2.2638, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.26% (1.3780 => 1.3055, std. dev.: 0.0131) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9474, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -3.98% (2.5089 => 2.4090, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -3.64% (1.9762 => 1.9042, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/lists: -2.31% (6.3560 => 6.2092, std. dev.: 0.0054) SingleSource/Benchmarks/Misc/richards_benchmark: -2.17% (1.1560 => 1.1309, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: -1.94% (9.3358 => 9.1546, std. dev.: 0.0257) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.89% (6.6320 => 6.5069, std. dev.: 0.0043) MultiSource/Benchmarks/mafft/pairlocalalign: -1.87% (28.2225 => 27.6934, std. dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.74% (20.3410 => 19.9862, std. dev.: 0.0415) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9952, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.52% (3.9173 => 3.8578, std. dev.: 0.0036) MultiSource/Applications/lua/lua: -1.41% (26.5159 => 26.1420, std. dev.: 0.0360) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.52s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu May 17 03:21:30 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 17 May 2012 05:21:30 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120517102130.4F6EB2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/686?compare_to=685&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 686, Order: 156984, Start Time: 2012-05-17 09:25:27, End Time: 2012-05-17 10:22:19 To: 685, Order: 156977, Start Time: 2012-05-17 05:33:19, End Time: 2012-05-17 06:29:52 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (64 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (787 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.04% (2.0176 => 2.2807, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.03% (0.3130 => 0.3350, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.19% (0.2721 => 0.2835, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.58% (3.9660 => 4.1081, std. dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.27% (0.5265 => 0.5437, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 3.24% (13.8202 => 14.2673, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.23% (0.6959 => 0.7184, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 3.11% (1.0594 => 1.0923, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.95% (0.9199 => 0.9470, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/football/football: 2.94% (0.8310 => 0.8554, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.73% (0.5637 => 0.5791, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.63% (1.2193 => 1.2514, std. dev.: 0.0044) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.62% (1.1364 => 1.1662, std. dev.: 0.0008) MultiSource/Applications/siod/siod: 2.61% (2.1791 => 2.2360, std. dev.: 0.0056) MultiSource/Applications/kimwitu++/kc: 2.57% (16.6129 => 17.0406, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.44% (1.4563 => 1.4919, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/gs/gs: 2.38% (3.8646 => 3.9565, std. dev.: 0.0031) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.12% (0.7460 => 0.7618, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.08% (1.3245 => 1.3521, std. dev.: 0.0005) MultiSource/Applications/Burg/burg: 2.05% (1.1061 => 1.1288, std. dev.: 0.0039) MultiSource/Applications/treecc/treecc: 2.01% (1.9270 => 1.9658, std. dev.: 0.0014) MultiSource/Applications/hbd/hbd: 2.00% (1.3693 => 1.3967, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.97% (13.2842 => 13.5454, std. dev.: 0.0065) MultiSource/Applications/sqlite3/sqlite3: 1.90% (16.2614 => 16.5697, std. dev.: 0.0078) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.79% (0.7710 => 0.7848, std. dev.: 0.0032) MultiSource/Applications/SIBsim4/SIBsim4: 1.55% (1.2749 => 1.2946, std. dev.: 0.0026) MultiSource/Applications/spiff/spiff: 1.49% (0.7506 => 0.7618, std. dev.: 0.0034) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.43% (1.3813 => 1.4011, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.41% (2.1007 => 2.1304, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.38% (3.6692 => 3.7199, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.32% (1.3819 => 1.4001, std. dev.: 0.0027) MultiSource/Applications/JM/lencod/lencod: 1.25% (14.8535 => 15.0386, std. dev.: 0.0104) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.17% (3.2742 => 3.3125, std. dev.: 0.0059) MultiSource/Applications/d/make_dparser: 1.11% (3.1889 => 3.2244, std. dev.: 0.0013) MultiSource/Applications/JM/ldecod/ldecod: 1.09% (6.5754 => 6.6473, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.08% (1.5188 => 1.5352, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.02% (1.1333 => 1.1449, std. dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.24% (1.8175 => 2.2580, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/mandel-2: 8.02% (1.2998 => 1.4041, std. dev.: 0.0052) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7298, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.86% (1.5824 => 1.6751, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8146, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9880, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.71% (1.7688 => 1.8345, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 3.52% (7.4271 => 7.6885, std. dev.: 0.0072) MultiSource/Benchmarks/nbench/nbench: 3.13% (11.2619 => 11.6144, std. dev.: 0.0024) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4541, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-6: 2.91% (1.9199 => 1.9758, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9393, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.69% (8.8259 => 9.0634, std. dev.: 0.0078) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.49% (7.9275 => 8.1250, std. dev.: 0.0102) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/ffbench: 1.60% (0.8273 => 0.8405, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5096, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.40% (1.4298 => 1.4498, std. dev.: 0.0052) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.28% (1.9433 => 1.9681, std. dev.: 0.0045) MultiSource/Benchmarks/Olden/bisort/bisort: 1.27% (0.8239 => 0.8344, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.27% (2.0200 => 2.0456, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 1.11% (9.0760 => 9.1771, std. dev.: 0.0018) MultiSource/Benchmarks/sim/sim: 1.06% (5.0168 => 5.0699, std. dev.: 0.0079) MultiSource/Applications/sqlite3/sqlite3: 1.01% (4.5928 => 4.6392, std. dev.: 0.0009) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.53% (0.2670 => 0.2469, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.61% (0.3511 => 0.3279, std. dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.74% (22.5627 => 21.2669, std. dev.: 0.0046) SingleSource/UnitTests/ObjC/exceptions-3: -4.33% (0.3623 => 0.3466, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -4.30% (0.3601 => 0.3446, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -4.26% (0.3663 => 0.3507, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: -4.22% (0.3646 => 0.3492, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.16% (0.3650 => 0.3498, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/trivial-interface: -4.05% (0.3578 => 0.3433, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -4.04% (0.3789 => 0.3636, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -3.93% (0.3940 => 0.3785, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -3.70% (0.3914 => 0.3769, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -3.52% (0.4003 => 0.3862, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.37% (0.8818 => 0.8521, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.13% (0.6576 => 0.6436, std. dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/bigfib: -1.95% (0.6250 => 0.6128, std. dev.: 0.0015) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -9.77% (1.2308 => 1.1106, std. dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.16% (1.0460 => 0.9502, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.47% (0.3139 => 0.2936, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9473, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -4.07% (2.5089 => 2.4069, std. dev.: 0.0043) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -3.65% (1.9762 => 1.9040, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/richards_benchmark: -2.15% (1.1560 => 1.1312, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.08% (20.3410 => 19.9176, std. dev.: 0.0574) SingleSource/Benchmarks/Shootout/lists: -2.00% (6.3560 => 6.2290, std. dev.: 0.0073) MultiSource/Applications/minisat/minisat: -1.90% (9.3358 => 9.1585, std. dev.: 0.0165) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6921, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.86% (6.6320 => 6.5089, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9959, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.36% (3.9173 => 3.8639, std. dev.: 0.0171) MultiSource/Applications/lua/lua: -1.30% (26.5159 => 26.1714, std. dev.: 0.0323) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.61s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu May 17 04:45:13 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 17 May 2012 06:45:13 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120517114513.834642A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/687?compare_to=686&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 687, Order: 156986, Start Time: 2012-05-17 10:49:16, End Time: 2012-05-17 11:46:03 To: 686, Order: 156984, Start Time: 2012-05-17 09:25:27, End Time: 2012-05-17 10:22:19 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (61 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 891 (787 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/siod/siod: 1.27% (3.2807 => 3.3225, std. dev.: 0.0018) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.78% (2.0176 => 2.2754, std. dev.: 0.0116) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.00% (0.3130 => 0.3349, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.26% (0.2721 => 0.2837, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.47% (3.9660 => 4.1035, std. dev.: 0.0079) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.10% (0.5265 => 0.5428, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.05% (0.6959 => 0.7171, std. dev.: 0.0034) MultiSource/Benchmarks/nbench/nbench: 2.89% (1.0594 => 1.0900, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.88% (0.9199 => 0.9464, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 2.85% (13.8202 => 14.2144, std. dev.: 0.0121) MultiSource/Benchmarks/Prolangs-C/football/football: 2.77% (0.8310 => 0.8540, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.68% (0.5637 => 0.5788, std. dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: 2.62% (16.6129 => 17.0488, std. dev.: 0.0102) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.53% (1.2193 => 1.2502, std. dev.: 0.0035) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.44% (1.1364 => 1.1641, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 2.37% (2.1791 => 2.2307, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/hash2: 2.33% (0.4328 => 0.4429, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.24% (0.5577 => 0.5702, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/gs/gs: 2.22% (3.8646 => 3.9504, std. dev.: 0.0019) MultiSource/Applications/lambda-0_1_3/lambda: 2.19% (0.7038 => 0.7192, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.14% (1.4563 => 1.4875, std. dev.: 0.0019) MultiSource/Applications/Burg/burg: 2.07% (1.1061 => 1.1290, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.02% (1.3245 => 1.3513, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.83% (13.2842 => 13.5274, std. dev.: 0.0021) MultiSource/Applications/treecc/treecc: 1.82% (1.9270 => 1.9621, std. dev.: 0.0022) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.80% (0.7710 => 0.7849, std. dev.: 0.0032) MultiSource/Applications/hbd/hbd: 1.78% (1.3693 => 1.3937, std. dev.: 0.0042) MultiSource/Applications/sqlite3/sqlite3: 1.51% (16.2614 => 16.5077, std. dev.: 0.0040) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.48% (3.6692 => 3.7235, std. dev.: 0.0116) MultiSource/Applications/spiff/spiff: 1.44% (0.7506 => 0.7614, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.32% (1.3813 => 1.3996, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.30% (2.1007 => 2.1280, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.29% (3.2742 => 3.3165, std. dev.: 0.0111) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.28% (1.3819 => 1.3996, std. dev.: 0.0019) MultiSource/Applications/SIBsim4/SIBsim4: 1.24% (1.2749 => 1.2907, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.19% (1.5188 => 1.5368, std. dev.: 0.0062) MultiSource/Applications/JM/lencod/lencod: 1.09% (14.8535 => 15.0161, std. dev.: 0.0101) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.30% (1.8175 => 2.2592, std. dev.: 0.0215) SingleSource/Benchmarks/Misc/mandel-2: 8.68% (1.2998 => 1.4126, std. dev.: 0.0071) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.91% (1.5824 => 1.6759, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8147, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.81% (1.9144 => 1.9874, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 3.67% (7.4271 => 7.6994, std. dev.: 0.0052) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.64% (1.7688 => 1.8332, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 3.13% (11.2619 => 11.6149, std. dev.: 0.0025) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4540, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: 2.89% (1.9199 => 1.9753, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9393, std. dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.72% (8.8259 => 9.0656, std. dev.: 0.0248) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.34% (7.9275 => 8.1133, std. dev.: 0.0114) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9603, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.62% (0.8273 => 0.8407, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.55% (1.4298 => 1.4520, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 1.52% (3.2729 => 3.3225, std. dev.: 0.0018) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5096, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.25% (2.0200 => 2.0453, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0001) MultiSource/Benchmarks/sim/sim: 1.16% (5.0168 => 5.0751, std. dev.: 0.0120) SingleSource/Benchmarks/Misc/flops: 1.10% (9.0760 => 9.1756, std. dev.: 0.0017) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -16.45% (0.4657 => 0.3891, std. dev.: 0.0234) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.94% (0.2670 => 0.2458, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.44% (0.3511 => 0.3285, std. dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.12% (22.5627 => 21.1822, std. dev.: 0.0215) SingleSource/UnitTests/ObjC/exceptions-3: -4.72% (0.3623 => 0.3452, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -4.64% (0.3601 => 0.3434, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -4.50% (0.3663 => 0.3498, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -4.50% (0.3578 => 0.3417, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -4.50% (0.3646 => 0.3482, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.41% (0.3650 => 0.3489, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/for-in: -4.33% (0.3789 => 0.3625, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -4.26% (0.3940 => 0.3772, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -4.04% (0.3914 => 0.3756, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -3.82% (0.4003 => 0.3850, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.11% (0.8818 => 0.8544, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.51% (0.6576 => 0.6411, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: -1.92% (0.6250 => 0.6130, std. dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -10.99% (1.2308 => 1.0955, std. dev.: 0.0078) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.16% (1.0460 => 0.9502, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.50% (0.3139 => 0.2935, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.04% (1.3780 => 1.3085, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9475, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -4.02% (2.5089 => 2.4081, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.67% (0.3458 => 0.3331, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.65% (1.9762 => 1.9041, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/richards_benchmark: -2.14% (1.1560 => 1.1313, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -2.13% (6.3560 => 6.2206, std. dev.: 0.0072) MultiSource/Applications/minisat/minisat: -1.97% (9.3358 => 9.1520, std. dev.: 0.0052) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.89% (6.6320 => 6.5067, std. dev.: 0.0015) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6918, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9951, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.59% (20.3410 => 20.0172, std. dev.: 0.0033) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.43% (3.9173 => 3.8611, std. dev.: 0.0073) MultiSource/Applications/lua/lua: -1.41% (26.5159 => 26.1431, std. dev.: 0.0331) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.07% (3.8887 => 3.8469, std. dev.: 0.0034) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.27s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu May 17 06:31:12 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 17 May 2012 08:31:12 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120517133112.7FC192A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/688?compare_to=687&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 688, Order: 156987, Start Time: 2012-05-17 12:35:09, End Time: 2012-05-17 13:32:02 To: 687, Order: 156986, Start Time: 2012-05-17 10:49:16, End Time: 2012-05-17 11:46:03 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (61 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (787 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.72% (2.0176 => 2.2742, std. dev.: 0.0147) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.96% (0.3130 => 0.3348, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.59% (0.2721 => 0.2846, std. dev.: 0.0017) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.52% (3.9660 => 4.1057, std. dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.29% (0.5265 => 0.5438, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.20% (0.6959 => 0.7182, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.97% (0.9199 => 0.9472, std. dev.: 0.0020) MultiSource/Benchmarks/nbench/nbench: 2.82% (1.0594 => 1.0893, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/football/football: 2.82% (0.8310 => 0.8544, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 2.74% (13.8202 => 14.1982, std. dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.57% (1.2193 => 1.2506, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.55% (0.5637 => 0.5781, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.49% (1.1364 => 1.1647, std. dev.: 0.0020) MultiSource/Applications/kimwitu++/kc: 2.44% (16.6129 => 17.0187, std. dev.: 0.0320) MultiSource/Applications/siod/siod: 2.35% (2.1791 => 2.2302, std. dev.: 0.0030) MultiSource/Applications/Burg/burg: 2.29% (1.1061 => 1.1314, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.28% (1.4563 => 1.4895, std. dev.: 0.0016) MultiSource/Benchmarks/MallocBench/gs/gs: 2.17% (3.8646 => 3.9484, std. dev.: 0.0106) MultiSource/Applications/lambda-0_1_3/lambda: 2.16% (0.7038 => 0.7190, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.06% (0.5577 => 0.5692, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.01% (0.7460 => 0.7610, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.99% (1.3245 => 1.3509, std. dev.: 0.0020) MultiSource/Applications/treecc/treecc: 1.99% (1.9270 => 1.9653, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.82% (13.2842 => 13.5254, std. dev.: 0.0205) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.70% (0.7710 => 0.7841, std. dev.: 0.0028) MultiSource/Applications/hbd/hbd: 1.55% (1.3693 => 1.3905, std. dev.: 0.0021) MultiSource/Applications/sqlite3/sqlite3: 1.52% (16.2614 => 16.5079, std. dev.: 0.0063) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.39% (2.1007 => 2.1300, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.37% (3.6692 => 3.7196, std. dev.: 0.0099) MultiSource/Applications/spiff/spiff: 1.37% (0.7506 => 0.7609, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.32% (1.3819 => 1.4001, std. dev.: 0.0018) MultiSource/Applications/SIBsim4/SIBsim4: 1.26% (1.2749 => 1.2910, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.20% (1.3813 => 1.3979, std. dev.: 0.0034) MultiSource/Applications/JM/lencod/lencod: 1.14% (14.8535 => 15.0224, std. dev.: 0.0062) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.11% (3.2742 => 3.3106, std. dev.: 0.0089) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 23.98% (1.8175 => 2.2534, std. dev.: 0.0203) SingleSource/Benchmarks/Misc/mandel-2: 6.58% (1.2998 => 1.3853, std. dev.: 0.0193) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 6.07% (1.5824 => 1.6784, std. dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9882, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.70% (1.7688 => 1.8343, std. dev.: 0.0055) SingleSource/Benchmarks/Misc/salsa20: 3.52% (7.4271 => 7.6887, std. dev.: 0.0121) MultiSource/Benchmarks/nbench/nbench: 3.12% (11.2619 => 11.6131, std. dev.: 0.0033) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4551, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: 2.86% (1.9199 => 1.9748, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.74% (2.8606 => 2.9391, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.72% (8.8259 => 9.0663, std. dev.: 0.0042) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.52% (7.9275 => 8.1269, std. dev.: 0.0058) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.62% (0.8273 => 0.8407, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 1.50% (3.2729 => 3.3220, std. dev.: 0.0020) MultiSource/Applications/lemon/lemon: 1.43% (1.4298 => 1.4503, std. dev.: 0.0019) MultiSource/Benchmarks/NPB-serial/is/is: 1.43% (8.3908 => 8.5104, std. dev.: 0.0078) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.28% (2.0200 => 2.0458, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.21% (1.9433 => 1.9668, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 1.14% (5.0168 => 5.0739, std. dev.: 0.0130) SingleSource/Benchmarks/Misc/flops: 1.13% (9.0760 => 9.1782, std. dev.: 0.0010) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -19.43% (0.4657 => 0.3752, std. dev.: 0.0115) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.94% (0.2670 => 0.2458, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.44% (0.3511 => 0.3285, std. dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.07% (22.5627 => 21.1923, std. dev.: 0.0039) SingleSource/UnitTests/ObjC/exceptions-3: -4.50% (0.3623 => 0.3460, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -4.44% (0.3601 => 0.3441, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.44% (0.3650 => 0.3488, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/trivial-interface: -4.36% (0.3578 => 0.3422, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -4.29% (0.3663 => 0.3506, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -4.28% (0.3646 => 0.3490, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -4.06% (0.3940 => 0.3780, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -4.04% (0.3789 => 0.3636, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -3.86% (0.3914 => 0.3763, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -3.75% (0.4003 => 0.3853, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.20% (0.8818 => 0.8536, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.62% (0.6576 => 0.6404, std. dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/bigfib: -2.06% (0.6250 => 0.6121, std. dev.: 0.0005) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -10.24% (1.2308 => 1.1048, std. dev.: 0.0052) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.53% (0.3139 => 0.2934, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.17% (1.3780 => 1.3067, std. dev.: 0.0068) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9474, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -4.03% (2.5089 => 2.4078, std. dev.: 0.0014) MultiSource/Benchmarks/Olden/bh/bh: -3.67% (1.9762 => 1.9037, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.59% (0.3458 => 0.3334, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -2.27% (6.3560 => 6.2115, std. dev.: 0.0128) SingleSource/Benchmarks/Misc/richards_benchmark: -2.15% (1.1560 => 1.1312, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.88% (6.6320 => 6.5073, std. dev.: 0.0028) MultiSource/Benchmarks/mafft/pairlocalalign: -1.87% (28.2225 => 27.6950, std. dev.: 0.0005) MultiSource/Applications/minisat/minisat: -1.82% (9.3358 => 9.1662, std. dev.: 0.0337) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.80% (20.3410 => 19.9757, std. dev.: 0.0120) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3444, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9956, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) MultiSource/Applications/lua/lua: -1.47% (26.5159 => 26.1250, std. dev.: 0.0162) SingleSource/Benchmarks/Shootout/heapsort: -1.46% (3.9173 => 3.8600, std. dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.14% (3.8887 => 3.8443, std. dev.: 0.0079) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.36s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu May 17 07:54:51 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 17 May 2012 09:54:51 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120517145451.87A272A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/689?compare_to=688&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 689, Order: 156989, Start Time: 2012-05-17 13:59:01, End Time: 2012-05-17 14:55:41 To: 688, Order: 156987, Start Time: 2012-05-17 12:35:09, End Time: 2012-05-17 13:32:02 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (60 on baseline) Performance Improvements: 0 (41 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (787 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.79% (2.0176 => 2.2756, std. dev.: 0.0143) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.06% (0.3130 => 0.3351, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.37% (0.2721 => 0.2840, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.51% (3.9660 => 4.1052, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.41% (0.6959 => 0.7196, std. dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.11% (0.5265 => 0.5429, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.01% (0.9199 => 0.9476, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 2.92% (1.0594 => 1.0903, std. dev.: 0.0036) MultiSource/Applications/SPASS/SPASS: 2.86% (13.8202 => 14.2151, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/football/football: 2.78% (0.8310 => 0.8541, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.72% (1.4563 => 1.4959, std. dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.68% (0.5637 => 0.5788, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.60% (1.1364 => 1.1659, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.59% (1.2193 => 1.2509, std. dev.: 0.0025) MultiSource/Applications/kimwitu++/kc: 2.55% (16.6129 => 17.0361, std. dev.: 0.0032) MultiSource/Applications/siod/siod: 2.35% (2.1791 => 2.2304, std. dev.: 0.0158) MultiSource/Benchmarks/MallocBench/gs/gs: 2.32% (3.8646 => 3.9542, std. dev.: 0.0157) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.24% (0.5577 => 0.5702, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 2.23% (0.7038 => 0.7195, std. dev.: 0.0006) MultiSource/Applications/Burg/burg: 2.15% (1.1061 => 1.1299, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.14% (1.3245 => 1.3529, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.09% (0.7710 => 0.7871, std. dev.: 0.0042) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.00% (0.7460 => 0.7609, std. dev.: 0.0001) MultiSource/Applications/treecc/treecc: 1.93% (1.9270 => 1.9642, std. dev.: 0.0048) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.85% (13.2842 => 13.5305, std. dev.: 0.0080) MultiSource/Applications/hbd/hbd: 1.61% (1.3693 => 1.3914, std. dev.: 0.0021) MultiSource/Applications/sqlite3/sqlite3: 1.58% (16.2614 => 16.5189, std. dev.: 0.0117) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.44% (2.1007 => 2.1309, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.42% (1.3819 => 1.4015, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.40% (1.3813 => 1.4007, std. dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.37% (3.6692 => 3.7194, std. dev.: 0.0144) MultiSource/Applications/SIBsim4/SIBsim4: 1.29% (1.2749 => 1.2913, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.24% (3.2742 => 3.3149, std. dev.: 0.0007) MultiSource/Applications/JM/lencod/lencod: 1.09% (14.8535 => 15.0160, std. dev.: 0.0092) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.05% (1.5188 => 1.5348, std. dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.23% (1.8175 => 2.2578, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/mandel-2: 7.82% (1.2998 => 1.4014, std. dev.: 0.0078) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.86% (1.5824 => 1.6752, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8146, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.87% (1.9144 => 1.9885, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.71% (1.7688 => 1.8345, std. dev.: 0.0252) SingleSource/Benchmarks/Misc/salsa20: 3.67% (7.4271 => 7.6998, std. dev.: 0.0070) MultiSource/Benchmarks/nbench/nbench: 3.12% (11.2619 => 11.6134, std. dev.: 0.0028) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4540, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/flops-6: 2.86% (1.9199 => 1.9748, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9393, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.71% (8.8259 => 9.0652, std. dev.: 0.0274) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.32% (7.9275 => 8.1117, std. dev.: 0.0092) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.56% (0.8273 => 0.8402, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 1.47% (3.2729 => 3.3211, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.39% (8.3908 => 8.5073, std. dev.: 0.0040) MultiSource/Applications/lemon/lemon: 1.36% (1.4298 => 1.4493, std. dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.26% (2.0200 => 2.0455, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/flops: 1.10% (9.0760 => 9.1760, std. dev.: 0.0018) MultiSource/Benchmarks/sim/sim: 1.02% (5.0168 => 5.0679, std. dev.: 0.0110) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -20.91% (0.4657 => 0.3683, std. dev.: 0.0333) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.87% (0.2670 => 0.2460, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.47% (0.3511 => 0.3284, std. dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.08% (22.5627 => 21.1920, std. dev.: 0.0079) SingleSource/UnitTests/ObjC/exceptions-3: -4.55% (0.3623 => 0.3458, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -4.42% (0.3601 => 0.3442, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -4.37% (0.3663 => 0.3503, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -4.36% (0.3578 => 0.3422, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -4.31% (0.3646 => 0.3489, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.27% (0.3650 => 0.3494, std. dev.: 0.0052) SingleSource/UnitTests/ObjC/for-in: -4.09% (0.3789 => 0.3634, std. dev.: 0.0042) SingleSource/UnitTests/ObjC/property: -4.09% (0.3940 => 0.3779, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -3.86% (0.3914 => 0.3763, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -3.75% (0.4003 => 0.3853, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.14% (0.8818 => 0.8541, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.68% (0.6576 => 0.6400, std. dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/bigfib: -2.00% (0.6250 => 0.6125, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: -1.74% (0.5748 => 0.5648, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -10.36% (1.2308 => 1.1033, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.16% (1.0460 => 0.9502, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.66% (0.3139 => 0.2930, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.21% (2.4152 => 2.2652, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9474, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.56% (1.3780 => 1.3151, std. dev.: 0.0074) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0011) SingleSource/Benchmarks/Dhrystone/dry: -4.05% (2.5089 => 2.4073, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.73% (0.3458 => 0.3329, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.65% (1.9762 => 1.9041, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: -2.13% (1.1560 => 1.1314, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -2.10% (6.3560 => 6.2225, std. dev.: 0.0046) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.95% (20.3410 => 19.9436, std. dev.: 0.0666) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.95% (6.6320 => 6.5029, std. dev.: 0.0040) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6918, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0009) MultiSource/Applications/minisat/minisat: -1.64% (9.3358 => 9.1827, std. dev.: 0.0230) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9950, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.44% (3.9173 => 3.8608, std. dev.: 0.0089) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.34% (2.5254 => 2.4915, std. dev.: 0.0069) MultiSource/Applications/lua/lua: -1.33% (26.5159 => 26.1635, std. dev.: 0.0116) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.29s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu May 17 10:15:08 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 17 May 2012 12:15:08 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120517171508.D77C52A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/690?compare_to=689&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 690, Order: 156993, Start Time: 2012-05-17 16:19:22, End Time: 2012-05-17 17:15:58 To: 689, Order: 156989, Start Time: 2012-05-17 13:59:01, End Time: 2012-05-17 14:55:41 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (58 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 891 (791 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 2.00% (3.7691 => 3.8444, std. dev.: 0.0125) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.79% (2.0176 => 2.2756, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.16% (0.3130 => 0.3354, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.26% (0.2721 => 0.2837, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.54% (3.9660 => 4.1062, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.31% (0.6959 => 0.7189, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.11% (0.5265 => 0.5429, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.00% (0.9199 => 0.9475, std. dev.: 0.0031) MultiSource/Benchmarks/nbench/nbench: 2.92% (1.0594 => 1.0903, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/football/football: 2.82% (0.8310 => 0.8544, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 2.81% (13.8202 => 14.2082, std. dev.: 0.0146) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.68% (0.5637 => 0.5788, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.54% (1.1364 => 1.1653, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.51% (1.2193 => 1.2499, std. dev.: 0.0010) MultiSource/Applications/siod/siod: 2.46% (2.1791 => 2.2328, std. dev.: 0.0016) MultiSource/Applications/kimwitu++/kc: 2.45% (16.6129 => 17.0196, std. dev.: 0.0250) MultiSource/Applications/lambda-0_1_3/lambda: 2.32% (0.7038 => 0.7201, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.28% (0.5577 => 0.5704, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.22% (0.7710 => 0.7881, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/gs/gs: 2.20% (3.8646 => 3.9497, std. dev.: 0.0111) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.15% (1.4563 => 1.4876, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.13% (1.3245 => 1.3527, std. dev.: 0.0007) MultiSource/Applications/Burg/burg: 2.12% (1.1061 => 1.1296, std. dev.: 0.0059) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.97% (0.7460 => 0.7607, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 1.93% (1.9270 => 1.9641, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.92% (13.2842 => 13.5390, std. dev.: 0.0110) MultiSource/Applications/sqlite3/sqlite3: 1.48% (16.2614 => 16.5025, std. dev.: 0.0046) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.38% (3.6692 => 3.7198, std. dev.: 0.0022) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.32% (1.3813 => 1.3995, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.29% (1.3819 => 1.3997, std. dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.28% (3.2742 => 3.3162, std. dev.: 0.0025) MultiSource/Applications/JM/lencod/lencod: 1.17% (14.8535 => 15.0280, std. dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.04% (1.5188 => 1.5346, std. dev.: 0.0010) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.18% (1.8175 => 2.2570, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/mandel-2: 8.01% (1.2998 => 1.4039, std. dev.: 0.0058) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.87% (1.5824 => 1.6753, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8142, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9880, std. dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.75% (1.7688 => 1.8352, std. dev.: 0.0058) SingleSource/Benchmarks/Misc/salsa20: 3.60% (7.4271 => 7.6948, std. dev.: 0.0081) MultiSource/Benchmarks/nbench/nbench: 3.14% (11.2619 => 11.6153, std. dev.: 0.0025) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4544, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-6: 2.87% (1.9199 => 1.9750, std. dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.85% (8.8259 => 9.0775, std. dev.: 0.0060) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9392, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.40% (7.9275 => 8.1174, std. dev.: 0.0108) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/llubenchmark/llu: 1.89% (3.7731 => 3.8444, std. dev.: 0.0125) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.60% (0.8273 => 0.8405, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 1.46% (3.2729 => 3.3208, std. dev.: 0.0005) MultiSource/Applications/lemon/lemon: 1.46% (1.4298 => 1.4507, std. dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.43% (8.3908 => 8.5105, std. dev.: 0.0087) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.28% (2.0200 => 2.0458, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.13% (1.9433 => 1.9652, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: 1.11% (9.0760 => 9.1770, std. dev.: 0.0019) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -20.74% (0.4657 => 0.3691, std. dev.: 0.0254) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.83% (0.2670 => 0.2461, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.44% (0.3511 => 0.3285, std. dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.07% (22.5627 => 21.1927, std. dev.: 0.0254) SingleSource/UnitTests/ObjC/exceptions-3: -4.42% (0.3623 => 0.3463, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -4.39% (0.3601 => 0.3443, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: -4.37% (0.3663 => 0.3503, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -4.33% (0.3646 => 0.3488, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: -4.30% (0.3578 => 0.3424, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.27% (0.3650 => 0.3494, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -4.09% (0.3789 => 0.3634, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -4.06% (0.3940 => 0.3780, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -3.70% (0.3914 => 0.3769, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -3.67% (0.4003 => 0.3856, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.11% (0.8818 => 0.8544, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.51% (0.6576 => 0.6411, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/bigfib: -1.98% (0.6250 => 0.6126, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -10.20% (1.2308 => 1.1052, std. dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.16% (1.0460 => 0.9502, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.59% (0.3139 => 0.2932, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9475, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.72% (1.3780 => 1.3129, std. dev.: 0.0043) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -3.97% (2.5089 => 2.4092, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.73% (0.3458 => 0.3329, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -3.63% (1.9762 => 1.9044, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: -2.14% (1.1560 => 1.1313, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -2.06% (6.3560 => 6.2248, std. dev.: 0.0063) MultiSource/Applications/minisat/minisat: -2.01% (9.3358 => 9.1479, std. dev.: 0.0295) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.95% (20.3410 => 19.9450, std. dev.: 0.0650) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.90% (6.6320 => 6.5062, std. dev.: 0.0024) MultiSource/Benchmarks/mafft/pairlocalalign: -1.87% (28.2225 => 27.6937, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9957, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/heapsort: -1.44% (3.9173 => 3.8610, std. dev.: 0.0055) MultiSource/Applications/lua/lua: -1.42% (26.5159 => 26.1387, std. dev.: 0.0225) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.59s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu May 17 11:38:55 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 17 May 2012 13:38:55 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120517183855.70F0F2A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/691?compare_to=690&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 691, Order: 156996, Start Time: 2012-05-17 17:43:11, End Time: 2012-05-17 18:39:45 To: 690, Order: 156993, Start Time: 2012-05-17 16:19:22, End Time: 2012-05-17 17:15:58 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (66 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 891 (785 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/sqlite3/sqlite3: 2.43% (4.7287 => 4.8435, std. dev.: 0.0269) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.57% (2.0176 => 2.2914, std. dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.48% (0.3130 => 0.3364, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.15% (0.2721 => 0.2834, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.83% (3.9660 => 4.1177, std. dev.: 0.0121) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.58% (0.6959 => 0.7208, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 3.37% (1.0594 => 1.0951, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.29% (0.5265 => 0.5438, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 3.23% (13.8202 => 14.2664, std. dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.21% (0.9199 => 0.9494, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 3.09% (0.8310 => 0.8567, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 3.02% (2.1791 => 2.2449, std. dev.: 0.0009) MultiSource/Applications/kimwitu++/kc: 2.96% (16.6129 => 17.1049, std. dev.: 0.0128) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.75% (1.1364 => 1.1676, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.73% (1.2193 => 1.2526, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.71% (0.5637 => 0.5790, std. dev.: 0.0016) MultiSource/Benchmarks/MallocBench/gs/gs: 2.67% (3.8646 => 3.9677, std. dev.: 0.0099) MultiSource/Applications/lambda-0_1_3/lambda: 2.64% (0.7038 => 0.7224, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.62% (0.5577 => 0.5723, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.47% (1.4563 => 1.4922, std. dev.: 0.0016) MultiSource/Applications/Burg/burg: 2.42% (1.1061 => 1.1329, std. dev.: 0.0021) MultiSource/Applications/treecc/treecc: 2.29% (1.9270 => 1.9711, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.28% (1.3245 => 1.3547, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.28% (0.4791 => 0.4900, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.22% (13.2842 => 13.5785, std. dev.: 0.0134) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.00% (0.7710 => 0.7864, std. dev.: 0.0019) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.96% (0.7460 => 0.7606, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.80% (2.1007 => 2.1385, std. dev.: 0.0018) MultiSource/Applications/sqlite3/sqlite3: 1.78% (16.2614 => 16.5511, std. dev.: 0.0177) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.69% (0.6283 => 0.6389, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 1.67% (1.3693 => 1.3921, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.65% (3.6692 => 3.7298, std. dev.: 0.0181) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.60% (1.3813 => 1.4034, std. dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.56% (3.2742 => 3.3253, std. dev.: 0.0011) MultiSource/Applications/SIBsim4/SIBsim4: 1.48% (1.2749 => 1.2938, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.48% (1.3819 => 1.4023, std. dev.: 0.0023) MultiSource/Applications/spiff/spiff: 1.35% (0.7506 => 0.7607, std. dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 1.34% (14.8535 => 15.0522, std. dev.: 0.0100) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.21% (1.1333 => 1.1470, std. dev.: 0.0010) MultiSource/Applications/lemon/lemon: 1.16% (1.0313 => 1.0433, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 1.15% (6.5754 => 6.6511, std. dev.: 0.0071) MultiSource/Applications/d/make_dparser: 1.05% (3.1889 => 3.2223, std. dev.: 0.0033) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.43% (1.8175 => 2.2615, std. dev.: 0.0326) SingleSource/Benchmarks/Misc/mandel-2: 7.89% (1.2998 => 1.4024, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7298, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6755, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 5.46% (4.5928 => 4.8435, std. dev.: 0.0269) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9878, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.69% (1.7688 => 1.8340, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 3.67% (7.4271 => 7.6998, std. dev.: 0.0028) MultiSource/Benchmarks/nbench/nbench: 3.11% (11.2619 => 11.6126, std. dev.: 0.0034) MultiSource/Applications/hexxagon/hexxagon: 3.01% (12.0921 => 12.4559, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.99% (8.8259 => 9.0896, std. dev.: 0.0148) SingleSource/Benchmarks/Misc/flops-6: 2.84% (1.9199 => 1.9744, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9394, std. dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.42% (7.9275 => 8.1195, std. dev.: 0.0126) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.56% (0.8273 => 0.8402, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 1.48% (3.2729 => 3.3213, std. dev.: 0.0004) MultiSource/Applications/lemon/lemon: 1.42% (1.4298 => 1.4501, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5090, std. dev.: 0.0038) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.25% (2.0200 => 2.0453, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/flops: 1.13% (9.0760 => 9.1783, std. dev.: 0.0011) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.42% (0.2670 => 0.2472, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.47% (0.3511 => 0.3284, std. dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.83% (22.5627 => 21.2478, std. dev.: 0.0117) SingleSource/UnitTests/ObjC/exceptions-3: -4.75% (0.3623 => 0.3451, std. dev.: 0.0025) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.60% (0.3650 => 0.3482, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions-2: -4.58% (0.3601 => 0.3436, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -4.53% (0.3663 => 0.3497, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -4.50% (0.3646 => 0.3482, std. dev.: 0.0049) SingleSource/UnitTests/ObjC/trivial-interface: -4.42% (0.3578 => 0.3420, std. dev.: 0.0030) SingleSource/UnitTests/ObjC/for-in: -4.25% (0.3789 => 0.3628, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -4.01% (0.3940 => 0.3782, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -3.88% (0.3914 => 0.3762, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -3.62% (0.4003 => 0.3858, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.96% (0.8818 => 0.8557, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.68% (0.6576 => 0.6400, std. dev.: 0.0012) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -10.18% (1.2308 => 1.1055, std. dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.53% (0.3139 => 0.2934, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.01% (1.3780 => 1.3089, std. dev.: 0.0077) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9475, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -4.10% (2.5089 => 2.4061, std. dev.: 0.0021) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.73% (0.3458 => 0.3329, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.63% (1.9762 => 1.9044, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: -2.15% (1.1560 => 1.1312, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -2.10% (6.3560 => 6.2228, std. dev.: 0.0065) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.07% (20.3410 => 19.9206, std. dev.: 0.0411) MultiSource/Applications/minisat/minisat: -1.97% (9.3358 => 9.1515, std. dev.: 0.0472) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6926, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.83% (6.6320 => 6.5109, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3444, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9956, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.56% (0.9692 => 0.9541, std. dev.: 0.0000) MultiSource/Applications/lua/lua: -1.35% (26.5159 => 26.1567, std. dev.: 0.0138) SingleSource/Benchmarks/Shootout/heapsort: -1.28% (3.9173 => 3.8672, std. dev.: 0.0017) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.63s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu May 17 13:02:20 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 17 May 2012 15:02:20 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120517200220.77F7C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/692?compare_to=691&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 692, Order: 157001, Start Time: 2012-05-17 19:06:36, End Time: 2012-05-17 20:03:10 To: 691, Order: 156996, Start Time: 2012-05-17 17:43:11, End Time: 2012-05-17 18:39:45 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (59 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 891 (789 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 1.83% (3.7987 => 3.8682, std. dev.: 0.0138) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.95% (2.0176 => 2.2789, std. dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.12% (0.3130 => 0.3353, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.23% (0.2721 => 0.2836, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.34% (3.9660 => 4.0984, std. dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.06% (0.5265 => 0.5426, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.03% (0.6959 => 0.7170, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 2.92% (1.0594 => 1.0903, std. dev.: 0.0032) MultiSource/Applications/SPASS/SPASS: 2.88% (13.8202 => 14.2188, std. dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.77% (0.5637 => 0.5793, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/football/football: 2.73% (0.8310 => 0.8537, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.70% (0.9199 => 0.9447, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.53% (1.1364 => 1.1651, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.39% (1.2193 => 1.2484, std. dev.: 0.0007) MultiSource/Applications/siod/siod: 2.23% (2.1791 => 2.2278, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.22% (1.4563 => 1.4886, std. dev.: 0.0018) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.17% (0.7710 => 0.7877, std. dev.: 0.0026) MultiSource/Applications/kimwitu++/kc: 2.09% (16.6129 => 16.9609, std. dev.: 0.0112) MultiSource/Benchmarks/MallocBench/gs/gs: 2.02% (3.8646 => 3.9428, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.00% (13.2842 => 13.5496, std. dev.: 0.0074) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.00% (0.7460 => 0.7609, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.94% (1.3245 => 1.3502, std. dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 1.93% (0.7038 => 0.7174, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 1.83% (1.1061 => 1.1263, std. dev.: 0.0020) MultiSource/Applications/treecc/treecc: 1.80% (1.9270 => 1.9616, std. dev.: 0.0109) MultiSource/Applications/hbd/hbd: 1.71% (1.3693 => 1.3927, std. dev.: 0.0017) MultiSource/Applications/sqlite3/sqlite3: 1.56% (16.2614 => 16.5157, std. dev.: 0.0088) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.47% (3.6692 => 3.7231, std. dev.: 0.0049) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.40% (1.3813 => 1.4007, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.30% (1.3819 => 1.3999, std. dev.: 0.0010) MultiSource/Applications/SIBsim4/SIBsim4: 1.18% (1.2749 => 1.2900, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.13% (2.1007 => 2.1244, std. dev.: 0.0061) MultiSource/Applications/JM/lencod/lencod: 1.12% (14.8535 => 15.0198, std. dev.: 0.0090) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.40% (1.8175 => 2.2609, std. dev.: 0.0543) SingleSource/Benchmarks/Misc/mandel-2: 7.71% (1.2998 => 1.4000, std. dev.: 0.0090) SingleSource/Benchmarks/Misc/flops-4: 6.52% (1.0640 => 1.1334, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7298, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.90% (1.5824 => 1.6757, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8146, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9880, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.69% (1.7688 => 1.8341, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: 3.51% (7.4271 => 7.6875, std. dev.: 0.0104) MultiSource/Benchmarks/nbench/nbench: 3.17% (11.2619 => 11.6186, std. dev.: 0.0020) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4547, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/flops-6: 2.90% (1.9199 => 1.9755, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.86% (8.8259 => 9.0782, std. dev.: 0.0078) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9393, std. dev.: 0.0018) MultiSource/Benchmarks/llubenchmark/llu: 2.52% (3.7731 => 3.8682, std. dev.: 0.0138) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.36% (7.9275 => 8.1144, std. dev.: 0.0228) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9603, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.57% (0.8273 => 0.8403, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 1.49% (3.2729 => 3.3217, std. dev.: 0.0009) MultiSource/Applications/lemon/lemon: 1.47% (1.4298 => 1.4508, std. dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5091, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.30% (2.0200 => 2.0463, std. dev.: 0.0001) MultiSource/Benchmarks/sim/sim: 1.19% (5.0168 => 5.0763, std. dev.: 0.0106) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.16% (1.9433 => 1.9658, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 1.11% (9.0760 => 9.1766, std. dev.: 0.0019) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -16.58% (0.4657 => 0.3885, std. dev.: 0.0209) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.64% (0.2670 => 0.2466, std. dev.: 0.0020) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.47% (0.3511 => 0.3284, std. dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.13% (22.5627 => 21.1791, std. dev.: 0.0142) SingleSource/UnitTests/ObjC/exceptions-3: -3.62% (0.3623 => 0.3492, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.59% (0.3650 => 0.3519, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -3.53% (0.3601 => 0.3474, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -3.44% (0.3578 => 0.3455, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -3.37% (0.3646 => 0.3523, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -3.36% (0.3663 => 0.3540, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.32% (0.8818 => 0.8525, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/property: -3.27% (0.3940 => 0.3811, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -3.07% (0.3914 => 0.3794, std. dev.: 0.0033) SingleSource/UnitTests/ObjC/for-in: -3.06% (0.3789 => 0.3673, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: -3.02% (0.4003 => 0.3882, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.27% (0.6576 => 0.6427, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: -2.05% (0.6250 => 0.6122, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.19% (0.9108 => 0.9000, std. dev.: 0.0005) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -10.46% (1.2308 => 1.1021, std. dev.: 0.0050) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.16% (1.0460 => 0.9502, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.53% (0.3139 => 0.2934, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9472, std. dev.: 0.0004) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.54% (1.3780 => 1.3154, std. dev.: 0.0078) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.90% (2.5089 => 2.4111, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.73% (0.3458 => 0.3329, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.64% (1.9762 => 1.9042, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: -2.12% (1.1560 => 1.1315, std. dev.: 0.0000) MultiSource/Applications/minisat/minisat: -1.98% (9.3358 => 9.1508, std. dev.: 0.0093) SingleSource/Benchmarks/Shootout/lists: -1.94% (6.3560 => 6.2324, std. dev.: 0.0106) MultiSource/Benchmarks/mafft/pairlocalalign: -1.89% (28.2225 => 27.6901, std. dev.: 0.0434) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.82% (6.6320 => 6.5114, std. dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.79% (20.3410 => 19.9771, std. dev.: 0.0224) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9957, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout/heapsort: -1.39% (3.9173 => 3.8627, std. dev.: 0.0051) MultiSource/Applications/lua/lua: -1.32% (26.5159 => 26.1657, std. dev.: 0.0414) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.51s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu May 17 14:25:49 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 17 May 2012 16:25:49 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120517212549.273262A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/693?compare_to=692&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 693, Order: 157007, Start Time: 2012-05-17 20:30:03, End Time: 2012-05-17 21:26:38 To: 692, Order: 157001, Start Time: 2012-05-17 19:06:36, End Time: 2012-05-17 20:03:10 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (68 on baseline) Performance Improvements: 1 (39 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 891 (781 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -2.44% (3.8682 => 3.7740, std. dev.: 0.0321) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.29% (2.0176 => 2.2857, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.92% (0.3130 => 0.3378, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.19% (0.2721 => 0.2835, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.74% (3.9660 => 4.1144, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.48% (0.6959 => 0.7201, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.40% (0.5265 => 0.5444, std. dev.: 0.0048) MultiSource/Applications/SPASS/SPASS: 3.31% (13.8202 => 14.2781, std. dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.11% (0.9199 => 0.9485, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 3.09% (1.0594 => 1.0921, std. dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/football/football: 3.00% (0.8310 => 0.8559, std. dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 2.93% (16.6129 => 17.0995, std. dev.: 0.0087) MultiSource/Applications/siod/siod: 2.81% (2.1791 => 2.2403, std. dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.79% (0.5637 => 0.5794, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.73% (1.1364 => 1.1674, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.67% (1.2193 => 1.2519, std. dev.: 0.0035) MultiSource/Benchmarks/MallocBench/gs/gs: 2.54% (3.8646 => 3.9629, std. dev.: 0.0121) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.49% (0.7710 => 0.7902, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.43% (1.4563 => 1.4917, std. dev.: 0.0054) MultiSource/Applications/lambda-0_1_3/lambda: 2.43% (0.7038 => 0.7209, std. dev.: 0.0005) MultiSource/Applications/Burg/burg: 2.41% (1.1061 => 1.1328, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash2: 2.38% (0.4328 => 0.4431, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.35% (0.5577 => 0.5708, std. dev.: 0.0012) MultiSource/Applications/treecc/treecc: 2.31% (1.9270 => 1.9715, std. dev.: 0.0033) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.29% (0.7460 => 0.7631, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.23% (1.3245 => 1.3541, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.18% (13.2842 => 13.5738, std. dev.: 0.0180) MultiSource/Applications/hbd/hbd: 1.95% (1.3693 => 1.3960, std. dev.: 0.0040) MultiSource/Applications/sqlite3/sqlite3: 1.93% (16.2614 => 16.5755, std. dev.: 0.0055) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.86% (2.1007 => 2.1398, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.86% (1.3813 => 1.4070, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.77% (3.6692 => 3.7340, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.75% (1.3819 => 1.4061, std. dev.: 0.0014) MultiSource/Applications/spiff/spiff: 1.73% (0.7506 => 0.7636, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.72% (0.6283 => 0.6391, std. dev.: 0.0001) MultiSource/Applications/SIBsim4/SIBsim4: 1.57% (1.2749 => 1.2949, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.46% (3.2742 => 3.3220, std. dev.: 0.0058) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.44% (1.5188 => 1.5407, std. dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 1.32% (14.8535 => 15.0499, std. dev.: 0.0129) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.23% (1.1333 => 1.1472, std. dev.: 0.0005) MultiSource/Applications/d/make_dparser: 1.13% (3.1889 => 3.2249, std. dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 1.06% (6.5754 => 6.6453, std. dev.: 0.0144) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.26% (1.8175 => 2.2584, std. dev.: 0.0366) SingleSource/Benchmarks/Misc/mandel-2: 7.80% (1.2998 => 1.4012, std. dev.: 0.0060) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.93% (1.5824 => 1.6762, std. dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 4.77% (4.5928 => 4.8117, std. dev.: 0.0478) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9877, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.67% (1.7688 => 1.8338, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 3.64% (7.4271 => 7.6973, std. dev.: 0.0049) MultiSource/Benchmarks/nbench/nbench: 3.13% (11.2619 => 11.6145, std. dev.: 0.0047) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4551, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: 2.87% (1.9199 => 1.9750, std. dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.85% (8.8259 => 9.0770, std. dev.: 0.0144) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9393, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.53% (7.9275 => 8.1282, std. dev.: 0.0119) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.56% (0.8273 => 0.8402, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: 1.49% (1.9290 => 1.9577, std. dev.: 0.0012) MultiSource/Applications/siod/siod: 1.46% (3.2729 => 3.3208, std. dev.: 0.0092) MultiSource/Benchmarks/sim/sim: 1.46% (5.0168 => 5.0900, std. dev.: 0.0024) MultiSource/Applications/lemon/lemon: 1.45% (1.4298 => 1.4506, std. dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5093, std. dev.: 0.0077) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.27% (2.0200 => 2.0456, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0036) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.15% (1.9433 => 1.9656, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 1.11% (9.0760 => 9.1764, std. dev.: 0.0022) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -19.09% (0.4657 => 0.3768, std. dev.: 0.0114) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.57% (0.2670 => 0.2468, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.95% (0.3511 => 0.3302, std. dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.83% (22.5627 => 21.2482, std. dev.: 0.0092) SingleSource/UnitTests/ObjC/exceptions-2: -3.42% (0.3601 => 0.3478, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -3.33% (0.3663 => 0.3541, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.32% (0.8818 => 0.8525, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-4: -3.29% (0.3646 => 0.3526, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.26% (0.3650 => 0.3531, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/trivial-interface: -3.13% (0.3578 => 0.3466, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -3.06% (0.3789 => 0.3673, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -3.02% (0.3940 => 0.3821, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -2.73% (0.3914 => 0.3807, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: -2.50% (0.4003 => 0.3903, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.08% (0.6576 => 0.6439, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: -1.60% (0.6250 => 0.6150, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -10.23% (1.2308 => 1.1049, std. dev.: 0.0048) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.59% (0.3139 => 0.2932, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9474, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.47% (1.3780 => 1.3164, std. dev.: 0.0041) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -4.02% (2.5089 => 2.4080, std. dev.: 0.0016) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -3.61% (1.9762 => 1.9049, std. dev.: 0.0106) SingleSource/Benchmarks/Misc/richards_benchmark: -2.14% (1.1560 => 1.1313, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.13% (20.3410 => 19.9085, std. dev.: 0.0339) SingleSource/Benchmarks/Shootout/lists: -2.04% (6.3560 => 6.2265, std. dev.: 0.0085) MultiSource/Applications/minisat/minisat: -1.95% (9.3358 => 9.1533, std. dev.: 0.0221) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.93% (6.6320 => 6.5038, std. dev.: 0.0029) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6922, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9957, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.41% (3.9173 => 3.8622, std. dev.: 0.0007) MultiSource/Applications/lua/lua: -1.33% (26.5159 => 26.1638, std. dev.: 0.0221) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.21% (3.8887 => 3.8418, std. dev.: 0.0101) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.37s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu May 17 15:49:27 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 17 May 2012 17:49:27 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120517224927.460152A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/694?compare_to=693&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 694, Order: 157017, Start Time: 2012-05-17 21:53:38, End Time: 2012-05-17 22:50:16 To: 693, Order: 157007, Start Time: 2012-05-17 20:30:03, End Time: 2012-05-17 21:26:38 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (69 on baseline) Performance Improvements: 0 (38 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (781 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.19% (2.0176 => 2.2837, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.96% (0.3130 => 0.3379, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.45% (0.2721 => 0.2842, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.78% (3.9660 => 4.1161, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.61% (0.5265 => 0.5455, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.55% (0.6959 => 0.7206, std. dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 3.31% (13.8202 => 14.2776, std. dev.: 0.0131) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.24% (0.9199 => 0.9497, std. dev.: 0.0042) MultiSource/Benchmarks/nbench/nbench: 3.11% (1.0594 => 1.0923, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/football/football: 3.04% (0.8310 => 0.8563, std. dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: 3.03% (16.6129 => 17.1165, std. dev.: 0.0104) MultiSource/Applications/siod/siod: 2.98% (2.1791 => 2.2440, std. dev.: 0.0089) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.91% (0.5637 => 0.5801, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 2.83% (3.8646 => 3.9739, std. dev.: 0.0011) MultiSource/Applications/lambda-0_1_3/lambda: 2.83% (0.7038 => 0.7237, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.75% (1.2193 => 1.2528, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.75% (1.1364 => 1.1676, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.63% (1.4563 => 1.4946, std. dev.: 0.0022) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.52% (0.7710 => 0.7904, std. dev.: 0.0039) MultiSource/Applications/Burg/burg: 2.50% (1.1061 => 1.1338, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.49% (0.5577 => 0.5716, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 2.40% (1.9270 => 1.9732, std. dev.: 0.0154) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.33% (0.7460 => 0.7634, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.33% (1.3245 => 1.3553, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 2.31% (0.4328 => 0.4428, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.23% (0.4791 => 0.4898, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.11% (13.2842 => 13.5651, std. dev.: 0.0095) MultiSource/Applications/hbd/hbd: 2.10% (1.3693 => 1.3980, std. dev.: 0.0050) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.02% (2.1007 => 2.1432, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.95% (1.3813 => 1.4082, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.85% (1.3819 => 1.4075, std. dev.: 0.0048) MultiSource/Applications/sqlite3/sqlite3: 1.83% (16.2614 => 16.5591, std. dev.: 0.0399) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.64% (3.6692 => 3.7294, std. dev.: 0.0025) MultiSource/Applications/spiff/spiff: 1.61% (0.7506 => 0.7627, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.55% (1.5188 => 1.5423, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.54% (3.2742 => 3.3247, std. dev.: 0.0057) MultiSource/Applications/minisat/minisat: 1.54% (0.6744 => 0.6848, std. dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 1.51% (1.2749 => 1.2941, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.46% (1.1333 => 1.1499, std. dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 1.32% (14.8535 => 15.0500, std. dev.: 0.0133) MultiSource/Applications/d/make_dparser: 1.17% (3.1889 => 3.2263, std. dev.: 0.0102) MultiSource/Applications/JM/ldecod/ldecod: 1.17% (6.5754 => 6.6525, std. dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.05% (7.2180 => 7.2941, std. dev.: 0.0012) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.56% (1.8175 => 2.2639, std. dev.: 0.0210) SingleSource/Benchmarks/Misc/mandel-2: 7.63% (1.2998 => 1.3990, std. dev.: 0.0122) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7298, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6755, std. dev.: 0.0017) MultiSource/Applications/sqlite3/sqlite3: 4.79% (4.5928 => 4.8128, std. dev.: 0.0398) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8143, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9876, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.66% (1.7688 => 1.8336, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/salsa20: 3.48% (7.4271 => 7.6858, std. dev.: 0.0105) MultiSource/Benchmarks/nbench/nbench: 3.11% (11.2619 => 11.6122, std. dev.: 0.0030) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4541, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-6: 2.86% (1.9199 => 1.9749, std. dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.86% (8.8259 => 9.0786, std. dev.: 0.0210) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9392, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.28% (7.9275 => 8.1080, std. dev.: 0.0114) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.60% (0.8273 => 0.8405, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 1.46% (3.2729 => 3.3206, std. dev.: 0.0024) MultiSource/Applications/lemon/lemon: 1.41% (1.4298 => 1.4499, std. dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.39% (8.3908 => 8.5074, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.28% (2.0200 => 2.0458, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.21% (1.9433 => 1.9668, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1781, std. dev.: 0.0008) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -16.19% (0.4657 => 0.3903, std. dev.: 0.0240) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.53% (0.2670 => 0.2469, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.98% (0.3511 => 0.3301, std. dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.67% (22.5627 => 21.2840, std. dev.: 0.0042) SingleSource/UnitTests/ObjC/exceptions-3: -3.45% (0.3623 => 0.3498, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.37% (0.3650 => 0.3527, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -3.33% (0.3601 => 0.3481, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.32% (0.8818 => 0.8525, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/trivial-interface: -3.30% (0.3578 => 0.3460, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -3.28% (0.3663 => 0.3543, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -3.18% (0.3646 => 0.3530, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: -3.04% (0.3789 => 0.3674, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -2.94% (0.3940 => 0.3824, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -2.76% (0.3914 => 0.3806, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -2.65% (0.4003 => 0.3897, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.14% (0.6576 => 0.6435, std. dev.: 0.0015) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -10.43% (1.2308 => 1.1024, std. dev.: 0.0047) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0016) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.53% (0.3139 => 0.2934, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-3: -6.21% (2.4152 => 2.2652, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9474, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.75% (1.3780 => 1.3125, std. dev.: 0.0034) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -4.03% (2.5089 => 2.4078, std. dev.: 0.0014) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -3.66% (1.9762 => 1.9038, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/richards_benchmark: -2.13% (1.1560 => 1.1314, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: -2.08% (9.3358 => 9.1420, std. dev.: 0.0173) SingleSource/Benchmarks/Shootout/lists: -2.04% (6.3560 => 6.2264, std. dev.: 0.0096) MultiSource/Benchmarks/mafft/pairlocalalign: -1.89% (28.2225 => 27.6904, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.86% (6.6320 => 6.5085, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3446, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9955, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.59% (20.3410 => 20.0181, std. dev.: 0.0599) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.37% (3.9173 => 3.8636, std. dev.: 0.0170) MultiSource/Applications/lua/lua: -1.34% (26.5159 => 26.1605, std. dev.: 0.0111) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.36s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu May 17 17:12:59 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 17 May 2012 19:12:59 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120518001259.7FFC32A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/695?compare_to=694&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 695, Order: 157021, Start Time: 2012-05-17 23:17:13, End Time: 2012-05-18 00:13:49 To: 694, Order: 157017, Start Time: 2012-05-17 21:53:38, End Time: 2012-05-17 22:50:16 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (70 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (779 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.95% (2.0176 => 2.2991, std. dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.60% (0.3130 => 0.3368, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.56% (0.2721 => 0.2845, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.94% (3.9660 => 4.1222, std. dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.58% (0.6959 => 0.7208, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.53% (0.5265 => 0.5451, std. dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 3.41% (13.8202 => 14.2921, std. dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.37% (0.9199 => 0.9509, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 3.35% (1.0594 => 1.0949, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.16% (0.5637 => 0.5815, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 3.10% (0.8310 => 0.8568, std. dev.: 0.0056) MultiSource/Applications/kimwitu++/kc: 3.04% (16.6129 => 17.1183, std. dev.: 0.0301) MultiSource/Applications/siod/siod: 2.94% (2.1791 => 2.2431, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.89% (1.1364 => 1.1692, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.76% (1.2193 => 1.2530, std. dev.: 0.0007) MultiSource/Applications/Burg/burg: 2.66% (1.1061 => 1.1355, std. dev.: 0.0055) MultiSource/Applications/lambda-0_1_3/lambda: 2.64% (0.7038 => 0.7224, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 2.58% (3.8646 => 3.9642, std. dev.: 0.0078) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.56% (1.4563 => 1.4936, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.48% (1.3245 => 1.3574, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.48% (13.2842 => 13.6133, std. dev.: 0.0174) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.47% (0.5577 => 0.5715, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 2.47% (0.4328 => 0.4435, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 2.38% (1.9270 => 1.9728, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.23% (0.7460 => 0.7626, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.22% (0.7710 => 0.7881, std. dev.: 0.0031) MultiSource/Applications/hbd/hbd: 2.21% (1.3693 => 1.3996, std. dev.: 0.0017) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.01% (1.3813 => 1.4090, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.97% (1.3819 => 1.4091, std. dev.: 0.0014) MultiSource/Applications/sqlite3/sqlite3: 1.84% (16.2614 => 16.5604, std. dev.: 0.0140) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.84% (2.1007 => 2.1393, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.81% (3.6692 => 3.7356, std. dev.: 0.0108) MultiSource/Applications/SIBsim4/SIBsim4: 1.57% (1.2749 => 1.2949, std. dev.: 0.0015) MultiSource/Applications/spiff/spiff: 1.53% (0.7506 => 0.7621, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: 1.53% (0.6744 => 0.6847, std. dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 1.46% (14.8535 => 15.0709, std. dev.: 0.0061) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.40% (3.2742 => 3.3202, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.37% (1.5188 => 1.5396, std. dev.: 0.0023) MultiSource/Applications/JM/ldecod/ldecod: 1.32% (6.5754 => 6.6623, std. dev.: 0.0144) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.31% (1.1333 => 1.1481, std. dev.: 0.0023) MultiSource/Applications/d/make_dparser: 1.21% (3.1889 => 3.2275, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.14% (7.2180 => 7.3000, std. dev.: 0.0093) MultiSource/Applications/lemon/lemon: 1.11% (1.0313 => 1.0427, std. dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: 1.05% (33.2944 => 33.6445, std. dev.: 0.0093) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.18% (1.8175 => 2.2569, std. dev.: 0.0155) SingleSource/Benchmarks/Misc/mandel-2: 8.17% (1.2998 => 1.4060, std. dev.: 0.0042) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.87% (1.5824 => 1.6753, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.81% (1.9144 => 1.9874, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.69% (1.7688 => 1.8341, std. dev.: 0.0110) SingleSource/Benchmarks/Misc/salsa20: 3.64% (7.4271 => 7.6971, std. dev.: 0.0035) MultiSource/Benchmarks/nbench/nbench: 3.13% (11.2619 => 11.6146, std. dev.: 0.0032) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4540, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-6: 2.86% (1.9199 => 1.9748, std. dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.78% (8.8259 => 9.0709, std. dev.: 0.0085) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9392, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.23% (7.9275 => 8.1046, std. dev.: 0.0082) SingleSource/Benchmarks/Misc/ffbench: 1.62% (0.8273 => 0.8407, std. dev.: 0.0015) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0009) MultiSource/Applications/lemon/lemon: 1.47% (1.4298 => 1.4508, std. dev.: 0.0030) MultiSource/Applications/siod/siod: 1.46% (3.2729 => 3.3207, std. dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5096, std. dev.: 0.0070) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.28% (2.0200 => 2.0459, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2135, std. dev.: 0.0005) MultiSource/Benchmarks/sim/sim: 1.15% (5.0168 => 5.0747, std. dev.: 0.0069) SingleSource/Benchmarks/Misc/flops: 1.13% (9.0760 => 9.1788, std. dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.10% (1.9433 => 1.9647, std. dev.: 0.0013) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -19.56% (0.4657 => 0.3746, std. dev.: 0.0121) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.15% (0.2670 => 0.2479, std. dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.78% (22.5627 => 21.2584, std. dev.: 0.0112) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.70% (0.3511 => 0.3311, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -3.95% (0.3623 => 0.3480, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.78% (0.3650 => 0.3512, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/trivial-interface: -3.77% (0.3578 => 0.3443, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -3.72% (0.3601 => 0.3467, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -3.63% (0.3663 => 0.3530, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: -3.62% (0.3646 => 0.3514, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -3.54% (0.3789 => 0.3655, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -3.38% (0.3940 => 0.3807, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.35% (0.8818 => 0.8523, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions: -3.27% (0.3914 => 0.3786, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: -3.10% (0.4003 => 0.3879, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.13% (0.6576 => 0.6436, std. dev.: 0.0008) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -9.81% (1.2308 => 1.1100, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.16% (1.0460 => 0.9502, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.53% (0.3139 => 0.2934, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9473, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.82% (1.3780 => 1.3116, std. dev.: 0.0079) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -4.03% (2.5089 => 2.4079, std. dev.: 0.0015) MultiSource/Benchmarks/Olden/bh/bh: -3.62% (1.9762 => 1.9046, std. dev.: 0.0065) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.59% (0.3458 => 0.3334, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: -2.12% (1.1560 => 1.1315, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: -2.09% (9.3358 => 9.1405, std. dev.: 0.0358) SingleSource/Benchmarks/Shootout/lists: -2.03% (6.3560 => 6.2270, std. dev.: 0.0034) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.91% (6.6320 => 6.5056, std. dev.: 0.0017) MultiSource/Benchmarks/mafft/pairlocalalign: -1.87% (28.2225 => 27.6937, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.74% (20.3410 => 19.9865, std. dev.: 0.0165) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9954, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.47% (3.9173 => 3.8599, std. dev.: 0.0105) MultiSource/Applications/lua/lua: -1.45% (26.5159 => 26.1312, std. dev.: 0.0320) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.12% (3.8887 => 3.8453, std. dev.: 0.0057) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.58s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu May 17 18:36:21 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 17 May 2012 20:36:21 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120518013621.C259C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/696?compare_to=695&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 696, Order: 157030, Start Time: 2012-05-18 00:40:41, End Time: 2012-05-18 01:37:11 To: 695, Order: 157021, Start Time: 2012-05-17 23:17:13, End Time: 2012-05-18 00:13:49 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (64 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (784 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.92% (2.0176 => 2.2984, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.67% (0.3130 => 0.3370, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.52% (0.2721 => 0.2844, std. dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.59% (3.9660 => 4.1085, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.29% (0.5265 => 0.5438, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.28% (0.6959 => 0.7187, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 3.17% (13.8202 => 14.2581, std. dev.: 0.0125) MultiSource/Benchmarks/nbench/nbench: 3.07% (1.0594 => 1.0919, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.05% (0.9199 => 0.9480, std. dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 2.93% (16.6129 => 17.1000, std. dev.: 0.0138) MultiSource/Benchmarks/Prolangs-C/football/football: 2.85% (0.8310 => 0.8547, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.77% (0.5637 => 0.5793, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 2.72% (2.1791 => 2.2383, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.61% (1.1364 => 1.1661, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.49% (1.2193 => 1.2497, std. dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: 2.43% (0.7038 => 0.7209, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 2.38% (0.4328 => 0.4431, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 2.36% (3.8646 => 3.9559, std. dev.: 0.0027) MultiSource/Applications/Burg/burg: 2.35% (1.1061 => 1.1321, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.31% (0.5577 => 0.5706, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.20% (1.4563 => 1.4884, std. dev.: 0.0018) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.14% (0.7710 => 0.7875, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.14% (1.3245 => 1.3528, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.12% (13.2842 => 13.5654, std. dev.: 0.0023) MultiSource/Applications/treecc/treecc: 2.09% (1.9270 => 1.9672, std. dev.: 0.0072) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.02% (0.7460 => 0.7611, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 1.70% (1.3693 => 1.3926, std. dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 1.67% (16.2614 => 16.5331, std. dev.: 0.0075) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.51% (3.6692 => 3.7245, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.43% (1.3819 => 1.4017, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.41% (2.1007 => 2.1304, std. dev.: 0.0008) MultiSource/Applications/spiff/spiff: 1.40% (0.7506 => 0.7611, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.37% (1.3813 => 1.4002, std. dev.: 0.0008) MultiSource/Applications/SIBsim4/SIBsim4: 1.36% (1.2749 => 1.2922, std. dev.: 0.0013) MultiSource/Applications/JM/lencod/lencod: 1.15% (14.8535 => 15.0249, std. dev.: 0.0076) MultiSource/Applications/d/make_dparser: 1.03% (3.1889 => 3.2219, std. dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: 1.03% (6.5754 => 6.6434, std. dev.: 0.0046) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.01% (1.1333 => 1.1448, std. dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.28% (1.8175 => 2.2587, std. dev.: 0.0412) SingleSource/Benchmarks/Misc/mandel-2: 8.12% (1.2998 => 1.4053, std. dev.: 0.0088) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.52% (2.5629 => 2.7299, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.89% (1.5824 => 1.6756, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8143, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.81% (1.9144 => 1.9873, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.65% (1.7688 => 1.8334, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: 3.58% (7.4271 => 7.6929, std. dev.: 0.0033) MultiSource/Benchmarks/nbench/nbench: 3.12% (11.2619 => 11.6134, std. dev.: 0.0032) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4543, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: 2.89% (1.9199 => 1.9754, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.78% (8.8259 => 9.0717, std. dev.: 0.0071) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.76% (2.8606 => 2.9395, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.25% (7.9275 => 8.1055, std. dev.: 0.0112) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.61% (0.8273 => 0.8406, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 1.45% (3.2729 => 3.3204, std. dev.: 0.0022) MultiSource/Applications/lemon/lemon: 1.44% (1.4298 => 1.4504, std. dev.: 0.0024) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5093, std. dev.: 0.0006) MultiSource/Benchmarks/sim/sim: 1.37% (5.0168 => 5.0856, std. dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.27% (2.0200 => 2.0457, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.18% (1.9433 => 1.9662, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/flops: 1.13% (9.0760 => 9.1784, std. dev.: 0.0014) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -20.87% (0.4657 => 0.3685, std. dev.: 0.0074) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.90% (0.2670 => 0.2459, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.07% (0.3511 => 0.3298, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.90% (22.5627 => 21.2312, std. dev.: 0.0097) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.75% (0.8818 => 0.8487, std. dev.: 0.0112) SingleSource/UnitTests/ObjC/exceptions-3: -3.51% (0.3623 => 0.3496, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -3.44% (0.3601 => 0.3477, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.37% (0.3650 => 0.3527, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/trivial-interface: -3.33% (0.3578 => 0.3459, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -3.28% (0.3663 => 0.3543, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -3.24% (0.3646 => 0.3528, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -3.09% (0.3789 => 0.3672, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -3.02% (0.3940 => 0.3821, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -2.84% (0.3914 => 0.3803, std. dev.: 0.0027) SingleSource/UnitTests/ObjC/parameter-passing: -2.72% (0.4003 => 0.3894, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.33% (0.6576 => 0.6423, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: -1.79% (0.6250 => 0.6138, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.10% (0.9108 => 0.9008, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -10.53% (1.2308 => 1.1012, std. dev.: 0.0063) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.16% (1.0460 => 0.9502, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.53% (0.3139 => 0.2934, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9474, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.98% (2.5089 => 2.4091, std. dev.: 0.0031) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: -3.57% (1.9762 => 1.9056, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.17% (20.3410 => 19.9006, std. dev.: 0.0477) SingleSource/Benchmarks/Misc/richards_benchmark: -2.11% (1.1560 => 1.1316, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -2.04% (6.3560 => 6.2266, std. dev.: 0.0009) MultiSource/Applications/minisat/minisat: -2.01% (9.3358 => 9.1485, std. dev.: 0.0137) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.90% (6.6320 => 6.5058, std. dev.: 0.0051) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6908, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9955, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.52% (3.9173 => 3.8577, std. dev.: 0.0047) MultiSource/Applications/lua/lua: -1.21% (26.5159 => 26.1941, std. dev.: 0.0189) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.05% (3.8887 => 3.8479, std. dev.: 0.0058) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.53s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu May 17 19:59:46 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 17 May 2012 21:59:46 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120518025946.936B62A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/697?compare_to=696&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 697, Order: 157037, Start Time: 2012-05-18 02:04:04, End Time: 2012-05-18 03:00:36 To: 696, Order: 157030, Start Time: 2012-05-18 00:40:41, End Time: 2012-05-18 01:37:11 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (58 on baseline) Performance Improvements: 0 (42 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 891 (788 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/sqlite3/sqlite3: 2.59% (4.7264 => 4.8490, std. dev.: 0.0308) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.06% (2.0176 => 2.3012, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.38% (0.3130 => 0.3361, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.19% (0.2721 => 0.2835, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.55% (3.9660 => 4.1067, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.23% (0.6959 => 0.7184, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 3.10% (1.0594 => 1.0922, std. dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 2.99% (13.8202 => 14.2329, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.95% (0.9199 => 0.9470, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/football/football: 2.84% (0.8310 => 0.8546, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.68% (1.1364 => 1.1668, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.63% (0.5637 => 0.5785, std. dev.: 0.0006) MultiSource/Applications/siod/siod: 2.62% (2.1791 => 2.2361, std. dev.: 0.0011) MultiSource/Applications/kimwitu++/kc: 2.59% (16.6129 => 17.0424, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.50% (1.2193 => 1.2498, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.36% (1.4563 => 1.4906, std. dev.: 0.0018) MultiSource/Applications/lambda-0_1_3/lambda: 2.26% (0.7038 => 0.7197, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 2.23% (3.8646 => 3.9508, std. dev.: 0.0096) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.19% (0.5577 => 0.5699, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.13% (0.7710 => 0.7874, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 2.11% (1.1061 => 1.1294, std. dev.: 0.0076) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.06% (13.2842 => 13.5585, std. dev.: 0.0153) MultiSource/Applications/treecc/treecc: 1.95% (1.9270 => 1.9645, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.94% (1.3245 => 1.3502, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.89% (0.7460 => 0.7601, std. dev.: 0.0016) MultiSource/Applications/sqlite3/sqlite3: 1.72% (16.2614 => 16.5418, std. dev.: 0.0083) MultiSource/Applications/hbd/hbd: 1.51% (1.3693 => 1.3900, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.49% (3.6692 => 3.7237, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.42% (2.1007 => 2.1306, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.33% (1.3813 => 1.3997, std. dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: 1.31% (1.2749 => 1.2916, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.26% (1.3819 => 1.3993, std. dev.: 0.0022) MultiSource/Applications/JM/lencod/lencod: 1.13% (14.8535 => 15.0211, std. dev.: 0.0124) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.05% (3.2742 => 3.3085, std. dev.: 0.0063) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 23.91% (1.8175 => 2.2520, std. dev.: 0.0097) SingleSource/Benchmarks/Misc/mandel-2: 8.49% (1.2998 => 1.4101, std. dev.: 0.0045) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.90% (1.5824 => 1.6757, std. dev.: 0.0054) MultiSource/Applications/sqlite3/sqlite3: 5.58% (4.5928 => 4.8490, std. dev.: 0.0308) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9878, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.70% (1.7688 => 1.8342, std. dev.: 0.0059) SingleSource/Benchmarks/Misc/salsa20: 3.56% (7.4271 => 7.6912, std. dev.: 0.0061) MultiSource/Benchmarks/nbench/nbench: 3.18% (11.2619 => 11.6202, std. dev.: 0.0021) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4536, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.96% (8.8259 => 9.0873, std. dev.: 0.0229) SingleSource/Benchmarks/Misc/flops-6: 2.94% (1.9199 => 1.9764, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9392, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.66% (7.9275 => 8.1386, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9601, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.56% (0.8273 => 0.8402, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: 1.49% (1.4298 => 1.4511, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 1.43% (3.2729 => 3.3198, std. dev.: 0.0102) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5101, std. dev.: 0.0076) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.28% (2.0200 => 2.0458, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: 1.11% (9.0760 => 9.1767, std. dev.: 0.0012) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -19.80% (0.4657 => 0.3735, std. dev.: 0.0199) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.83% (0.2670 => 0.2461, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.15% (0.3511 => 0.3295, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.08% (22.5627 => 21.1916, std. dev.: 0.0043) SingleSource/UnitTests/ObjC/exceptions-3: -4.61% (0.3623 => 0.3456, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -4.58% (0.3601 => 0.3436, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.47% (0.3650 => 0.3487, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -4.42% (0.3663 => 0.3501, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -4.42% (0.3578 => 0.3420, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -4.36% (0.3646 => 0.3487, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -4.20% (0.3789 => 0.3630, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -4.06% (0.3940 => 0.3780, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -3.86% (0.3914 => 0.3763, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -3.82% (0.4003 => 0.3850, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.71% (0.8818 => 0.8491, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.60% (0.6576 => 0.6405, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: -2.10% (0.5818 => 0.5696, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: -1.97% (0.6250 => 0.6127, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: -1.57% (0.7061 => 0.6950, std. dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.11% (0.9108 => 0.9007, std. dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -10.53% (1.2308 => 1.1012, std. dev.: 0.0042) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.53% (0.3139 => 0.2934, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9474, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.40% (1.3780 => 1.3173, std. dev.: 0.0016) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -4.02% (2.5089 => 2.4080, std. dev.: 0.0016) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.73% (0.3458 => 0.3329, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.71% (1.9762 => 1.9029, std. dev.: 0.0098) SingleSource/Benchmarks/Misc/richards_benchmark: -2.14% (1.1560 => 1.1313, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -2.00% (6.3560 => 6.2286, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.93% (20.3410 => 19.9492, std. dev.: 0.0503) MultiSource/Applications/minisat/minisat: -1.90% (9.3358 => 9.1584, std. dev.: 0.0276) MultiSource/Benchmarks/mafft/pairlocalalign: -1.89% (28.2225 => 27.6902, std. dev.: 0.0016) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.81% (6.6320 => 6.5122, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9953, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) MultiSource/Applications/lua/lua: -1.36% (26.5159 => 26.1549, std. dev.: 0.0297) SingleSource/Benchmarks/Shootout/heapsort: -1.25% (3.9173 => 3.8682, std. dev.: 0.0032) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.37s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu May 17 21:23:12 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 17 May 2012 23:23:12 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120518042312.5E41B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/698?compare_to=697&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 698, Order: 157039, Start Time: 2012-05-18 03:27:29, End Time: 2012-05-18 04:24:02 To: 697, Order: 157037, Start Time: 2012-05-18 02:04:04, End Time: 2012-05-18 03:00:36 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (65 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 891 (786 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/sqlite3/sqlite3: 1.31% (4.8490 => 4.9127, std. dev.: 0.0063) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.08% (2.0176 => 2.3017, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.67% (0.3130 => 0.3370, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.67% (0.2721 => 0.2848, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.92% (3.9660 => 4.1215, std. dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.45% (0.6959 => 0.7199, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.38% (0.5265 => 0.5443, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 3.37% (1.0594 => 1.0951, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 3.26% (13.8202 => 14.2706, std. dev.: 0.0182) MultiSource/Benchmarks/Prolangs-C/football/football: 3.15% (0.8310 => 0.8572, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.14% (0.9199 => 0.9488, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.91% (0.5637 => 0.5801, std. dev.: 0.0013) MultiSource/Applications/siod/siod: 2.88% (2.1791 => 2.2419, std. dev.: 0.0018) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.85% (1.1364 => 1.1688, std. dev.: 0.0032) MultiSource/Applications/kimwitu++/kc: 2.82% (16.6129 => 17.0817, std. dev.: 0.0167) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.76% (1.2193 => 1.2529, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.71% (1.4563 => 1.4957, std. dev.: 0.0033) MultiSource/Applications/lambda-0_1_3/lambda: 2.64% (0.7038 => 0.7224, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 2.59% (0.4328 => 0.4440, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 2.56% (3.8646 => 3.9636, std. dev.: 0.0013) MultiSource/Applications/Burg/burg: 2.50% (1.1061 => 1.1338, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.47% (0.5577 => 0.5715, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.39% (0.7710 => 0.7894, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.36% (1.3245 => 1.3558, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.25% (13.2842 => 13.5833, std. dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.23% (0.4791 => 0.4898, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 2.23% (1.9270 => 1.9699, std. dev.: 0.0024) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.10% (0.7460 => 0.7617, std. dev.: 0.0009) MultiSource/Applications/hbd/hbd: 2.05% (1.3693 => 1.3974, std. dev.: 0.0025) MultiSource/Applications/sqlite3/sqlite3: 1.88% (16.2614 => 16.5678, std. dev.: 0.0074) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.87% (2.1007 => 2.1400, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.79% (3.6692 => 3.7347, std. dev.: 0.0092) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.69% (0.6283 => 0.6389, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.64% (1.3813 => 1.4039, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.51% (1.3819 => 1.4028, std. dev.: 0.0006) MultiSource/Applications/JM/lencod/lencod: 1.38% (14.8535 => 15.0584, std. dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.34% (3.2742 => 3.3181, std. dev.: 0.0031) MultiSource/Applications/JM/ldecod/ldecod: 1.26% (6.5754 => 6.6581, std. dev.: 0.0048) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.20% (1.1333 => 1.1469, std. dev.: 0.0003) MultiSource/Applications/d/make_dparser: 1.18% (3.1889 => 3.2264, std. dev.: 0.0008) MultiSource/Applications/lemon/lemon: 1.09% (1.0313 => 1.0425, std. dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 23.85% (1.8175 => 2.2510, std. dev.: 0.0181) SingleSource/Benchmarks/Misc/mandel-2: 8.00% (1.2998 => 1.4038, std. dev.: 0.0097) MultiSource/Applications/sqlite3/sqlite3: 6.97% (4.5928 => 4.9127, std. dev.: 0.0063) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6755, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9877, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/salsa20: 3.63% (7.4271 => 7.6964, std. dev.: 0.0013) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.56% (1.7688 => 1.8318, std. dev.: 0.0065) MultiSource/Benchmarks/nbench/nbench: 3.19% (11.2619 => 11.6211, std. dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: 3.01% (12.0921 => 12.4560, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-6: 2.92% (1.9199 => 1.9760, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.82% (8.8259 => 9.0749, std. dev.: 0.0139) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9394, std. dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.38% (7.9275 => 8.1160, std. dev.: 0.0137) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0084) MultiSource/Applications/lemon/lemon: 1.50% (1.4298 => 1.4513, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 1.45% (3.2729 => 3.3202, std. dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5087, std. dev.: 0.0040) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.29% (2.0200 => 2.0460, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.16% (1.9433 => 1.9658, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1779, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -20.81% (0.4657 => 0.3688, std. dev.: 0.0096) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.38% (0.2670 => 0.2473, std. dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.77% (22.5627 => 21.2606, std. dev.: 0.0178) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.70% (0.3511 => 0.3311, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -4.11% (0.3623 => 0.3474, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -4.03% (0.3601 => 0.3456, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.00% (0.3650 => 0.3504, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/synchronized: -3.99% (0.3663 => 0.3517, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -3.98% (0.3646 => 0.3501, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -3.91% (0.3578 => 0.3438, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -3.72% (0.3789 => 0.3648, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -3.68% (0.3940 => 0.3795, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -3.50% (0.3914 => 0.3777, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -3.30% (0.4003 => 0.3871, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.49% (0.6576 => 0.6412, std. dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -11.04% (1.2308 => 1.0949, std. dev.: 0.0085) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.16% (1.0460 => 0.9502, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.63% (0.3139 => 0.2931, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2642, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9474, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.17% (1.3780 => 1.3206, std. dev.: 0.0026) SingleSource/Benchmarks/Dhrystone/dry: -4.00% (2.5089 => 2.4086, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.67% (1.9762 => 1.9036, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/lists: -2.22% (6.3560 => 6.2147, std. dev.: 0.0174) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.16% (20.3410 => 19.9008, std. dev.: 0.0626) SingleSource/Benchmarks/Misc/richards_benchmark: -2.13% (1.1560 => 1.1314, std. dev.: 0.0010) MultiSource/Applications/minisat/minisat: -1.92% (9.3358 => 9.1567, std. dev.: 0.0101) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.89% (6.6320 => 6.5069, std. dev.: 0.0055) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6908, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3446, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9951, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.33% (3.9173 => 3.8651, std. dev.: 0.0024) MultiSource/Applications/lua/lua: -1.27% (26.5159 => 26.1797, std. dev.: 0.0051) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.59s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri May 18 01:16:05 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 18 May 2012 03:16:05 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120518081605.5BC132A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/699?compare_to=698&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 699, Order: 157043, Start Time: 2012-05-18 07:20:00, End Time: 2012-05-18 08:16:55 To: 698, Order: 157039, Start Time: 2012-05-18 03:27:29, End Time: 2012-05-18 04:24:02 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (66 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 891 (783 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/McGill/chomp: 1.29% (1.0949 => 1.1090, std. dev.: 0.0032) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.99% (2.0176 => 2.2999, std. dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.57% (0.3130 => 0.3367, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.56% (0.2721 => 0.2845, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.95% (3.9660 => 4.1225, std. dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.78% (0.6959 => 0.7222, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.34% (0.5265 => 0.5441, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 3.31% (1.0594 => 1.0945, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.24% (0.9199 => 0.9497, std. dev.: 0.0016) MultiSource/Applications/SPASS/SPASS: 3.23% (13.8202 => 14.2671, std. dev.: 0.0112) MultiSource/Benchmarks/Prolangs-C/football/football: 3.09% (0.8310 => 0.8567, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.01% (0.7710 => 0.7942, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.95% (1.1364 => 1.1699, std. dev.: 0.0011) MultiSource/Applications/siod/siod: 2.89% (2.1791 => 2.2421, std. dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.87% (0.5637 => 0.5799, std. dev.: 0.0011) MultiSource/Applications/kimwitu++/kc: 2.79% (16.6129 => 17.0764, std. dev.: 0.0206) MultiSource/Benchmarks/MallocBench/gs/gs: 2.74% (3.8646 => 3.9706, std. dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.72% (1.2193 => 1.2525, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.49% (0.5577 => 0.5716, std. dev.: 0.0032) MultiSource/Applications/Burg/burg: 2.49% (1.1061 => 1.1336, std. dev.: 0.0056) MultiSource/Applications/lambda-0_1_3/lambda: 2.44% (0.7038 => 0.7210, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.41% (1.4563 => 1.4914, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.30% (13.2842 => 13.5895, std. dev.: 0.0268) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.29% (1.3245 => 1.3548, std. dev.: 0.0006) MultiSource/Applications/hbd/hbd: 2.26% (1.3693 => 1.4003, std. dev.: 0.0049) MultiSource/Applications/treecc/treecc: 2.26% (1.9270 => 1.9706, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.21% (0.4791 => 0.4897, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.09% (0.7460 => 0.7616, std. dev.: 0.0014) MultiSource/Applications/sqlite3/sqlite3: 1.85% (16.2614 => 16.5626, std. dev.: 0.0097) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.83% (3.6692 => 3.7363, std. dev.: 0.0054) MultiSource/Applications/SIBsim4/SIBsim4: 1.71% (1.2749 => 1.2967, std. dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.70% (0.6283 => 0.6390, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.66% (2.1007 => 2.1355, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.59% (1.3819 => 1.4039, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.51% (1.3813 => 1.4022, std. dev.: 0.0007) MultiSource/Applications/spiff/spiff: 1.41% (0.7506 => 0.7612, std. dev.: 0.0015) MultiSource/Applications/JM/lencod/lencod: 1.41% (14.8535 => 15.0624, std. dev.: 0.0063) MultiSource/Applications/d/make_dparser: 1.29% (3.1889 => 3.2299, std. dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.28% (3.2742 => 3.3162, std. dev.: 0.0015) MultiSource/Applications/JM/ldecod/ldecod: 1.28% (6.5754 => 6.6597, std. dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.22% (1.1333 => 1.1471, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.12% (1.5188 => 1.5358, std. dev.: 0.0008) MultiSource/Applications/lemon/lemon: 1.06% (1.0313 => 1.0422, std. dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.17% (1.8175 => 2.2568, std. dev.: 0.0522) SingleSource/Benchmarks/Misc/mandel-2: 7.92% (1.2998 => 1.4028, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7298, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.87% (1.5824 => 1.6753, std. dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9878, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.70% (1.7688 => 1.8342, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 3.62% (7.4271 => 7.6962, std. dev.: 0.0052) MultiSource/Benchmarks/nbench/nbench: 3.15% (11.2619 => 11.6165, std. dev.: 0.0030) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.99% (8.8259 => 9.0901, std. dev.: 0.0063) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4537, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/flops-6: 2.82% (1.9199 => 1.9740, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9394, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.74% (7.9275 => 8.1444, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.60% (0.8273 => 0.8405, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 1.47% (3.2729 => 3.3211, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.45% (1.4298 => 1.4505, std. dev.: 0.0020) MultiSource/Benchmarks/NPB-serial/is/is: 1.43% (8.3908 => 8.5111, std. dev.: 0.0087) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.28% (2.0200 => 2.0458, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/flops: 1.11% (9.0760 => 9.1770, std. dev.: 0.0017) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.57% (0.2670 => 0.2468, std. dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.80% (22.5627 => 21.2530, std. dev.: 0.0116) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.78% (0.3511 => 0.3308, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-3: -4.06% (0.3623 => 0.3476, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.86% (0.3650 => 0.3509, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/trivial-interface: -3.86% (0.3578 => 0.3440, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -3.80% (0.3601 => 0.3464, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -3.77% (0.3663 => 0.3525, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -3.76% (0.3646 => 0.3509, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -3.54% (0.3789 => 0.3655, std. dev.: 0.0016) SingleSource/UnitTests/ObjC/property: -3.53% (0.3940 => 0.3801, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -3.32% (0.3914 => 0.3784, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: -3.17% (0.4003 => 0.3876, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.10% (0.8818 => 0.8545, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.16% (0.6576 => 0.6434, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/bigfib: -1.70% (0.6250 => 0.6144, std. dev.: 0.0009) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -9.90% (1.2308 => 1.1090, std. dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.16% (1.0460 => 0.9502, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.53% (0.3139 => 0.2934, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.09% (1.3780 => 1.3079, std. dev.: 0.0044) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9474, std. dev.: 0.0007) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.96% (2.5089 => 2.4096, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: -3.68% (1.9762 => 1.9035, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.67% (0.3458 => 0.3331, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: -2.31% (9.3358 => 9.1202, std. dev.: 0.0422) SingleSource/Benchmarks/Misc/richards_benchmark: -2.15% (1.1560 => 1.1311, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -2.02% (6.3560 => 6.2279, std. dev.: 0.0039) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.90% (20.3410 => 19.9536, std. dev.: 0.0174) MultiSource/Benchmarks/mafft/pairlocalalign: -1.87% (28.2225 => 27.6934, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.85% (6.6320 => 6.5093, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/fp-convert: -1.67% (3.4016 => 3.3448, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9955, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) MultiSource/Applications/lua/lua: -1.42% (26.5159 => 26.1400, std. dev.: 0.0142) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.36% (2.5254 => 2.4910, std. dev.: 0.0075) SingleSource/Benchmarks/Shootout/heapsort: -1.34% (3.9173 => 3.8648, std. dev.: 0.0057) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.61s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri May 18 02:40:03 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 18 May 2012 04:40:03 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120518094003.E73052A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/700?compare_to=699&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 700, Order: 157044, Start Time: 2012-05-18 08:43:59, End Time: 2012-05-18 09:40:54 To: 699, Order: 157043, Start Time: 2012-05-18 07:20:00, End Time: 2012-05-18 08:16:55 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (70 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 891 (783 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/minisat/minisat: 1.01% (9.1202 => 9.2124, std. dev.: 0.0285) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.10% (2.0176 => 2.3020, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.70% (0.3130 => 0.3371, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.63% (0.2721 => 0.2847, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.93% (3.9660 => 4.1218, std. dev.: 0.0052) MultiSource/Benchmarks/nbench/nbench: 3.70% (1.0594 => 1.0986, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.69% (0.6959 => 0.7216, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.44% (0.5265 => 0.5446, std. dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 3.32% (13.8202 => 14.2784, std. dev.: 0.0110) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.25% (0.9199 => 0.9498, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: 3.18% (0.8310 => 0.8574, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.02% (0.5637 => 0.5807, std. dev.: 0.0040) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.98% (1.1364 => 1.1703, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.87% (1.4563 => 1.4981, std. dev.: 0.0013) MultiSource/Applications/siod/siod: 2.82% (2.1791 => 2.2406, std. dev.: 0.0104) MultiSource/Applications/kimwitu++/kc: 2.78% (16.6129 => 17.0750, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.78% (1.2193 => 1.2532, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.62% (0.5577 => 0.5723, std. dev.: 0.0016) MultiSource/Benchmarks/MallocBench/gs/gs: 2.59% (3.8646 => 3.9648, std. dev.: 0.0092) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.54% (13.2842 => 13.6217, std. dev.: 0.0070) MultiSource/Applications/Burg/burg: 2.51% (1.1061 => 1.1339, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.42% (1.3245 => 1.3566, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 2.42% (1.9270 => 1.9736, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.41% (0.7710 => 0.7896, std. dev.: 0.0021) MultiSource/Applications/lambda-0_1_3/lambda: 2.34% (0.7038 => 0.7203, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.32% (0.7460 => 0.7633, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.32% (0.4791 => 0.4902, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 1.93% (16.2614 => 16.5757, std. dev.: 0.0087) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.86% (3.6692 => 3.7374, std. dev.: 0.0106) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.86% (2.1007 => 2.1397, std. dev.: 0.0012) MultiSource/Applications/hbd/hbd: 1.82% (1.3693 => 1.3942, std. dev.: 0.0046) MultiSource/Applications/SIBsim4/SIBsim4: 1.77% (1.2749 => 1.2975, std. dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.75% (0.6283 => 0.6393, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.72% (1.3813 => 1.4051, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.66% (1.3819 => 1.4049, std. dev.: 0.0012) MultiSource/Applications/minisat/minisat: 1.65% (0.6744 => 0.6855, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 1.60% (0.7506 => 0.7626, std. dev.: 0.0010) MultiSource/Applications/JM/lencod/lencod: 1.51% (14.8535 => 15.0784, std. dev.: 0.0158) MultiSource/Applications/d/make_dparser: 1.41% (3.1889 => 3.2340, std. dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.36% (3.2742 => 3.3188, std. dev.: 0.0096) MultiSource/Applications/JM/ldecod/ldecod: 1.31% (6.5754 => 6.6615, std. dev.: 0.0132) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.26% (1.5188 => 1.5380, std. dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.24% (1.1333 => 1.1474, std. dev.: 0.0037) MultiSource/Applications/lemon/lemon: 1.12% (1.0313 => 1.0429, std. dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: 1.06% (14.5298 => 14.6845, std. dev.: 0.0110) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.29% (1.8175 => 2.2589, std. dev.: 0.0484) SingleSource/Benchmarks/Misc/mandel-2: 7.57% (1.2998 => 1.3982, std. dev.: 0.0153) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.52% (2.5629 => 2.7299, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.89% (1.5824 => 1.6756, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: 3.86% (1.9144 => 1.9883, std. dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.72% (1.7688 => 1.8346, std. dev.: 0.0174) SingleSource/Benchmarks/Misc/salsa20: 3.69% (7.4271 => 7.7008, std. dev.: 0.0037) MultiSource/Benchmarks/nbench/nbench: 3.16% (11.2619 => 11.6174, std. dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 2.98% (12.0921 => 12.4525, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/flops-6: 2.88% (1.9199 => 1.9751, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9394, std. dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.75% (8.8259 => 9.0686, std. dev.: 0.0146) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.47% (7.9275 => 8.1231, std. dev.: 0.0161) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.63% (0.8273 => 0.8408, std. dev.: 0.0013) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9603, std. dev.: 0.0010) MultiSource/Applications/siod/siod: 1.46% (3.2729 => 3.3208, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: 1.45% (1.4298 => 1.4505, std. dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.43% (8.3908 => 8.5106, std. dev.: 0.0064) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.29% (2.0200 => 2.0460, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0036) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.16% (1.9433 => 1.9659, std. dev.: 0.0009) MultiSource/Benchmarks/sim/sim: 1.11% (5.0168 => 5.0727, std. dev.: 0.0109) SingleSource/Benchmarks/Misc/flops: 1.11% (9.0760 => 9.1769, std. dev.: 0.0019) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.57% (0.2670 => 0.2468, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.84% (0.3511 => 0.3306, std. dev.: 0.0013) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.61% (22.5627 => 21.2976, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-3: -3.95% (0.3623 => 0.3480, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -3.89% (0.3601 => 0.3461, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -3.86% (0.3578 => 0.3440, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -3.85% (0.3663 => 0.3522, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-4: -3.73% (0.3646 => 0.3510, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -3.51% (0.3789 => 0.3656, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -3.43% (0.3940 => 0.3805, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -3.27% (0.3914 => 0.3786, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.85% (0.8818 => 0.8567, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.99% (0.6576 => 0.6445, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -10.32% (1.2308 => 1.1038, std. dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.53% (0.3139 => 0.2934, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9473, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.48% (1.3780 => 1.3163, std. dev.: 0.0012) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -4.00% (2.5089 => 2.4085, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.67% (0.3458 => 0.3331, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -3.65% (1.9762 => 1.9041, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -2.22% (6.3560 => 6.2148, std. dev.: 0.0111) SingleSource/Benchmarks/Misc/richards_benchmark: -2.15% (1.1560 => 1.1311, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.06% (20.3410 => 19.9226, std. dev.: 0.0415) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.88% (6.6320 => 6.5071, std. dev.: 0.0037) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6926, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3446, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9951, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.56% (3.9173 => 3.8563, std. dev.: 0.0028) MultiSource/Applications/lua/lua: -1.53% (26.5159 => 26.1104, std. dev.: 0.0182) MultiSource/Applications/minisat/minisat: -1.32% (9.3358 => 9.2124, std. dev.: 0.0285) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.46s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri May 18 04:03:44 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 18 May 2012 06:03:44 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120518110344.25DAF2A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/701?compare_to=700&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 701, Order: 157046, Start Time: 2012-05-18 10:07:56, End Time: 2012-05-18 11:04:34 To: 700, Order: 157044, Start Time: 2012-05-18 08:43:59, End Time: 2012-05-18 09:40:54 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (61 on baseline) Performance Improvements: 1 (40 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 891 (787 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.33% (2.3020 => 2.2714, std. dev.: 0.0006) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.58% (2.0176 => 2.2714, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.16% (0.3130 => 0.3354, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.04% (0.2721 => 0.2831, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.38% (3.9660 => 4.1000, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.20% (0.6959 => 0.7182, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.02% (0.5265 => 0.5424, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.88% (0.9199 => 0.9464, std. dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 2.79% (1.0594 => 1.0890, std. dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 2.71% (13.8202 => 14.1951, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/football/football: 2.65% (0.8310 => 0.8530, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.42% (1.2193 => 1.2488, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.41% (0.5637 => 0.5773, std. dev.: 0.0027) MultiSource/Applications/siod/siod: 2.40% (2.1791 => 2.2315, std. dev.: 0.0041) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.34% (1.1364 => 1.1630, std. dev.: 0.0024) MultiSource/Applications/kimwitu++/kc: 2.32% (16.6129 => 16.9981, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.28% (1.4563 => 1.4895, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.22% (0.5577 => 0.5701, std. dev.: 0.0020) MultiSource/Benchmarks/MallocBench/gs/gs: 2.18% (3.8646 => 3.9487, std. dev.: 0.0142) MultiSource/Applications/lambda-0_1_3/lambda: 2.06% (0.7038 => 0.7183, std. dev.: 0.0022) MultiSource/Applications/treecc/treecc: 2.05% (1.9270 => 1.9665, std. dev.: 0.0040) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.97% (13.2842 => 13.5460, std. dev.: 0.0176) MultiSource/Applications/Burg/burg: 1.93% (1.1061 => 1.1275, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.93% (1.3245 => 1.3501, std. dev.: 0.0097) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.93% (0.7460 => 0.7604, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.78% (0.7710 => 0.7847, std. dev.: 0.0021) MultiSource/Applications/hbd/hbd: 1.49% (1.3693 => 1.3897, std. dev.: 0.0044) MultiSource/Applications/sqlite3/sqlite3: 1.47% (16.2614 => 16.5002, std. dev.: 0.0204) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.36% (2.1007 => 2.1293, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.30% (3.6692 => 3.7170, std. dev.: 0.0017) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.15% (1.3813 => 1.3972, std. dev.: 0.0012) MultiSource/Applications/SIBsim4/SIBsim4: 1.14% (1.2749 => 1.2894, std. dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.05% (3.2742 => 3.3087, std. dev.: 0.0015) MultiSource/Applications/JM/lencod/lencod: 1.04% (14.8535 => 15.0087, std. dev.: 0.0066) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.03% (1.3819 => 1.3962, std. dev.: 0.0050) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.01% (1.5188 => 1.5341, std. dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 27.02% (1.8175 => 2.3086, std. dev.: 0.0240) SingleSource/Benchmarks/Misc/mandel-2: 7.38% (1.2998 => 1.3957, std. dev.: 0.0070) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7298, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6755, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8147, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 3.86% (1.9144 => 1.9883, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.66% (1.7688 => 1.8335, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/salsa20: 3.59% (7.4271 => 7.6938, std. dev.: 0.0079) MultiSource/Applications/sqlite3/sqlite3: 3.34% (4.5928 => 4.7461, std. dev.: 0.0158) MultiSource/Benchmarks/nbench/nbench: 3.11% (11.2619 => 11.6117, std. dev.: 0.0044) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 3.02% (8.8259 => 9.0928, std. dev.: 0.0074) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4541, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-6: 2.88% (1.9199 => 1.9752, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9394, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.22% (7.9275 => 8.1034, std. dev.: 0.0168) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.61% (0.8273 => 0.8406, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 1.47% (3.2729 => 3.3209, std. dev.: 0.0008) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5088, std. dev.: 0.0058) MultiSource/Applications/lemon/lemon: 1.40% (1.4298 => 1.4498, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.25% (2.0200 => 2.0452, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/flops: 1.14% (9.0760 => 9.1791, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.13% (1.9433 => 1.9652, std. dev.: 0.0015) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -21.00% (0.4657 => 0.3679, std. dev.: 0.0082) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.16% (0.2670 => 0.2452, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.81% (0.3511 => 0.3272, std. dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.21% (22.5627 => 21.1623, std. dev.: 0.0099) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.70% (0.3650 => 0.3515, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -3.70% (0.3623 => 0.3489, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -3.60% (0.3663 => 0.3531, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: -3.55% (0.3601 => 0.3473, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -3.51% (0.3646 => 0.3518, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -3.47% (0.3578 => 0.3454, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/property: -3.32% (0.3940 => 0.3809, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -3.30% (0.3789 => 0.3664, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.19% (0.8818 => 0.8537, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions: -3.09% (0.3914 => 0.3793, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -2.97% (0.4003 => 0.3884, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.78% (0.6576 => 0.6393, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/bigfib: -2.11% (0.6250 => 0.6118, std. dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -9.82% (1.2308 => 1.1099, std. dev.: 0.0188) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.56% (0.3139 => 0.2933, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2642, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9472, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.83% (1.3780 => 1.3115, std. dev.: 0.0059) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -4.01% (2.5089 => 2.4083, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.61% (0.3458 => 0.3333, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -3.60% (1.9762 => 1.9051, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/richards_benchmark: -2.13% (1.1560 => 1.1314, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.12% (20.3410 => 19.9104, std. dev.: 0.1048) SingleSource/Benchmarks/Shootout/lists: -2.03% (6.3560 => 6.2272, std. dev.: 0.0042) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.95% (6.6320 => 6.5024, std. dev.: 0.0065) MultiSource/Applications/minisat/minisat: -1.92% (9.3358 => 9.1561, std. dev.: 0.0447) MultiSource/Benchmarks/mafft/pairlocalalign: -1.89% (28.2225 => 27.6884, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0156) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9952, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.56% (0.9692 => 0.9541, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.42% (3.9173 => 3.8616, std. dev.: 0.0042) MultiSource/Applications/lua/lua: -1.40% (26.5159 => 26.1460, std. dev.: 0.0219) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.09% (3.8887 => 3.8463, std. dev.: 0.0098) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.32s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri May 18 10:52:03 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 18 May 2012 12:52:03 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120518175203.A4E222A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/702?compare_to=701&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 702, Order: 157051, Start Time: 2012-05-18 16:56:07, End Time: 2012-05-18 17:52:54 To: 701, Order: 157046, Start Time: 2012-05-18 10:07:56, End Time: 2012-05-18 11:04:34 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (61 on baseline) Performance Improvements: 1 (37 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 891 (790 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/fbench: -2.36% (2.3086 => 2.2542, std. dev.: 0.0029) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.56% (2.0176 => 2.2710, std. dev.: 0.0137) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.12% (0.3130 => 0.3353, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.97% (0.2721 => 0.2829, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.43% (3.9660 => 4.1020, std. dev.: 0.0130) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.21% (0.5265 => 0.5434, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.18% (0.6959 => 0.7180, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/football/football: 2.86% (0.8310 => 0.8548, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 2.86% (1.0594 => 1.0897, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.82% (0.9199 => 0.9458, std. dev.: 0.0008) MultiSource/Applications/siod/siod: 2.77% (2.1791 => 2.2395, std. dev.: 0.0038) MultiSource/Applications/SPASS/SPASS: 2.75% (13.8202 => 14.2009, std. dev.: 0.0094) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.54% (0.5637 => 0.5780, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.48% (1.2193 => 1.2495, std. dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: 2.47% (0.7038 => 0.7212, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.45% (1.1364 => 1.1642, std. dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 2.43% (16.6129 => 17.0174, std. dev.: 0.0270) MultiSource/Benchmarks/MallocBench/gs/gs: 2.32% (3.8646 => 3.9543, std. dev.: 0.0098) MultiSource/Applications/Burg/burg: 2.25% (1.1061 => 1.1310, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.22% (0.5577 => 0.5701, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.13% (1.4563 => 1.4873, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.07% (1.3245 => 1.3519, std. dev.: 0.0030) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.06% (0.7460 => 0.7614, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.05% (0.7710 => 0.7868, std. dev.: 0.0023) MultiSource/Applications/treecc/treecc: 1.98% (1.9270 => 1.9652, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.87% (13.2842 => 13.5328, std. dev.: 0.0316) MultiSource/Applications/sqlite3/sqlite3: 1.54% (16.2614 => 16.5113, std. dev.: 0.0072) MultiSource/Applications/hbd/hbd: 1.53% (1.3693 => 1.3902, std. dev.: 0.0075) MultiSource/Applications/spiff/spiff: 1.43% (0.7506 => 0.7613, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.36% (2.1007 => 2.1292, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.35% (1.3819 => 1.4006, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.30% (3.6692 => 3.7170, std. dev.: 0.0123) MultiSource/Applications/SIBsim4/SIBsim4: 1.26% (1.2749 => 1.2909, std. dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.15% (3.2742 => 3.3117, std. dev.: 0.0020) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.14% (1.3813 => 1.3971, std. dev.: 0.0022) MultiSource/Applications/JM/lencod/lencod: 1.14% (14.8535 => 15.0227, std. dev.: 0.0031) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.03% (1.8175 => 2.2542, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/mandel-2: 8.01% (1.2998 => 1.4039, std. dev.: 0.0106) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.92% (1.5824 => 1.6761, std. dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9877, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.65% (1.7688 => 1.8334, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/salsa20: 3.59% (7.4271 => 7.6934, std. dev.: 0.0100) MultiSource/Benchmarks/nbench/nbench: 3.13% (11.2619 => 11.6148, std. dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 3.01% (12.0921 => 12.4562, std. dev.: 0.0013) MultiSource/Applications/sqlite3/sqlite3: 2.97% (4.5928 => 4.7293, std. dev.: 0.0190) SingleSource/Benchmarks/Misc/flops-6: 2.91% (1.9199 => 1.9758, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.85% (8.8259 => 9.0771, std. dev.: 0.0138) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9393, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.47% (7.9275 => 8.1231, std. dev.: 0.0096) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.61% (0.8273 => 0.8406, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 1.46% (3.2729 => 3.3208, std. dev.: 0.0037) MultiSource/Applications/lemon/lemon: 1.45% (1.4298 => 1.4506, std. dev.: 0.0013) MultiSource/Benchmarks/NPB-serial/is/is: 1.43% (8.3908 => 8.5107, std. dev.: 0.0089) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.28% (2.0200 => 2.0458, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0038) MultiSource/Benchmarks/sim/sim: 1.13% (5.0168 => 5.0734, std. dev.: 0.0116) SingleSource/Benchmarks/Misc/flops: 1.10% (9.0760 => 9.1755, std. dev.: 0.0014) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.16% (0.2670 => 0.2452, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.58% (0.3511 => 0.3280, std. dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.14% (22.5627 => 21.1781, std. dev.: 0.0094) SingleSource/UnitTests/ObjC/exceptions-3: -3.70% (0.3623 => 0.3489, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -3.67% (0.3601 => 0.3469, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -3.55% (0.3578 => 0.3451, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: -3.52% (0.3663 => 0.3534, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -3.48% (0.3646 => 0.3519, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -3.35% (0.3789 => 0.3662, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -3.30% (0.3940 => 0.3810, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.14% (0.8818 => 0.8541, std. dev.: 0.0019) SingleSource/UnitTests/ObjC/exceptions: -3.07% (0.3914 => 0.3794, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -2.90% (0.4003 => 0.3887, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.66% (0.6576 => 0.6401, std. dev.: 0.0018) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -10.49% (1.2308 => 1.1017, std. dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.63% (0.3139 => 0.2931, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.34% (1.3780 => 1.3044, std. dev.: 0.0066) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9473, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -4.00% (2.5089 => 2.4086, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.73% (0.3458 => 0.3329, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -3.68% (1.9762 => 1.9034, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout/lists: -2.43% (6.3560 => 6.2018, std. dev.: 0.0143) SingleSource/Benchmarks/Misc/richards_benchmark: -2.14% (1.1560 => 1.1313, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.95% (20.3410 => 19.9446, std. dev.: 0.0541) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.90% (6.6320 => 6.5062, std. dev.: 0.0034) MultiSource/Benchmarks/mafft/pairlocalalign: -1.87% (28.2225 => 27.6943, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: -1.80% (9.3358 => 9.1673, std. dev.: 0.0399) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3446, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9958, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) MultiSource/Applications/lua/lua: -1.50% (26.5159 => 26.1180, std. dev.: 0.0272) SingleSource/Benchmarks/Shootout/heapsort: -1.35% (3.9173 => 3.8644, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.03% (3.8887 => 3.8487, std. dev.: 0.0036) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.36s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri May 18 12:15:46 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 18 May 2012 14:15:46 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120518191546.534842A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/703?compare_to=702&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 703, Order: 157058, Start Time: 2012-05-18 18:19:56, End Time: 2012-05-18 19:16:37 To: 702, Order: 157051, Start Time: 2012-05-18 16:56:07, End Time: 2012-05-18 17:52:54 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (70 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (779 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.99% (2.0176 => 2.2797, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.70% (0.3130 => 0.3371, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.30% (0.2721 => 0.2838, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.74% (3.9660 => 4.1144, std. dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.68% (0.5265 => 0.5459, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.41% (0.6959 => 0.7196, std. dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 3.29% (13.8202 => 14.2755, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.24% (0.9199 => 0.9497, std. dev.: 0.0028) MultiSource/Benchmarks/nbench/nbench: 3.14% (1.0594 => 1.0927, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/football/football: 3.13% (0.8310 => 0.8570, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.93% (1.2193 => 1.2550, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.87% (0.5637 => 0.5799, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 2.84% (0.4328 => 0.4451, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.82% (1.1364 => 1.1685, std. dev.: 0.0008) MultiSource/Applications/siod/siod: 2.79% (2.1791 => 2.2399, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.64% (1.4563 => 1.4947, std. dev.: 0.0015) MultiSource/Applications/kimwitu++/kc: 2.59% (16.6129 => 17.0425, std. dev.: 0.0193) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.47% (0.5577 => 0.5715, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/gs/gs: 2.37% (3.8646 => 3.9561, std. dev.: 0.0087) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.35% (13.2842 => 13.5969, std. dev.: 0.0073) MultiSource/Applications/lambda-0_1_3/lambda: 2.33% (0.7038 => 0.7202, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.29% (1.3245 => 1.3548, std. dev.: 0.0009) MultiSource/Applications/treecc/treecc: 2.27% (1.9270 => 1.9707, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.26% (0.7710 => 0.7884, std. dev.: 0.0024) MultiSource/Applications/Burg/burg: 2.15% (1.1061 => 1.1299, std. dev.: 0.0009) MultiSource/Applications/hbd/hbd: 2.11% (1.3693 => 1.3982, std. dev.: 0.0045) MultiSource/Applications/sqlite3/sqlite3: 1.99% (16.2614 => 16.5843, std. dev.: 0.0227) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.97% (0.7460 => 0.7607, std. dev.: 0.0023) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.87% (1.3813 => 1.4071, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.83% (1.3819 => 1.4072, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.76% (3.6692 => 3.7339, std. dev.: 0.0050) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.63% (2.1007 => 2.1349, std. dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: 1.62% (1.2749 => 1.2955, std. dev.: 0.0028) MultiSource/Applications/JM/lencod/lencod: 1.48% (14.8535 => 15.0730, std. dev.: 0.0161) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.44% (3.2742 => 3.3215, std. dev.: 0.0012) MultiSource/Applications/spiff/spiff: 1.43% (0.7506 => 0.7613, std. dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.36% (1.5188 => 1.5395, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 1.24% (6.5754 => 6.6570, std. dev.: 0.0156) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.21% (1.1333 => 1.1470, std. dev.: 0.0019) MultiSource/Applications/d/make_dparser: 1.13% (3.1889 => 3.2248, std. dev.: 0.0022) MultiSource/Benchmarks/Bullet/bullet: 1.12% (33.2944 => 33.6666, std. dev.: 0.0070) MultiSource/Applications/hexxagon/hexxagon: 1.06% (1.2292 => 1.2422, std. dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.05% (7.2180 => 7.2937, std. dev.: 0.0072) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.09% (1.8175 => 2.2553, std. dev.: 0.0052) SingleSource/Benchmarks/Misc/mandel-2: 7.27% (1.2998 => 1.3943, std. dev.: 0.0123) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7298, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6754, std. dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8147, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 3.81% (1.9144 => 1.9873, std. dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.64% (1.7688 => 1.8331, std. dev.: 0.0060) SingleSource/Benchmarks/Misc/salsa20: 3.59% (7.4271 => 7.6935, std. dev.: 0.0098) MultiSource/Benchmarks/nbench/nbench: 3.16% (11.2619 => 11.6176, std. dev.: 0.0020) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4538, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.98% (8.8259 => 9.0886, std. dev.: 0.0121) SingleSource/Benchmarks/Misc/flops-6: 2.96% (1.9199 => 1.9767, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 2.86% (4.5928 => 4.7240, std. dev.: 0.0168) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.76% (2.8606 => 2.9395, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.41% (7.9275 => 8.1187, std. dev.: 0.0046) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.58% (0.8273 => 0.8404, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 1.42% (3.2729 => 3.3194, std. dev.: 0.0088) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5090, std. dev.: 0.0077) MultiSource/Applications/lemon/lemon: 1.40% (1.4298 => 1.4498, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.28% (2.0200 => 2.0458, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.19% (1.9433 => 1.9665, std. dev.: 0.0060) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/flops: 1.13% (9.0760 => 9.1784, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 1.10% (5.0168 => 5.0719, std. dev.: 0.0098) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.12% (0.2670 => 0.2480, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.38% (0.3511 => 0.3287, std. dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.92% (22.5627 => 21.2269, std. dev.: 0.0031) SingleSource/UnitTests/ObjC/exceptions-3: -3.97% (0.3623 => 0.3479, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -3.83% (0.3601 => 0.3463, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -3.78% (0.3646 => 0.3508, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -3.77% (0.3663 => 0.3525, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -3.72% (0.3578 => 0.3445, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.70% (0.3650 => 0.3515, std. dev.: 0.0034) SingleSource/UnitTests/ObjC/property: -3.40% (0.3940 => 0.3806, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -3.27% (0.3789 => 0.3665, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions: -3.19% (0.3914 => 0.3789, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -3.10% (0.4003 => 0.3879, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.67% (0.8818 => 0.8583, std. dev.: 0.0037) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.75% (0.6576 => 0.6461, std. dev.: 0.0042) SingleSource/Benchmarks/Misc-C++/bigfib: -1.70% (0.6250 => 0.6144, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -10.46% (1.2308 => 1.1021, std. dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.66% (0.3139 => 0.2930, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2641, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.31% (1.3780 => 1.3048, std. dev.: 0.0071) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9473, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -4.12% (2.5089 => 2.4055, std. dev.: 0.0023) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.67% (0.3458 => 0.3331, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -3.57% (1.9762 => 1.9057, std. dev.: 0.0087) SingleSource/Benchmarks/Shootout/lists: -2.30% (6.3560 => 6.2097, std. dev.: 0.0089) SingleSource/Benchmarks/Misc/richards_benchmark: -2.15% (1.1560 => 1.1312, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.06% (20.3410 => 19.9226, std. dev.: 0.0382) MultiSource/Benchmarks/mafft/pairlocalalign: -1.89% (28.2225 => 27.6903, std. dev.: 0.0020) MultiSource/Applications/minisat/minisat: -1.85% (9.3358 => 9.1635, std. dev.: 0.0297) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.79% (6.6320 => 6.5136, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9955, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) MultiSource/Applications/lua/lua: -1.47% (26.5159 => 26.1254, std. dev.: 0.0262) SingleSource/Benchmarks/Shootout/heapsort: -1.24% (3.9173 => 3.8686, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.07% (3.8887 => 3.8470, std. dev.: 0.0060) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.36s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri May 18 13:39:29 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 18 May 2012 15:39:29 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120518203929.C56F02A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/704?compare_to=703&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 704, Order: 157061, Start Time: 2012-05-18 19:43:35, End Time: 2012-05-18 20:40:20 To: 703, Order: 157058, Start Time: 2012-05-18 18:19:56, End Time: 2012-05-18 19:16:37 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (61 on baseline) Performance Improvements: 0 (38 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (789 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.01% (2.0176 => 2.2800, std. dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.38% (0.3130 => 0.3361, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.19% (0.2721 => 0.2835, std. dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.53% (3.9660 => 4.1060, std. dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.25% (0.6959 => 0.7185, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.19% (0.5265 => 0.5433, std. dev.: 0.0035) MultiSource/Benchmarks/nbench/nbench: 2.99% (1.0594 => 1.0911, std. dev.: 0.0025) MultiSource/Applications/SPASS/SPASS: 2.93% (13.8202 => 14.2253, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.92% (0.9199 => 0.9468, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/football/football: 2.91% (0.8310 => 0.8552, std. dev.: 0.0047) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.77% (1.1364 => 1.1679, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.67% (1.2193 => 1.2519, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.67% (0.5577 => 0.5726, std. dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.63% (0.5637 => 0.5785, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 2.38% (2.1791 => 2.2310, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.29% (1.4563 => 1.4897, std. dev.: 0.0013) MultiSource/Applications/kimwitu++/kc: 2.26% (16.6129 => 16.9888, std. dev.: 0.0073) MultiSource/Benchmarks/MallocBench/gs/gs: 2.18% (3.8646 => 3.9487, std. dev.: 0.0030) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.15% (0.7710 => 0.7876, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 2.15% (0.7038 => 0.7189, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.14% (1.3245 => 1.3529, std. dev.: 0.0094) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.10% (13.2842 => 13.5635, std. dev.: 0.0046) MultiSource/Applications/treecc/treecc: 1.97% (1.9270 => 1.9650, std. dev.: 0.0015) MultiSource/Applications/Burg/burg: 1.95% (1.1061 => 1.1277, std. dev.: 0.0061) MultiSource/Applications/sqlite3/sqlite3: 1.91% (16.2614 => 16.5712, std. dev.: 0.0209) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.90% (0.7460 => 0.7602, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.67% (1.3819 => 1.4050, std. dev.: 0.0007) MultiSource/Applications/hbd/hbd: 1.62% (1.3693 => 1.3915, std. dev.: 0.0049) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.59% (3.6692 => 3.7275, std. dev.: 0.0069) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.57% (1.3813 => 1.4030, std. dev.: 0.0012) MultiSource/Applications/SIBsim4/SIBsim4: 1.41% (1.2749 => 1.2929, std. dev.: 0.0018) MultiSource/Applications/JM/lencod/lencod: 1.37% (14.8535 => 15.0576, std. dev.: 0.0118) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.31% (3.2742 => 3.3172, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.30% (2.1007 => 2.1280, std. dev.: 0.0007) MultiSource/Applications/JM/ldecod/ldecod: 1.05% (6.5754 => 6.6446, std. dev.: 0.0055) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.51% (1.8175 => 2.2630, std. dev.: 0.0276) SingleSource/Benchmarks/Misc/mandel-2: 7.96% (1.2998 => 1.4033, std. dev.: 0.0112) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7298, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.86% (1.5824 => 1.6752, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8147, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9878, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.72% (1.7688 => 1.8346, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/salsa20: 3.65% (7.4271 => 7.6983, std. dev.: 0.0020) MultiSource/Applications/sqlite3/sqlite3: 3.18% (4.5928 => 4.7388, std. dev.: 0.0447) MultiSource/Benchmarks/nbench/nbench: 3.16% (11.2619 => 11.6178, std. dev.: 0.0044) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 3.03% (8.8259 => 9.0935, std. dev.: 0.0148) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4548, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: 2.92% (1.9199 => 1.9759, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9393, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.41% (7.9275 => 8.1186, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0065) SingleSource/Benchmarks/Misc/ffbench: 1.61% (0.8273 => 0.8406, std. dev.: 0.0016) MultiSource/Applications/siod/siod: 1.47% (3.2729 => 3.3210, std. dev.: 0.0004) MultiSource/Applications/lemon/lemon: 1.46% (1.4298 => 1.4507, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5089, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.28% (2.0200 => 2.0458, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.18% (1.9433 => 1.9662, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 1.13% (9.0760 => 9.1783, std. dev.: 0.0005) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.60% (0.2670 => 0.2467, std. dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.15% (22.5627 => 21.1748, std. dev.: 0.0184) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.70% (0.3511 => 0.3311, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -4.14% (0.3623 => 0.3473, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.00% (0.3650 => 0.3504, std. dev.: 0.0030) SingleSource/UnitTests/ObjC/exceptions-2: -3.94% (0.3601 => 0.3459, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -3.92% (0.3646 => 0.3503, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -3.90% (0.3663 => 0.3520, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -3.83% (0.3578 => 0.3441, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -3.55% (0.3940 => 0.3800, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -3.38% (0.3789 => 0.3661, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -3.25% (0.4003 => 0.3873, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -3.24% (0.3914 => 0.3787, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.98% (0.8818 => 0.8555, std. dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/bigfib: -2.10% (0.6250 => 0.6119, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.05% (0.6576 => 0.6441, std. dev.: 0.0011) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -9.74% (1.2308 => 1.1109, std. dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.53% (0.3139 => 0.2934, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9473, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -3.92% (2.5089 => 2.4106, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.65% (1.9762 => 1.9041, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/richards_benchmark: -2.10% (1.1560 => 1.1317, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -2.06% (6.3560 => 6.2248, std. dev.: 0.0035) MultiSource/Applications/minisat/minisat: -1.90% (9.3358 => 9.1587, std. dev.: 0.0052) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6916, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.87% (6.6320 => 6.5083, std. dev.: 0.0034) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.84% (20.3410 => 19.9671, std. dev.: 0.0854) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9955, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/heapsort: -1.32% (3.9173 => 3.8655, std. dev.: 0.0029) MultiSource/Applications/lua/lua: -1.30% (26.5159 => 26.1720, std. dev.: 0.0054) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.03% (2.5254 => 2.4995, std. dev.: 0.0036) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.28s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri May 18 15:03:08 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 18 May 2012 17:03:08 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120518220308.1A7592A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/705?compare_to=704&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 705, Order: 157064, Start Time: 2012-05-18 21:07:20, End Time: 2012-05-18 22:03:59 To: 704, Order: 157061, Start Time: 2012-05-18 19:43:35, End Time: 2012-05-18 20:40:20 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (69 on baseline) Performance Improvements: 1 (38 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 891 (781 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -1.46% (3.8167 => 3.7609, std. dev.: 0.0188) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.14% (2.0176 => 2.2827, std. dev.: 0.0166) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.32% (0.3130 => 0.3359, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.48% (0.2721 => 0.2843, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.81% (3.9660 => 4.1172, std. dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.40% (0.5265 => 0.5444, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.31% (0.6959 => 0.7189, std. dev.: 0.0015) MultiSource/Applications/SPASS/SPASS: 3.18% (13.8202 => 14.2603, std. dev.: 0.0170) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.05% (0.9199 => 0.9480, std. dev.: 0.0010) MultiSource/Applications/kimwitu++/kc: 3.04% (16.6129 => 17.1177, std. dev.: 0.0051) MultiSource/Benchmarks/nbench/nbench: 2.96% (1.0594 => 1.0908, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: 2.96% (0.8310 => 0.8556, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.82% (0.5637 => 0.5796, std. dev.: 0.0009) MultiSource/Applications/siod/siod: 2.80% (2.1791 => 2.2401, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.78% (0.7710 => 0.7924, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash2: 2.77% (0.4328 => 0.4448, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.67% (1.2193 => 1.2519, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.63% (1.1364 => 1.1663, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/gs/gs: 2.49% (3.8646 => 3.9607, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.44% (0.5577 => 0.5713, std. dev.: 0.0024) MultiSource/Applications/lambda-0_1_3/lambda: 2.43% (0.7038 => 0.7209, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 2.40% (1.1061 => 1.1327, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.39% (1.4563 => 1.4911, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.30% (1.3245 => 1.3550, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.25% (13.2842 => 13.5832, std. dev.: 0.0064) MultiSource/Applications/treecc/treecc: 2.22% (1.9270 => 1.9698, std. dev.: 0.0031) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.20% (0.7460 => 0.7624, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.05% (1.3819 => 1.4102, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.01% (1.3813 => 1.4091, std. dev.: 0.0011) MultiSource/Applications/hbd/hbd: 2.01% (1.3693 => 1.3968, std. dev.: 0.0086) MultiSource/Applications/sqlite3/sqlite3: 1.71% (16.2614 => 16.5400, std. dev.: 0.0075) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.68% (2.1007 => 2.1359, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.67% (3.6692 => 3.7305, std. dev.: 0.0099) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.59% (0.6283 => 0.6383, std. dev.: 0.0008) MultiSource/Applications/minisat/minisat: 1.59% (0.6744 => 0.6851, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 1.48% (0.7506 => 0.7617, std. dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.36% (3.2742 => 3.3187, std. dev.: 0.0015) MultiSource/Applications/JM/lencod/lencod: 1.33% (14.8535 => 15.0505, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.26% (1.5188 => 1.5379, std. dev.: 0.0074) MultiSource/Applications/SIBsim4/SIBsim4: 1.17% (1.2749 => 1.2898, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.15% (1.1333 => 1.1463, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 1.08% (6.5754 => 6.6462, std. dev.: 0.0079) MultiSource/Benchmarks/Bullet/bullet: 1.03% (33.2944 => 33.6358, std. dev.: 0.0014) MultiSource/Applications/hexxagon/hexxagon: 1.02% (1.2292 => 1.2417, std. dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 25.84% (1.8175 => 2.2871, std. dev.: 0.0376) SingleSource/Benchmarks/Misc/mandel-2: 6.91% (1.2998 => 1.3896, std. dev.: 0.0104) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.87% (1.5824 => 1.6753, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8147, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9881, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.74% (1.7688 => 1.8350, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: 3.69% (7.4271 => 7.7011, std. dev.: 0.0050) MultiSource/Applications/sqlite3/sqlite3: 3.18% (4.5928 => 4.7390, std. dev.: 0.0169) MultiSource/Benchmarks/nbench/nbench: 3.12% (11.2619 => 11.6132, std. dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 3.03% (8.8259 => 9.0932, std. dev.: 0.0045) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4546, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/flops-6: 2.89% (1.9199 => 1.9754, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.76% (2.8606 => 2.9396, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.43% (7.9275 => 8.1204, std. dev.: 0.0092) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.58% (0.8273 => 0.8404, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: 1.56% (1.9290 => 1.9591, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 1.44% (3.2729 => 3.3201, std. dev.: 0.0027) MultiSource/Benchmarks/NPB-serial/is/is: 1.44% (8.3908 => 8.5113, std. dev.: 0.0016) MultiSource/Applications/lemon/lemon: 1.41% (1.4298 => 1.4500, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.30% (2.0200 => 2.0463, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) MultiSource/Benchmarks/sim/sim: 1.13% (5.0168 => 5.0733, std. dev.: 0.0085) SingleSource/Benchmarks/Misc/flops: 1.13% (9.0760 => 9.1782, std. dev.: 0.0009) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.48% (0.2670 => 0.2497, std. dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.79% (22.5627 => 21.2561, std. dev.: 0.0239) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.04% (0.3511 => 0.3334, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -4.20% (0.3623 => 0.3471, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.05% (0.3650 => 0.3502, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -4.03% (0.3601 => 0.3456, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -4.00% (0.3646 => 0.3500, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -4.00% (0.3578 => 0.3435, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -3.96% (0.3663 => 0.3518, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -3.53% (0.3940 => 0.3801, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -3.46% (0.3789 => 0.3658, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -3.40% (0.3914 => 0.3781, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.23% (0.8818 => 0.8533, std. dev.: 0.0022) SingleSource/UnitTests/ObjC/parameter-passing: -3.20% (0.4003 => 0.3875, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.63% (0.6576 => 0.6469, std. dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -10.61% (1.2308 => 1.1002, std. dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.16% (1.0460 => 0.9502, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.53% (0.3139 => 0.2934, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.33% (1.3780 => 1.3045, std. dev.: 0.0116) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9475, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -3.98% (2.5089 => 2.4091, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.65% (1.9762 => 1.9040, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/richards_benchmark: -2.11% (1.1560 => 1.1316, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.95% (6.6320 => 6.5026, std. dev.: 0.0060) SingleSource/Benchmarks/Shootout/lists: -1.91% (6.3560 => 6.2348, std. dev.: 0.0046) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6918, std. dev.: 0.0012) MultiSource/Applications/minisat/minisat: -1.80% (9.3358 => 9.1676, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3446, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9958, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.54% (20.3410 => 20.0269, std. dev.: 0.0163) SingleSource/Benchmarks/Shootout/heapsort: -1.50% (3.9173 => 3.8584, std. dev.: 0.0142) MultiSource/Applications/lua/lua: -1.38% (26.5159 => 26.1492, std. dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.03% (3.8887 => 3.8486, std. dev.: 0.0021) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.37s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri May 18 16:26:44 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 18 May 2012 18:26:44 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120518232644.C02572A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/706?compare_to=705&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 706, Order: 157074, Start Time: 2012-05-18 22:30:56, End Time: 2012-05-18 23:27:35 To: 705, Order: 157064, Start Time: 2012-05-18 21:07:20, End Time: 2012-05-18 22:03:59 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (67 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 891 (782 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/ary3: 1.09% (3.6936 => 3.7337, std. dev.: 0.0014) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.83% (2.0176 => 2.2765, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.19% (0.3130 => 0.3355, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.23% (0.2721 => 0.2836, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.67% (3.9660 => 4.1114, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.44% (0.5265 => 0.5446, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.31% (0.6959 => 0.7189, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.20% (0.9199 => 0.9493, std. dev.: 0.0042) MultiSource/Benchmarks/nbench/nbench: 3.12% (1.0594 => 1.0925, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 3.02% (13.8202 => 14.2371, std. dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/football/football: 2.91% (0.8310 => 0.8552, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.86% (0.5637 => 0.5798, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.72% (1.2193 => 1.2525, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.69% (1.1364 => 1.1670, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.60% (1.4563 => 1.4942, std. dev.: 0.0027) MultiSource/Applications/kimwitu++/kc: 2.60% (16.6129 => 17.0442, std. dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.57% (1.3245 => 1.3586, std. dev.: 0.0072) MultiSource/Applications/siod/siod: 2.51% (2.1791 => 2.2339, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.51% (0.5577 => 0.5717, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash2: 2.47% (0.4328 => 0.4435, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.36% (0.7710 => 0.7892, std. dev.: 0.0050) MultiSource/Benchmarks/MallocBench/gs/gs: 2.34% (3.8646 => 3.9550, std. dev.: 0.0074) MultiSource/Applications/lambda-0_1_3/lambda: 2.30% (0.7038 => 0.7200, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 2.27% (1.1061 => 1.1312, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.13% (0.4791 => 0.4893, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 2.11% (1.9270 => 1.9676, std. dev.: 0.0034) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.08% (0.7460 => 0.7615, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.06% (13.2842 => 13.5581, std. dev.: 0.0163) MultiSource/Applications/hbd/hbd: 1.94% (1.3693 => 1.3959, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.68% (1.3813 => 1.4045, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.65% (3.6692 => 3.7299, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.65% (1.3819 => 1.4047, std. dev.: 0.0013) MultiSource/Applications/spiff/spiff: 1.61% (0.7506 => 0.7627, std. dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: 1.55% (16.2614 => 16.5142, std. dev.: 0.0204) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.49% (2.1007 => 2.1321, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.41% (3.2742 => 3.3204, std. dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 1.29% (1.2749 => 1.2913, std. dev.: 0.0011) MultiSource/Applications/JM/lencod/lencod: 1.22% (14.8535 => 15.0343, std. dev.: 0.0136) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.13% (1.5188 => 1.5360, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.09% (1.1333 => 1.1457, std. dev.: 0.0004) MultiSource/Applications/d/make_dparser: 1.02% (3.1889 => 3.2214, std. dev.: 0.0087) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.38% (1.8175 => 2.2606, std. dev.: 0.0497) SingleSource/Benchmarks/Misc/mandel-2: 7.50% (1.2998 => 1.3973, std. dev.: 0.0125) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6754, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8143, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9880, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.64% (1.7688 => 1.8331, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: 3.51% (7.4271 => 7.6880, std. dev.: 0.0071) MultiSource/Benchmarks/nbench/nbench: 3.17% (11.2619 => 11.6189, std. dev.: 0.0025) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4542, std. dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.95% (8.8259 => 9.0861, std. dev.: 0.0159) SingleSource/Benchmarks/Misc/flops-6: 2.94% (1.9199 => 1.9763, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9392, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.32% (7.9275 => 8.1116, std. dev.: 0.0118) MultiSource/Applications/sqlite3/sqlite3: 2.28% (4.5928 => 4.6974, std. dev.: 0.0397) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.61% (0.8273 => 0.8406, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 1.47% (3.2729 => 3.3210, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.46% (1.4298 => 1.4507, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5099, std. dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.29% (2.0200 => 2.0461, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.25% (1.9433 => 1.9676, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/flops: 1.13% (9.0760 => 9.1786, std. dev.: 0.0006) MultiSource/Benchmarks/sim/sim: 1.08% (5.0168 => 5.0708, std. dev.: 0.0120) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -21.37% (0.4657 => 0.3662, std. dev.: 0.0370) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.00% (0.2670 => 0.2483, std. dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.96% (22.5627 => 21.2182, std. dev.: 0.0022) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.81% (0.3511 => 0.3307, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -3.67% (0.3623 => 0.3490, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.64% (0.3650 => 0.3517, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -3.64% (0.3601 => 0.3470, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -3.57% (0.3646 => 0.3516, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -3.55% (0.3663 => 0.3533, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -3.38% (0.3578 => 0.3457, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/property: -3.15% (0.3940 => 0.3816, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.11% (0.8818 => 0.8544, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/for-in: -3.06% (0.3789 => 0.3673, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -2.91% (0.3914 => 0.3800, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -2.70% (0.4003 => 0.3895, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.87% (0.6576 => 0.6453, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: -1.78% (0.6250 => 0.6139, std. dev.: 0.0007) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -9.77% (1.2308 => 1.1105, std. dev.: 0.0211) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.53% (0.3139 => 0.2934, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.98% (1.3780 => 1.3094, std. dev.: 0.0113) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9473, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -4.08% (2.5089 => 2.4066, std. dev.: 0.0021) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.73% (0.3458 => 0.3329, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.64% (1.9762 => 1.9043, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -2.45% (6.3560 => 6.2004, std. dev.: 0.0171) SingleSource/Benchmarks/Misc/richards_benchmark: -2.16% (1.1560 => 1.1310, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.99% (6.6320 => 6.4997, std. dev.: 0.0056) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.93% (20.3410 => 19.9489, std. dev.: 0.0494) MultiSource/Benchmarks/mafft/pairlocalalign: -1.89% (28.2225 => 27.6892, std. dev.: 0.0032) MultiSource/Applications/minisat/minisat: -1.84% (9.3358 => 9.1643, std. dev.: 0.0360) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9951, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/heapsort: -1.53% (3.9173 => 3.8572, std. dev.: 0.0061) MultiSource/Applications/lua/lua: -1.45% (26.5159 => 26.1305, std. dev.: 0.0364) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.38s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri May 18 17:50:17 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 18 May 2012 19:50:17 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120519005017.8F4952A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/707?compare_to=706&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 707, Order: 157082, Start Time: 2012-05-18 23:54:30, End Time: 2012-05-19 00:51:08 To: 706, Order: 157074, Start Time: 2012-05-18 22:30:56, End Time: 2012-05-18 23:27:35 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (59 on baseline) Performance Improvements: 0 (38 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 891 (791 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 1.29% (1.3973 => 1.4153, std. dev.: 0.0049) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.16% (2.0176 => 2.2832, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.12% (0.3130 => 0.3353, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.26% (0.2721 => 0.2837, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.69% (3.9660 => 4.1125, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.33% (0.6959 => 0.7191, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.32% (0.5265 => 0.5440, std. dev.: 0.0019) MultiSource/Applications/SPASS/SPASS: 3.30% (13.8202 => 14.2759, std. dev.: 0.0073) MultiSource/Benchmarks/nbench/nbench: 3.19% (1.0594 => 1.0932, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.14% (0.9199 => 0.9488, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 2.98% (0.8310 => 0.8558, std. dev.: 0.0030) MultiSource/Applications/kimwitu++/kc: 2.82% (16.6129 => 17.0818, std. dev.: 0.0227) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.78% (1.2193 => 1.2532, std. dev.: 0.0043) MultiSource/Applications/siod/siod: 2.75% (2.1791 => 2.2391, std. dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.68% (0.5637 => 0.5788, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.63% (1.1364 => 1.1663, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.63% (1.3245 => 1.3593, std. dev.: 0.0031) MultiSource/Benchmarks/MallocBench/gs/gs: 2.39% (3.8646 => 3.9568, std. dev.: 0.0049) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.36% (0.7710 => 0.7892, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.33% (1.4563 => 1.4903, std. dev.: 0.0013) MultiSource/Applications/Burg/burg: 2.27% (1.1061 => 1.1312, std. dev.: 0.0014) MultiSource/Applications/treecc/treecc: 2.27% (1.9270 => 1.9707, std. dev.: 0.0069) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.17% (0.7460 => 0.7622, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.94% (13.2842 => 13.5424, std. dev.: 0.0107) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.90% (1.3819 => 1.4082, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.80% (1.3813 => 1.4062, std. dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.77% (2.1007 => 2.1379, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.74% (3.2742 => 3.3313, std. dev.: 0.0143) MultiSource/Applications/hbd/hbd: 1.72% (1.3693 => 1.3929, std. dev.: 0.0016) MultiSource/Applications/sqlite3/sqlite3: 1.60% (16.2614 => 16.5222, std. dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.54% (3.6692 => 3.7256, std. dev.: 0.0030) MultiSource/Applications/SIBsim4/SIBsim4: 1.47% (1.2749 => 1.2936, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.36% (1.5188 => 1.5395, std. dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 1.20% (14.8535 => 15.0322, std. dev.: 0.0042) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.08% (1.1333 => 1.1455, std. dev.: 0.0002) MultiSource/Applications/d/make_dparser: 1.03% (3.1889 => 3.2217, std. dev.: 0.0012) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.06% (1.8175 => 2.2548, std. dev.: 0.0417) SingleSource/Benchmarks/Misc/mandel-2: 8.89% (1.2998 => 1.4153, std. dev.: 0.0049) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.90% (1.5824 => 1.6757, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9875, std. dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.70% (1.7688 => 1.8343, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: 3.66% (7.4271 => 7.6987, std. dev.: 0.0053) MultiSource/Benchmarks/nbench/nbench: 3.15% (11.2619 => 11.6164, std. dev.: 0.0037) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4538, std. dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.92% (8.8259 => 9.0836, std. dev.: 0.0098) SingleSource/Benchmarks/Misc/flops-6: 2.88% (1.9199 => 1.9751, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.74% (2.8606 => 2.9391, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.35% (7.9275 => 8.1141, std. dev.: 0.0147) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.49% (1.9290 => 1.9577, std. dev.: 0.0088) MultiSource/Applications/lemon/lemon: 1.42% (1.4298 => 1.4501, std. dev.: 0.0030) MultiSource/Applications/siod/siod: 1.41% (3.2729 => 3.3192, std. dev.: 0.0010) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5083, std. dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.27% (2.0200 => 2.0456, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.22% (1.9433 => 1.9670, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 1.10% (9.0760 => 9.1759, std. dev.: 0.0007) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.70% (0.2670 => 0.2491, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.72% (22.5627 => 21.2723, std. dev.: 0.0128) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.61% (0.3511 => 0.3314, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: -4.14% (0.3623 => 0.3473, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: -4.11% (0.3601 => 0.3453, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.08% (0.3650 => 0.3501, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -4.00% (0.3646 => 0.3500, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -4.00% (0.3578 => 0.3435, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -3.99% (0.3663 => 0.3517, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -3.55% (0.3940 => 0.3800, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -3.54% (0.3789 => 0.3655, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -3.47% (0.3914 => 0.3778, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -3.22% (0.4003 => 0.3874, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.13% (0.8818 => 0.8542, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.22% (0.6576 => 0.6430, std. dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/bigfib: -1.82% (0.6250 => 0.6136, std. dev.: 0.0005) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -10.57% (1.2308 => 1.1007, std. dev.: 0.0047) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.50% (0.3139 => 0.2935, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9473, std. dev.: 0.0004) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.29% (1.3780 => 1.3189, std. dev.: 0.0033) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -3.93% (2.5089 => 2.4103, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.63% (1.9762 => 1.9044, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/lists: -2.53% (6.3560 => 6.1954, std. dev.: 0.0163) SingleSource/Benchmarks/Misc/richards_benchmark: -2.16% (1.1560 => 1.1310, std. dev.: 0.0015) MultiSource/Applications/minisat/minisat: -1.95% (9.3358 => 9.1534, std. dev.: 0.0142) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.91% (6.6320 => 6.5050, std. dev.: 0.0043) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6909, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9952, std. dev.: 0.0003) MultiSource/Applications/lua/lua: -1.57% (26.5159 => 26.1007, std. dev.: 0.0281) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.56% (0.9692 => 0.9541, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.52% (20.3410 => 20.0312, std. dev.: 0.0207) SingleSource/Benchmarks/Shootout/heapsort: -1.46% (3.9173 => 3.8600, std. dev.: 0.0048) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.19s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri May 18 19:14:07 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 18 May 2012 21:14:07 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120519021407.EA55A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/708?compare_to=707&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 708, Order: 157089, Start Time: 2012-05-19 01:18:04, End Time: 2012-05-19 02:14:59 To: 707, Order: 157082, Start Time: 2012-05-18 23:54:30, End Time: 2012-05-19 00:51:08 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (63 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (790 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.51% (2.0176 => 2.2902, std. dev.: 0.0092) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.09% (0.3130 => 0.3352, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.41% (0.2721 => 0.2841, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.70% (3.9660 => 4.1128, std. dev.: 0.0095) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.26% (0.6959 => 0.7186, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.21% (0.5265 => 0.5434, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.09% (0.9199 => 0.9483, std. dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 2.96% (13.8202 => 14.2294, std. dev.: 0.0115) MultiSource/Benchmarks/nbench/nbench: 2.88% (1.0594 => 1.0899, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/football/football: 2.74% (0.8310 => 0.8538, std. dev.: 0.0022) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.65% (1.1364 => 1.1665, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.64% (0.5637 => 0.5786, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.58% (1.2193 => 1.2508, std. dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: 2.56% (16.6129 => 17.0382, std. dev.: 0.0172) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.48% (1.3245 => 1.3573, std. dev.: 0.0019) MultiSource/Applications/siod/siod: 2.44% (2.1791 => 2.2323, std. dev.: 0.0027) MultiSource/Benchmarks/MallocBench/gs/gs: 2.25% (3.8646 => 3.9514, std. dev.: 0.0030) MultiSource/Applications/Burg/burg: 2.21% (1.1061 => 1.1306, std. dev.: 0.0038) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.21% (1.4563 => 1.4885, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.21% (0.5577 => 0.5700, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 2.16% (0.7038 => 0.7190, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.06% (0.7710 => 0.7869, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.99% (13.2842 => 13.5492, std. dev.: 0.0124) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.98% (1.3813 => 1.4087, std. dev.: 0.0018) MultiSource/Applications/treecc/treecc: 1.96% (1.9270 => 1.9648, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.87% (1.3819 => 1.4077, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.82% (0.7460 => 0.7596, std. dev.: 0.0016) MultiSource/Applications/hbd/hbd: 1.68% (1.3693 => 1.3923, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.65% (2.1007 => 2.1354, std. dev.: 0.0074) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.65% (3.6692 => 3.7296, std. dev.: 0.0094) MultiSource/Applications/sqlite3/sqlite3: 1.48% (16.2614 => 16.5025, std. dev.: 0.0185) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.39% (3.2742 => 3.3197, std. dev.: 0.0011) MultiSource/Applications/SIBsim4/SIBsim4: 1.29% (1.2749 => 1.2914, std. dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.27% (1.5188 => 1.5381, std. dev.: 0.0074) MultiSource/Applications/JM/lencod/lencod: 1.13% (14.8535 => 15.0217, std. dev.: 0.0037) MultiSource/Benchmarks/Bullet/bullet: 1.03% (33.2944 => 33.6367, std. dev.: 0.0074) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 23.92% (1.8175 => 2.2523, std. dev.: 0.0509) SingleSource/Benchmarks/Misc/mandel-2: 7.32% (1.2998 => 1.3950, std. dev.: 0.0100) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6754, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.88% (1.9144 => 1.9886, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.59% (1.7688 => 1.8323, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/salsa20: 3.57% (7.4271 => 7.6921, std. dev.: 0.0119) MultiSource/Benchmarks/nbench/nbench: 3.13% (11.2619 => 11.6145, std. dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 3.01% (12.0921 => 12.4555, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: 2.89% (1.9199 => 1.9753, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.74% (2.8606 => 2.9391, std. dev.: 0.0022) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.61% (7.9275 => 8.1348, std. dev.: 0.0034) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.61% (8.8259 => 9.0565, std. dev.: 0.0118) MultiSource/Benchmarks/llubenchmark/llu: 2.25% (3.7731 => 3.8580, std. dev.: 0.0214) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9603, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.60% (0.8273 => 0.8405, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 1.47% (3.2729 => 3.3209, std. dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.44% (8.3908 => 8.5115, std. dev.: 0.0010) MultiSource/Applications/lemon/lemon: 1.40% (1.4298 => 1.4498, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.29% (2.0200 => 2.0460, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0034) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.17% (1.9433 => 1.9660, std. dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 1.15% (10.7476 => 10.8707, std. dev.: 0.0380) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1773, std. dev.: 0.0015) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.37% (0.2670 => 0.2500, std. dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.93% (22.5627 => 21.2247, std. dev.: 0.0080) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.72% (0.3511 => 0.3310, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -4.11% (0.3623 => 0.3474, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.05% (0.3650 => 0.3502, std. dev.: 0.0022) SingleSource/UnitTests/ObjC/trivial-interface: -3.94% (0.3578 => 0.3437, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -3.89% (0.3601 => 0.3461, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -3.88% (0.3663 => 0.3521, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -3.87% (0.3646 => 0.3505, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: -3.58% (0.3940 => 0.3799, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -3.38% (0.3789 => 0.3661, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: -3.22% (0.4003 => 0.3874, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.11% (0.8818 => 0.8544, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.40% (0.6576 => 0.6418, std. dev.: 0.0013) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -10.03% (1.2308 => 1.1073, std. dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.56% (0.3139 => 0.2933, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9475, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.68% (1.3780 => 1.3135, std. dev.: 0.0054) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) SingleSource/Benchmarks/Dhrystone/dry: -4.12% (2.5089 => 2.4055, std. dev.: 0.0023) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.67% (0.3458 => 0.3331, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.66% (1.9762 => 1.9038, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/richards_benchmark: -2.15% (1.1560 => 1.1311, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -2.05% (6.3560 => 6.2254, std. dev.: 0.0045) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.00% (20.3410 => 19.9343, std. dev.: 0.0124) MultiSource/Applications/minisat/minisat: -1.95% (9.3358 => 9.1533, std. dev.: 0.0386) MultiSource/Benchmarks/mafft/pairlocalalign: -1.87% (28.2225 => 27.6934, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.87% (6.6320 => 6.5081, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9956, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.38% (3.9173 => 3.8632, std. dev.: 0.0014) MultiSource/Applications/lua/lua: -1.31% (26.5159 => 26.1691, std. dev.: 0.0220) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.37s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri May 18 20:37:41 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 18 May 2012 22:37:41 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120519033741.23CFE2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/709?compare_to=708&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 709, Order: 157095, Start Time: 2012-05-19 02:41:58, End Time: 2012-05-19 03:38:32 To: 708, Order: 157089, Start Time: 2012-05-19 01:18:04, End Time: 2012-05-19 02:14:59 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (71 on baseline) Performance Improvements: 0 (38 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 891 (779 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 1.08% (7.9539 => 8.0396, std. dev.: 0.0120) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.16% (2.0176 => 2.2832, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.32% (0.3130 => 0.3359, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.81% (0.2721 => 0.2852, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.60% (3.9660 => 4.1086, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.34% (0.5265 => 0.5441, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 3.28% (1.0594 => 1.0942, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.26% (0.6959 => 0.7186, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 3.10% (13.8202 => 14.2487, std. dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.09% (0.9199 => 0.9483, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/football/football: 2.98% (0.8310 => 0.8558, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.82% (1.2193 => 1.2537, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.80% (0.5637 => 0.5795, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.75% (1.1364 => 1.1677, std. dev.: 0.0026) MultiSource/Applications/siod/siod: 2.57% (2.1791 => 2.2350, std. dev.: 0.0019) MultiSource/Applications/kimwitu++/kc: 2.56% (16.6129 => 17.0381, std. dev.: 0.0114) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.54% (1.3245 => 1.3582, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 2.52% (0.4328 => 0.4437, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.47% (1.4563 => 1.4922, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.35% (0.5577 => 0.5708, std. dev.: 0.0016) MultiSource/Applications/lambda-0_1_3/lambda: 2.34% (0.7038 => 0.7203, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 2.29% (3.8646 => 3.9531, std. dev.: 0.0130) MultiSource/Applications/treecc/treecc: 2.18% (1.9270 => 1.9691, std. dev.: 0.0008) MultiSource/Applications/Burg/burg: 2.18% (1.1061 => 1.1302, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.11% (0.4791 => 0.4892, std. dev.: 0.0039) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.10% (0.7710 => 0.7872, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.04% (13.2842 => 13.5547, std. dev.: 0.0093) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.97% (0.7460 => 0.7607, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.91% (1.3819 => 1.4083, std. dev.: 0.0046) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.78% (1.3813 => 1.4059, std. dev.: 0.0019) MultiSource/Applications/hbd/hbd: 1.75% (1.3693 => 1.3932, std. dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: 1.73% (16.2614 => 16.5435, std. dev.: 0.0173) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.67% (0.6283 => 0.6388, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.65% (3.6692 => 3.7296, std. dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.63% (2.1007 => 2.1349, std. dev.: 0.0023) MultiSource/Applications/SIBsim4/SIBsim4: 1.61% (1.2749 => 1.2954, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.55% (3.2742 => 3.3248, std. dev.: 0.0015) MultiSource/Applications/minisat/minisat: 1.50% (0.6744 => 0.6845, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.31% (1.5188 => 1.5387, std. dev.: 0.0007) MultiSource/Applications/JM/lencod/lencod: 1.30% (14.8535 => 15.0461, std. dev.: 0.0130) MultiSource/Benchmarks/Bullet/bullet: 1.20% (33.2944 => 33.6950, std. dev.: 0.0087) MultiSource/Applications/JM/ldecod/ldecod: 1.13% (6.5754 => 6.6500, std. dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.12% (1.1333 => 1.1460, std. dev.: 0.0026) MultiSource/Applications/d/make_dparser: 1.01% (3.1889 => 3.2211, std. dev.: 0.0101) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.04% (1.8175 => 2.2544, std. dev.: 0.0082) SingleSource/Benchmarks/Misc/mandel-2: 7.96% (1.2998 => 1.4032, std. dev.: 0.0095) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.89% (1.5824 => 1.6756, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8146, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9878, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.62% (1.7688 => 1.8328, std. dev.: 0.0062) SingleSource/Benchmarks/Misc/salsa20: 3.55% (7.4271 => 7.6909, std. dev.: 0.0041) MultiSource/Benchmarks/nbench/nbench: 3.12% (11.2619 => 11.6133, std. dev.: 0.0040) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4544, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-6: 2.85% (1.9199 => 1.9746, std. dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.85% (8.8259 => 9.0772, std. dev.: 0.0160) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.76% (2.8606 => 2.9395, std. dev.: 0.0020) MultiSource/Applications/sqlite3/sqlite3: 2.31% (4.5928 => 4.6987, std. dev.: 0.0269) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.19% (7.9275 => 8.1013, std. dev.: 0.0134) SingleSource/Benchmarks/Misc/ffbench: 1.61% (0.8273 => 0.8406, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9600, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 1.49% (3.2729 => 3.3216, std. dev.: 0.0008) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5093, std. dev.: 0.0018) MultiSource/Applications/lemon/lemon: 1.38% (1.4298 => 1.4496, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/bisort/bisort: 1.29% (0.8239 => 0.8345, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.26% (2.0200 => 2.0455, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0036) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.14% (1.9433 => 1.9655, std. dev.: 0.0064) SingleSource/Benchmarks/Misc/flops: 1.13% (9.0760 => 9.1786, std. dev.: 0.0012) MultiSource/Benchmarks/sim/sim: 1.01% (5.0168 => 5.0676, std. dev.: 0.0075) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -20.74% (0.4657 => 0.3691, std. dev.: 0.0165) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.10% (22.5627 => 21.1861, std. dev.: 0.0168) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.96% (0.2670 => 0.2511, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.95% (0.3511 => 0.3302, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -4.00% (0.3601 => 0.3457, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: -3.92% (0.3623 => 0.3481, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -3.89% (0.3646 => 0.3504, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -3.86% (0.3578 => 0.3440, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -3.85% (0.3663 => 0.3522, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -3.55% (0.3940 => 0.3800, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -3.43% (0.3789 => 0.3659, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -3.19% (0.3914 => 0.3789, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -3.10% (0.4003 => 0.3879, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.78% (0.8818 => 0.8573, std. dev.: 0.0041) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.66% (0.6576 => 0.6401, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: -1.92% (0.6250 => 0.6130, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -10.89% (1.2308 => 1.0968, std. dev.: 0.0088) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.16% (1.0460 => 0.9502, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.56% (0.3139 => 0.2933, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.87% (1.3780 => 1.3109, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9474, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.95% (2.5089 => 2.4098, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.73% (0.3458 => 0.3329, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -3.63% (1.9762 => 1.9045, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -2.26% (6.3560 => 6.2124, std. dev.: 0.0146) SingleSource/Benchmarks/Misc/richards_benchmark: -2.18% (1.1560 => 1.1308, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: -1.97% (9.3358 => 9.1516, std. dev.: 0.0316) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.92% (6.6320 => 6.5044, std. dev.: 0.0061) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6909, std. dev.: 0.0026) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.83% (20.3410 => 19.9679, std. dev.: 0.0279) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9957, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) MultiSource/Applications/lua/lua: -1.38% (26.5159 => 26.1498, std. dev.: 0.0125) SingleSource/Benchmarks/Shootout/heapsort: -1.27% (3.9173 => 3.8674, std. dev.: 0.0063) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.42s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri May 18 23:56:09 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 19 May 2012 01:56:09 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120519065609.609ED2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/710?compare_to=709&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 710, Order: 157104, Start Time: 2012-05-19 05:59:56, End Time: 2012-05-19 06:57:00 To: 709, Order: 157095, Start Time: 2012-05-19 02:41:58, End Time: 2012-05-19 03:38:32 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (61 on baseline) Performance Improvements: 1 (43 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 889 (784 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 5.15% (0.3691 => 0.3881, std. dev.: 0.0050) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/McGill/chomp: 1.21% (1.0968 => 1.1101, std. dev.: 0.0028) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.11% (2.2832 => 2.2579, std. dev.: 0.0005) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 11.91% (2.0176 => 2.2579, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.84% (0.3130 => 0.3344, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.34% (0.2721 => 0.2839, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.20% (3.9660 => 4.0929, std. dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.16% (0.6959 => 0.7179, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.00% (0.5265 => 0.5423, std. dev.: 0.0026) MultiSource/Benchmarks/nbench/nbench: 2.79% (1.0594 => 1.0890, std. dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.74% (0.9199 => 0.9451, std. dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 2.68% (13.8202 => 14.1904, std. dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C/football/football: 2.60% (0.8310 => 0.8526, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.49% (1.2193 => 1.2497, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.40% (1.1364 => 1.1637, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.38% (1.3245 => 1.3560, std. dev.: 0.0015) MultiSource/Applications/siod/siod: 2.36% (2.1791 => 2.2305, std. dev.: 0.0071) MultiSource/Applications/kimwitu++/kc: 2.31% (16.6129 => 16.9965, std. dev.: 0.0127) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.31% (0.5637 => 0.5767, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 2.17% (0.7038 => 0.7191, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 2.15% (3.8646 => 3.9475, std. dev.: 0.0049) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.05% (0.7460 => 0.7613, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.03% (0.5577 => 0.5690, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.96% (1.4563 => 1.4849, std. dev.: 0.0012) MultiSource/Applications/Burg/burg: 1.90% (1.1061 => 1.1271, std. dev.: 0.0053) MultiSource/Applications/treecc/treecc: 1.88% (1.9270 => 1.9633, std. dev.: 0.0029) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.84% (0.7710 => 0.7852, std. dev.: 0.0044) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.58% (13.2842 => 13.4941, std. dev.: 0.0060) MultiSource/Applications/sqlite3/sqlite3: 1.54% (16.2614 => 16.5116, std. dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.37% (3.2742 => 3.3192, std. dev.: 0.0123) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.32% (2.1007 => 2.1285, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.23% (3.6692 => 3.7144, std. dev.: 0.0071) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.23% (1.3819 => 1.3989, std. dev.: 0.0018) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.19% (1.3813 => 1.3978, std. dev.: 0.0031) MultiSource/Applications/SIBsim4/SIBsim4: 1.19% (1.2749 => 1.2901, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.09% (1.5188 => 1.5353, std. dev.: 0.0006) MultiSource/Applications/hbd/hbd: 1.06% (1.3693 => 1.3838, std. dev.: 0.0010) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 23.91% (1.8175 => 2.2521, std. dev.: 0.0313) SingleSource/Benchmarks/Misc/mandel-2: 7.92% (1.2998 => 1.4028, std. dev.: 0.0063) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7298, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6754, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8148, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9876, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.70% (1.7688 => 1.8342, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: 3.62% (7.4271 => 7.6957, std. dev.: 0.0082) MultiSource/Benchmarks/nbench/nbench: 3.13% (11.2619 => 11.6143, std. dev.: 0.0018) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4542, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-6: 2.87% (1.9199 => 1.9750, std. dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.78% (8.8259 => 9.0717, std. dev.: 0.0081) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.74% (2.8606 => 2.9391, std. dev.: 0.0021) MultiSource/Applications/sqlite3/sqlite3: 2.36% (4.5928 => 4.7012, std. dev.: 0.0318) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.33% (7.9275 => 8.1121, std. dev.: 0.0198) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 1.61% (0.8273 => 0.8406, std. dev.: 0.0014) MultiSource/Applications/lemon/lemon: 1.49% (1.4298 => 1.4511, std. dev.: 0.0010) MultiSource/Applications/siod/siod: 1.46% (3.2729 => 3.3208, std. dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 1.46% (5.0168 => 5.0901, std. dev.: 0.0027) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5085, std. dev.: 0.0027) SingleSource/Benchmarks/Dhrystone/fldry: 1.35% (1.9290 => 1.9551, std. dev.: 0.0030) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.26% (2.0200 => 2.0455, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0038) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.14% (1.9433 => 1.9654, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1773, std. dev.: 0.0007) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -16.66% (0.4657 => 0.3881, std. dev.: 0.0050) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.78% (0.2670 => 0.2489, std. dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.38% (22.5627 => 21.1226, std. dev.: 0.0067) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.15% (0.3511 => 0.3295, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-3: -5.00% (0.3623 => 0.3442, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -4.94% (0.3601 => 0.3423, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.93% (0.3650 => 0.3470, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -4.85% (0.3646 => 0.3469, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/synchronized: -4.80% (0.3663 => 0.3487, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -4.70% (0.3578 => 0.3410, std. dev.: 0.0030) SingleSource/UnitTests/ObjC/for-in: -4.38% (0.3789 => 0.3623, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/property: -4.34% (0.3940 => 0.3769, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -4.19% (0.3914 => 0.3750, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: -3.97% (0.4003 => 0.3844, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.23% (0.8818 => 0.8533, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.92% (0.6576 => 0.6384, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: -2.51% (0.6250 => 0.6093, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/Hello: -2.24% (0.5748 => 0.5619, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: -2.13% (0.5818 => 0.5694, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: -1.47% (0.7061 => 0.6957, std. dev.: 0.0010) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -9.81% (1.2308 => 1.1101, std. dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.16% (1.0460 => 0.9502, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.56% (0.3139 => 0.2933, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9474, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.78% (1.3780 => 1.3122, std. dev.: 0.0048) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -4.08% (2.5089 => 2.4065, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.67% (1.9762 => 1.9037, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: -2.15% (1.1560 => 1.1311, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -1.98% (6.3560 => 6.2301, std. dev.: 0.0043) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.95% (20.3410 => 19.9435, std. dev.: 0.0173) MultiSource/Applications/minisat/minisat: -1.94% (9.3358 => 9.1547, std. dev.: 0.0296) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.92% (6.6320 => 6.5048, std. dev.: 0.0049) MultiSource/Benchmarks/mafft/pairlocalalign: -1.87% (28.2225 => 27.6937, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9956, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) MultiSource/Applications/lua/lua: -1.41% (26.5159 => 26.1414, std. dev.: 0.0102) SingleSource/Benchmarks/Shootout/heapsort: -1.36% (3.9173 => 3.8641, std. dev.: 0.0029) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.18% (2.5254 => 2.4957, std. dev.: 0.0055) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.24s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat May 19 02:56:19 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 19 May 2012 04:56:19 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120519095619.E7F832A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/711?compare_to=710&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 711, Order: 157109, Start Time: 2012-05-19 09:00:15, End Time: 2012-05-19 09:57:11 To: 710, Order: 157104, Start Time: 2012-05-19 05:59:56, End Time: 2012-05-19 06:57:00 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (59 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 891 (789 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 1.41% (1.4028 => 1.4226, std. dev.: 0.0009) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.21% (2.0176 => 2.2640, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.96% (0.3130 => 0.3348, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.12% (0.2721 => 0.2833, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.19% (3.9660 => 4.0927, std. dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.00% (0.5265 => 0.5423, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.97% (0.6959 => 0.7166, std. dev.: 0.0018) MultiSource/Benchmarks/nbench/nbench: 2.91% (1.0594 => 1.0902, std. dev.: 0.0022) MultiSource/Applications/SPASS/SPASS: 2.82% (13.8202 => 14.2096, std. dev.: 0.0118) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.75% (0.9199 => 0.9452, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 2.72% (0.8310 => 0.8536, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.47% (1.1364 => 1.1645, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.45% (1.4563 => 1.4920, std. dev.: 0.0016) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.39% (0.7710 => 0.7894, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.36% (0.5637 => 0.5770, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 2.33% (2.1791 => 2.2299, std. dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.31% (1.2193 => 1.2475, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.26% (1.3245 => 1.3544, std. dev.: 0.0010) MultiSource/Applications/kimwitu++/kc: 2.22% (16.6129 => 16.9815, std. dev.: 0.0151) MultiSource/Applications/lambda-0_1_3/lambda: 2.15% (0.7038 => 0.7189, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.10% (0.5577 => 0.5694, std. dev.: 0.0019) MultiSource/Benchmarks/MallocBench/gs/gs: 2.02% (3.8646 => 3.9426, std. dev.: 0.0078) MultiSource/Applications/treecc/treecc: 1.85% (1.9270 => 1.9626, std. dev.: 0.0015) MultiSource/Applications/Burg/burg: 1.79% (1.1061 => 1.1259, std. dev.: 0.0056) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.74% (0.7460 => 0.7590, std. dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: 1.65% (16.2614 => 16.5299, std. dev.: 0.0057) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.64% (13.2842 => 13.5018, std. dev.: 0.0060) MultiSource/Applications/hbd/hbd: 1.59% (1.3693 => 1.3911, std. dev.: 0.0063) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.39% (2.1007 => 2.1298, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.37% (3.2742 => 3.3190, std. dev.: 0.0102) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.22% (3.6692 => 3.7140, std. dev.: 0.0021) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.22% (1.3813 => 1.3981, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.18% (1.3819 => 1.3982, std. dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.08% (1.5188 => 1.5352, std. dev.: 0.0007) MultiSource/Applications/JM/lencod/lencod: 1.02% (14.8535 => 15.0045, std. dev.: 0.0025) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.10% (1.8175 => 2.2555, std. dev.: 0.0144) SingleSource/Benchmarks/Misc/mandel-2: 9.45% (1.2998 => 1.4226, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.86% (1.5824 => 1.6752, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8146, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9876, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: 3.65% (7.4271 => 7.6980, std. dev.: 0.0066) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.61% (1.7688 => 1.8326, std. dev.: 0.0078) MultiSource/Benchmarks/nbench/nbench: 3.14% (11.2619 => 11.6159, std. dev.: 0.0018) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4545, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: 2.93% (1.9199 => 1.9762, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.85% (8.8259 => 9.0774, std. dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9394, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.30% (7.9275 => 8.1097, std. dev.: 0.0136) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.55% (0.8273 => 0.8401, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.52% (1.4298 => 1.4515, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 1.46% (3.2729 => 3.3208, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 1.42% (5.0168 => 5.0879, std. dev.: 0.0038) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5091, std. dev.: 0.0033) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.30% (2.0200 => 2.0462, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1775, std. dev.: 0.0009) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.97% (0.2670 => 0.2484, std. dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.21% (22.5627 => 21.1617, std. dev.: 0.0125) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.21% (0.3511 => 0.3293, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-3: -5.30% (0.3623 => 0.3431, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.29% (0.3650 => 0.3457, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-2: -5.25% (0.3601 => 0.3412, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -5.20% (0.3578 => 0.3392, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -5.13% (0.3646 => 0.3459, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -5.11% (0.3663 => 0.3476, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -4.64% (0.3940 => 0.3757, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -4.57% (0.3789 => 0.3616, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -4.50% (0.3914 => 0.3738, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: -4.40% (0.4003 => 0.3827, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.32% (0.8818 => 0.8525, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: -2.46% (0.6250 => 0.6096, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.45% (0.6576 => 0.6415, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/Hello: -2.35% (0.5748 => 0.5613, std. dev.: 0.0034) SingleSource/UnitTests/ObjC++/property-reference-object: -2.22% (0.5818 => 0.5689, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -9.90% (1.2308 => 1.1089, std. dev.: 0.0052) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.56% (0.3139 => 0.2933, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.21% (2.4152 => 2.2652, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.02% (1.3780 => 1.3088, std. dev.: 0.0057) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9474, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -4.00% (2.5089 => 2.4085, std. dev.: 0.0013) MultiSource/Benchmarks/Olden/bh/bh: -3.66% (1.9762 => 1.9039, std. dev.: 0.0114) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.61% (0.3458 => 0.3333, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.19% (20.3410 => 19.8947, std. dev.: 0.0463) SingleSource/Benchmarks/Misc/richards_benchmark: -2.15% (1.1560 => 1.1312, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -2.03% (6.3560 => 6.2268, std. dev.: 0.0085) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -2.02% (6.6320 => 6.4979, std. dev.: 0.0077) MultiSource/Applications/minisat/minisat: -1.95% (9.3358 => 9.1535, std. dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: -1.89% (28.2225 => 27.6905, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9956, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.44% (3.9173 => 3.8610, std. dev.: 0.0051) MultiSource/Applications/lua/lua: -1.36% (26.5159 => 26.1550, std. dev.: 0.0235) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.55s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat May 19 05:11:20 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 19 May 2012 07:11:20 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120519121120.C60582A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/712?compare_to=711&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 712, Order: 157111, Start Time: 2012-05-19 11:15:22, End Time: 2012-05-19 12:12:12 To: 711, Order: 157109, Start Time: 2012-05-19 09:00:15, End Time: 2012-05-19 09:57:11 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (62 on baseline) Performance Improvements: 0 (38 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 891 (788 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC++/property-reference-object: 1.95% (0.5689 => 0.5800, std. dev.: 0.0009) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.47% (2.0176 => 2.2691, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.25% (0.3130 => 0.3357, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.15% (0.2721 => 0.2834, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.35% (3.9660 => 4.0987, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.33% (0.6959 => 0.7191, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.04% (0.5265 => 0.5425, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 3.02% (13.8202 => 14.2373, std. dev.: 0.0083) MultiSource/Benchmarks/nbench/nbench: 2.95% (1.0594 => 1.0906, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/football/football: 2.83% (0.8310 => 0.8545, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.83% (0.9199 => 0.9459, std. dev.: 0.0068) MultiSource/Applications/siod/siod: 2.80% (2.1791 => 2.2402, std. dev.: 0.0047) MultiSource/Applications/kimwitu++/kc: 2.59% (16.6129 => 17.0432, std. dev.: 0.0114) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.49% (1.1364 => 1.1647, std. dev.: 0.0015) MultiSource/Applications/lambda-0_1_3/lambda: 2.47% (0.7038 => 0.7212, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.46% (1.3245 => 1.3571, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.41% (1.2193 => 1.2487, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.22% (0.5637 => 0.5762, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/gs/gs: 2.20% (3.8646 => 3.9498, std. dev.: 0.0033) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.09% (1.4563 => 1.4867, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.04% (0.5577 => 0.5691, std. dev.: 0.0025) MultiSource/Applications/Burg/burg: 2.01% (1.1061 => 1.1283, std. dev.: 0.0021) MultiSource/Applications/treecc/treecc: 1.99% (1.9270 => 1.9654, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.90% (0.7460 => 0.7602, std. dev.: 0.0034) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.71% (0.7710 => 0.7842, std. dev.: 0.0020) MultiSource/Applications/hbd/hbd: 1.67% (1.3693 => 1.3921, std. dev.: 0.0050) MultiSource/Applications/sqlite3/sqlite3: 1.64% (16.2614 => 16.5287, std. dev.: 0.0048) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.63% (13.2842 => 13.5008, std. dev.: 0.0084) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.57% (3.2742 => 3.3256, std. dev.: 0.0058) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.48% (2.1007 => 2.1318, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.36% (1.3813 => 1.4001, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.30% (1.3819 => 1.3999, std. dev.: 0.0023) MultiSource/Applications/SIBsim4/SIBsim4: 1.29% (1.2749 => 1.2914, std. dev.: 0.0036) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.24% (3.6692 => 3.7147, std. dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.18% (1.5188 => 1.5367, std. dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 1.04% (14.8535 => 15.0084, std. dev.: 0.0050) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.85% (1.8175 => 2.2692, std. dev.: 0.0147) SingleSource/Benchmarks/Misc/mandel-2: 8.24% (1.2998 => 1.4069, std. dev.: 0.0096) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.87% (1.5824 => 1.6753, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8146, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.86% (1.9144 => 1.9883, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.71% (1.7688 => 1.8344, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: 3.60% (7.4271 => 7.6947, std. dev.: 0.0059) MultiSource/Benchmarks/nbench/nbench: 3.13% (11.2619 => 11.6140, std. dev.: 0.0022) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4538, std. dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: 2.92% (4.5928 => 4.7271, std. dev.: 0.0216) SingleSource/Benchmarks/Misc/flops-6: 2.86% (1.9199 => 1.9749, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.85% (8.8259 => 9.0776, std. dev.: 0.0130) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9392, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.47% (7.9275 => 8.1232, std. dev.: 0.0067) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/ffbench: 1.57% (0.8273 => 0.8403, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.52% (1.4298 => 1.4516, std. dev.: 0.0040) MultiSource/Applications/siod/siod: 1.47% (3.2729 => 3.3209, std. dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.39% (8.3908 => 8.5074, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.27% (2.0200 => 2.0456, std. dev.: 0.0005) MultiSource/Benchmarks/sim/sim: 1.22% (5.0168 => 5.0781, std. dev.: 0.0084) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.19% (1.9433 => 1.9665, std. dev.: 0.0068) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1781, std. dev.: 0.0008) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.55% (0.2670 => 0.2495, std. dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.17% (22.5627 => 21.1697, std. dev.: 0.0121) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.98% (0.3511 => 0.3301, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-3: -4.94% (0.3623 => 0.3444, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.90% (0.3650 => 0.3471, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-2: -4.89% (0.3601 => 0.3425, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -4.75% (0.3578 => 0.3408, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -4.75% (0.3663 => 0.3489, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -4.69% (0.3646 => 0.3475, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -4.31% (0.3940 => 0.3770, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -4.25% (0.3789 => 0.3628, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions: -4.14% (0.3914 => 0.3752, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -3.97% (0.4003 => 0.3844, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.35% (0.8818 => 0.8523, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.95% (0.6576 => 0.6382, std. dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/bigfib: -2.05% (0.6250 => 0.6122, std. dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -10.37% (1.2308 => 1.1032, std. dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.59% (0.3139 => 0.2932, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9473, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.96% (2.5089 => 2.4096, std. dev.: 0.0032) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.73% (0.3458 => 0.3329, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.62% (1.9762 => 1.9047, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -2.23% (6.3560 => 6.2141, std. dev.: 0.0048) SingleSource/Benchmarks/Misc/richards_benchmark: -2.11% (1.1560 => 1.1316, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.96% (6.6320 => 6.5017, std. dev.: 0.0050) MultiSource/Applications/minisat/minisat: -1.93% (9.3358 => 9.1553, std. dev.: 0.0111) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6906, std. dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.80% (20.3410 => 19.9749, std. dev.: 0.0546) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9952, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/heapsort: -1.44% (3.9173 => 3.8610, std. dev.: 0.0009) MultiSource/Applications/lua/lua: -1.44% (26.5159 => 26.1352, std. dev.: 0.0217) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.04% (3.8887 => 3.8481, std. dev.: 0.0036) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.29s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat May 19 07:45:37 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 19 May 2012 09:45:37 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120519144537.BFE952A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/713?compare_to=712&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 713, Order: 157112, Start Time: 2012-05-19 13:49:52, End Time: 2012-05-19 14:46:28 To: 712, Order: 157111, Start Time: 2012-05-19 11:15:22, End Time: 2012-05-19 12:12:12 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (60 on baseline) Performance Improvements: 1 (40 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 891 (788 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/ary3: -1.13% (3.7247 => 3.6827, std. dev.: 0.0154) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.45% (2.0176 => 2.2687, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.03% (0.3130 => 0.3350, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.23% (0.2721 => 0.2836, std. dev.: 0.0036) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.24% (3.9660 => 4.0946, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.10% (0.6959 => 0.7175, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.98% (0.5265 => 0.5422, std. dev.: 0.0019) MultiSource/Benchmarks/nbench/nbench: 2.88% (1.0594 => 1.0899, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.84% (0.9199 => 0.9460, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 2.73% (13.8202 => 14.1970, std. dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/football/football: 2.70% (0.8310 => 0.8534, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.48% (1.1364 => 1.1646, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.43% (0.5637 => 0.5774, std. dev.: 0.0015) MultiSource/Applications/kimwitu++/kc: 2.43% (16.6129 => 17.0159, std. dev.: 0.0077) MultiSource/Applications/siod/siod: 2.35% (2.1791 => 2.2304, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.30% (1.2193 => 1.2473, std. dev.: 0.0090) MultiSource/Applications/lambda-0_1_3/lambda: 2.27% (0.7038 => 0.7198, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.24% (1.3245 => 1.3542, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.13% (0.5577 => 0.5696, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: 2.07% (3.8646 => 3.9447, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.07% (1.4563 => 1.4864, std. dev.: 0.0013) MultiSource/Applications/Burg/burg: 1.99% (1.1061 => 1.1281, std. dev.: 0.0020) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.89% (0.7460 => 0.7601, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 1.86% (1.9270 => 1.9629, std. dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.70% (13.2842 => 13.5104, std. dev.: 0.0158) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.62% (0.7710 => 0.7835, std. dev.: 0.0033) MultiSource/Applications/sqlite3/sqlite3: 1.59% (16.2614 => 16.5206, std. dev.: 0.0212) MultiSource/Applications/hbd/hbd: 1.50% (1.3693 => 1.3899, std. dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.42% (2.1007 => 2.1306, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.34% (1.3819 => 1.4004, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.23% (3.2742 => 3.3146, std. dev.: 0.0053) MultiSource/Applications/SIBsim4/SIBsim4: 1.23% (1.2749 => 1.2906, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.21% (3.6692 => 3.7136, std. dev.: 0.0016) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.21% (1.3813 => 1.3980, std. dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.09% (1.5188 => 1.5354, std. dev.: 0.0022) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.09% (1.8175 => 2.2554, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/mandel-2: 7.93% (1.2998 => 1.4029, std. dev.: 0.0091) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.90% (1.5824 => 1.6757, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8147, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.79% (1.9144 => 1.9869, std. dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.67% (1.7688 => 1.8337, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/salsa20: 3.66% (7.4271 => 7.6986, std. dev.: 0.0081) MultiSource/Benchmarks/nbench/nbench: 3.14% (11.2619 => 11.6158, std. dev.: 0.0049) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4538, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: 2.96% (1.9199 => 1.9767, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.76% (8.8259 => 9.0692, std. dev.: 0.0257) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9394, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/llubenchmark/llu: 2.24% (3.7731 => 3.8578, std. dev.: 0.0088) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.18% (7.9275 => 8.1005, std. dev.: 0.0182) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9603, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.56% (0.8273 => 0.8402, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.50% (1.4298 => 1.4512, std. dev.: 0.0025) MultiSource/Applications/siod/siod: 1.45% (3.2729 => 3.3205, std. dev.: 0.0094) MultiSource/Benchmarks/NPB-serial/is/is: 1.39% (8.3908 => 8.5072, std. dev.: 0.0050) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.29% (2.0200 => 2.0461, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.14% (1.9433 => 1.9655, std. dev.: 0.0085) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1775, std. dev.: 0.0008) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -21.64% (0.4657 => 0.3649, std. dev.: 0.0332) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.97% (0.2670 => 0.2484, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.24% (0.3511 => 0.3292, std. dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.16% (22.5627 => 21.1738, std. dev.: 0.0173) SingleSource/UnitTests/ObjC/exceptions-3: -5.30% (0.3623 => 0.3431, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.26% (0.3650 => 0.3458, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -5.19% (0.3601 => 0.3414, std. dev.: 0.0029) SingleSource/UnitTests/ObjC/synchronized: -5.19% (0.3663 => 0.3473, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: -5.17% (0.3578 => 0.3393, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -5.10% (0.3646 => 0.3460, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -4.70% (0.3789 => 0.3611, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -4.67% (0.3940 => 0.3756, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -4.47% (0.3914 => 0.3739, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -4.30% (0.4003 => 0.3831, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.72% (0.8818 => 0.8490, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.06% (0.6576 => 0.6375, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: -2.08% (0.6250 => 0.6120, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.11% (0.9108 => 0.9007, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -9.81% (1.2308 => 1.1101, std. dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.16% (1.0460 => 0.9502, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.66% (0.3139 => 0.2930, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.33% (1.3780 => 1.3046, std. dev.: 0.0091) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9473, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.98% (2.5089 => 2.4090, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.73% (0.3458 => 0.3329, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -3.66% (1.9762 => 1.9039, std. dev.: 0.0083) SingleSource/Benchmarks/Misc/richards_benchmark: -2.15% (1.1560 => 1.1312, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -2.05% (6.3560 => 6.2254, std. dev.: 0.0104) MultiSource/Applications/minisat/minisat: -1.90% (9.3358 => 9.1584, std. dev.: 0.0157) MultiSource/Benchmarks/mafft/pairlocalalign: -1.89% (28.2225 => 27.6890, std. dev.: 0.0016) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.85% (6.6320 => 6.5094, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.67% (20.3410 => 20.0012, std. dev.: 0.0087) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9957, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.43% (3.9173 => 3.8614, std. dev.: 0.0012) MultiSource/Applications/lua/lua: -1.36% (26.5159 => 26.1547, std. dev.: 0.0080) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.17s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat May 19 09:09:11 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 19 May 2012 11:09:11 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120519160911.A0E6F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/714?compare_to=713&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 714, Order: 157114, Start Time: 2012-05-19 15:13:32, End Time: 2012-05-19 16:10:03 To: 713, Order: 157112, Start Time: 2012-05-19 13:49:52, End Time: 2012-05-19 14:46:28 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (59 on baseline) Performance Improvements: 0 (41 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 891 (788 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/sqlite3/sqlite3: 2.28% (4.6658 => 4.7721, std. dev.: 0.0026) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.85% (2.0176 => 2.2768, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.16% (0.3130 => 0.3354, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.37% (0.2721 => 0.2840, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.57% (3.9660 => 4.1075, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.25% (0.5265 => 0.5436, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.18% (0.6959 => 0.7180, std. dev.: 0.0014) MultiSource/Benchmarks/nbench/nbench: 3.05% (1.0594 => 1.0917, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.04% (0.9199 => 0.9479, std. dev.: 0.0038) MultiSource/Applications/SPASS/SPASS: 2.94% (13.8202 => 14.2272, std. dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/football/football: 2.77% (0.8310 => 0.8540, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.75% (0.5637 => 0.5792, std. dev.: 0.0016) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.62% (1.1364 => 1.1662, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.50% (1.3245 => 1.3576, std. dev.: 0.0031) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.49% (0.7710 => 0.7902, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.48% (1.2193 => 1.2495, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.40% (1.4563 => 1.4912, std. dev.: 0.0015) MultiSource/Applications/siod/siod: 2.34% (2.1791 => 2.2301, std. dev.: 0.0016) MultiSource/Applications/kimwitu++/kc: 2.25% (16.6129 => 16.9862, std. dev.: 0.0109) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.24% (0.5577 => 0.5702, std. dev.: 0.0010) MultiSource/Applications/Burg/burg: 2.18% (1.1061 => 1.1302, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 2.05% (3.8646 => 3.9439, std. dev.: 0.0032) MultiSource/Applications/treecc/treecc: 2.05% (1.9270 => 1.9665, std. dev.: 0.0087) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.98% (0.7460 => 0.7608, std. dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: 1.95% (0.7038 => 0.7175, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.80% (13.2842 => 13.5237, std. dev.: 0.0076) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.75% (1.3813 => 1.4055, std. dev.: 0.0021) MultiSource/Applications/sqlite3/sqlite3: 1.70% (16.2614 => 16.5374, std. dev.: 0.0051) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.68% (1.3819 => 1.4051, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.54% (3.6692 => 3.7258, std. dev.: 0.0027) MultiSource/Applications/hbd/hbd: 1.51% (1.3693 => 1.3900, std. dev.: 0.0008) MultiSource/Applications/SIBsim4/SIBsim4: 1.37% (1.2749 => 1.2924, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.22% (3.2742 => 3.3143, std. dev.: 0.0010) MultiSource/Applications/JM/lencod/lencod: 1.08% (14.8535 => 15.0132, std. dev.: 0.0034) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.14% (1.8175 => 2.2563, std. dev.: 0.0468) SingleSource/Benchmarks/Misc/mandel-2: 7.07% (1.2998 => 1.3917, std. dev.: 0.0102) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6754, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 3.90% (4.5928 => 4.7721, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9879, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.66% (1.7688 => 1.8335, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/salsa20: 3.58% (7.4271 => 7.6930, std. dev.: 0.0075) MultiSource/Benchmarks/nbench/nbench: 3.12% (11.2619 => 11.6134, std. dev.: 0.0044) MultiSource/Applications/hexxagon/hexxagon: 2.98% (12.0921 => 12.4527, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-6: 2.84% (1.9199 => 1.9745, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.77% (2.8606 => 2.9397, std. dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.65% (8.8259 => 9.0600, std. dev.: 0.0072) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.47% (7.9275 => 8.1231, std. dev.: 0.0063) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.61% (0.8273 => 0.8406, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 1.48% (3.2729 => 3.3214, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.45% (1.4298 => 1.4506, std. dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5095, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.27% (2.0200 => 2.0456, std. dev.: 0.0005) MultiSource/Benchmarks/sim/sim: 1.21% (5.0168 => 5.0774, std. dev.: 0.0081) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 1.09% (9.0760 => 9.1753, std. dev.: 0.0018) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -19.95% (0.4657 => 0.3728, std. dev.: 0.0046) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.67% (0.2670 => 0.2492, std. dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.06% (22.5627 => 21.1948, std. dev.: 0.0212) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.92% (0.3511 => 0.3303, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.08% (0.3650 => 0.3501, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -4.03% (0.3623 => 0.3477, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: -3.94% (0.3578 => 0.3437, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -3.92% (0.3601 => 0.3460, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -3.85% (0.3663 => 0.3522, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -3.84% (0.3646 => 0.3506, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.56% (0.8818 => 0.8504, std. dev.: 0.0036) SingleSource/UnitTests/ObjC/property: -3.55% (0.3940 => 0.3800, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -3.33% (0.3789 => 0.3663, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -3.30% (0.3914 => 0.3785, std. dev.: 0.0031) SingleSource/UnitTests/ObjC/parameter-passing: -3.27% (0.4003 => 0.3872, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.43% (0.6576 => 0.6416, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: -2.05% (0.6250 => 0.6122, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.10% (0.9108 => 0.9008, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -10.16% (1.2308 => 1.1057, std. dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.53% (0.3139 => 0.2934, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.87% (1.3780 => 1.3109, std. dev.: 0.0077) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9474, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -4.01% (2.5089 => 2.4083, std. dev.: 0.0012) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.67% (0.3458 => 0.3331, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.65% (1.9762 => 1.9040, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/lists: -2.19% (6.3560 => 6.2167, std. dev.: 0.0149) SingleSource/Benchmarks/Misc/richards_benchmark: -2.14% (1.1560 => 1.1313, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: -2.01% (9.3358 => 9.1486, std. dev.: 0.0081) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.94% (6.6320 => 6.5035, std. dev.: 0.0042) MultiSource/Benchmarks/mafft/pairlocalalign: -1.89% (28.2225 => 27.6896, std. dev.: 0.0024) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.86% (20.3410 => 19.9630, std. dev.: 0.0249) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3446, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9954, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) MultiSource/Applications/lua/lua: -1.33% (26.5159 => 26.1626, std. dev.: 0.0245) SingleSource/Benchmarks/Shootout/heapsort: -1.25% (3.9173 => 3.8685, std. dev.: 0.0140) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.00% (3.8887 => 3.8498, std. dev.: 0.0122) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.32s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat May 19 10:17:36 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 19 May 2012 12:17:36 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120519171736.4DDB42A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/715?compare_to=714&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 715, Order: 157116, Start Time: 2012-05-19 16:36:58, End Time: 2012-05-19 17:18:28 To: 714, Order: 157114, Start Time: 2012-05-19 15:13:32, End Time: 2012-05-19 16:10:03 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== New Failures: 128 (128 on baseline) Performance Regressions: 1 (50 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 763 (674 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== New Failures - Compile Time --------------------------- MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/minisat/minisat MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/ofstream_ctor SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/ObjC++/Hello SingleSource/UnitTests/ObjC++/property-reference SingleSource/UnitTests/ObjC++/property-reference-object SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/initp1 New Failures - Execution Time ----------------------------- MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/minisat/minisat MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/ofstream_ctor SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/ObjC++/Hello SingleSource/UnitTests/ObjC++/property-reference SingleSource/UnitTests/ObjC++/property-reference-object SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/initp1 Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 1.09% (1.3917 => 1.4069, std. dev.: 0.0003) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/minisat/minisat MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/ofstream_ctor SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/ObjC++/Hello SingleSource/UnitTests/ObjC++/property-reference SingleSource/UnitTests/ObjC++/property-reference-object SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/initp1 New Failures - Execution Time ----------------------------- MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/minisat/minisat MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/ofstream_ctor SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/ObjC++/Hello SingleSource/UnitTests/ObjC++/property-reference SingleSource/UnitTests/ObjC++/property-reference-object SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/initp1 Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.16% (0.3130 => 0.3354, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.34% (0.2721 => 0.2839, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.53% (3.9660 => 4.1061, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.25% (0.5265 => 0.5436, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.23% (0.6959 => 0.7184, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.99% (0.9199 => 0.9474, std. dev.: 0.0026) MultiSource/Benchmarks/nbench/nbench: 2.98% (1.0594 => 1.0910, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 2.90% (13.8202 => 14.2211, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/football/football: 2.84% (0.8310 => 0.8546, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.71% (1.1364 => 1.1672, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.56% (1.3245 => 1.3584, std. dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.52% (0.5637 => 0.5779, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.49% (1.2193 => 1.2497, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 2.37% (2.1791 => 2.2308, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/gs/gs: 2.36% (3.8646 => 3.9557, std. dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.33% (0.5577 => 0.5707, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.22% (1.4563 => 1.4886, std. dev.: 0.0026) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.14% (0.7710 => 0.7875, std. dev.: 0.0029) MultiSource/Applications/Burg/burg: 2.09% (1.1061 => 1.1292, std. dev.: 0.0072) MultiSource/Applications/treecc/treecc: 2.04% (1.9270 => 1.9664, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.90% (0.7460 => 0.7602, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.86% (13.2842 => 13.5318, std. dev.: 0.0150) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.78% (1.3819 => 1.4065, std. dev.: 0.0018) MultiSource/Applications/sqlite3/sqlite3: 1.66% (16.2614 => 16.5306, std. dev.: 0.0192) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.62% (1.3813 => 1.4037, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.49% (3.6692 => 3.7239, std. dev.: 0.0022) MultiSource/Applications/SIBsim4/SIBsim4: 1.41% (1.2749 => 1.2929, std. dev.: 0.0008) MultiSource/Applications/JM/lencod/lencod: 1.25% (14.8535 => 15.0397, std. dev.: 0.0037) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.18% (1.8175 => 2.2570, std. dev.: 0.0066) SingleSource/Benchmarks/Misc/mandel-2: 8.24% (1.2998 => 1.4069, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6754, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.80% (1.9144 => 1.9871, std. dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.72% (1.7688 => 1.8346, std. dev.: 0.0167) SingleSource/Benchmarks/Misc/salsa20: 3.68% (7.4271 => 7.7002, std. dev.: 0.0031) MultiSource/Benchmarks/nbench/nbench: 3.14% (11.2619 => 11.6152, std. dev.: 0.0046) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.94% (8.8259 => 9.0852, std. dev.: 0.0069) SingleSource/Benchmarks/Misc/flops-6: 2.89% (1.9199 => 1.9754, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.31% (7.9275 => 8.1108, std. dev.: 0.0091) MultiSource/Applications/sqlite3/sqlite3: 2.28% (4.5928 => 4.6973, std. dev.: 0.0324) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.62% (0.8273 => 0.8407, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 1.45% (3.2729 => 3.3203, std. dev.: 0.0076) MultiSource/Applications/lemon/lemon: 1.43% (1.4298 => 1.4503, std. dev.: 0.0012) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5089, std. dev.: 0.0075) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.27% (2.0200 => 2.0456, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 1.16% (5.0168 => 5.0750, std. dev.: 0.0153) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1780, std. dev.: 0.0015) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -23.00% (0.4657 => 0.3586, std. dev.: 0.0209) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.63% (0.2670 => 0.2493, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.95% (0.3511 => 0.3302, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: -3.89% (0.3623 => 0.3482, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: -3.77% (0.3578 => 0.3443, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -3.64% (0.3601 => 0.3470, std. dev.: 0.0031) SingleSource/UnitTests/ObjC/exceptions-4: -3.57% (0.3646 => 0.3516, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -3.55% (0.3663 => 0.3533, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.50% (0.8818 => 0.8509, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -3.43% (0.3940 => 0.3805, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -3.22% (0.3789 => 0.3667, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -3.19% (0.3914 => 0.3789, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -3.15% (0.4003 => 0.3877, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.90% (0.6576 => 0.6385, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.10% (0.9108 => 0.9008, std. dev.: 0.0005) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -10.36% (1.2308 => 1.1033, std. dev.: 0.0061) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.53% (0.3139 => 0.2934, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.95% (1.3780 => 1.3098, std. dev.: 0.0063) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9473, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -4.01% (2.5089 => 2.4082, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.67% (0.3458 => 0.3331, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.61% (1.9762 => 1.9049, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/richards_benchmark: -2.13% (1.1560 => 1.1314, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -2.07% (6.3560 => 6.2243, std. dev.: 0.0095) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6926, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.82% (6.6320 => 6.5110, std. dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.76% (20.3410 => 19.9832, std. dev.: 0.0043) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9954, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.47% (3.9173 => 3.8597, std. dev.: 0.0038) MultiSource/Applications/lua/lua: -1.46% (26.5159 => 26.1299, std. dev.: 0.0247) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.32s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat May 19 11:41:09 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 19 May 2012 13:41:09 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120519184109.9C3A22A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/716?compare_to=715&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 716, Order: 157118, Start Time: 2012-05-19 17:45:29, End Time: 2012-05-19 18:42:01 To: 715, Order: 157116, Start Time: 2012-05-19 16:36:58, End Time: 2012-05-19 17:18:28 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== New Passes: 128 (0 on baseline) Performance Regressions: 1 (60 on baseline) Performance Improvements: 0 (41 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 763 (787 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== New Passes - Compile Time ------------------------- MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/minisat/minisat MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/ofstream_ctor SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/ObjC++/Hello SingleSource/UnitTests/ObjC++/property-reference SingleSource/UnitTests/ObjC++/property-reference-object SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/initp1 New Passes - Execution Time --------------------------- MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/minisat/minisat MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/ofstream_ctor SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/ObjC++/Hello SingleSource/UnitTests/ObjC++/property-reference SingleSource/UnitTests/ObjC++/property-reference-object SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/initp1 Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/sqlite3/sqlite3: 1.49% (4.6973 => 4.7673, std. dev.: 0.0052) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.87% (2.0176 => 2.2772, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.22% (0.3130 => 0.3356, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.41% (0.2721 => 0.2841, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.60% (3.9660 => 4.1088, std. dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.30% (0.5265 => 0.5439, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.15% (0.6959 => 0.7178, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 3.07% (1.0594 => 1.0919, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.97% (0.9199 => 0.9472, std. dev.: 0.0020) MultiSource/Applications/SPASS/SPASS: 2.87% (13.8202 => 14.2166, std. dev.: 0.0169) MultiSource/Benchmarks/Prolangs-C/football/football: 2.78% (0.8310 => 0.8541, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.68% (0.5637 => 0.5788, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.61% (1.1364 => 1.1661, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.50% (1.2193 => 1.2498, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.39% (1.3245 => 1.3562, std. dev.: 0.0049) MultiSource/Applications/siod/siod: 2.35% (2.1791 => 2.2303, std. dev.: 0.0008) MultiSource/Applications/kimwitu++/kc: 2.29% (16.6129 => 16.9932, std. dev.: 0.0083) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.28% (1.4563 => 1.4895, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.28% (0.5577 => 0.5704, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 2.18% (3.8646 => 3.9487, std. dev.: 0.0024) MultiSource/Applications/Burg/burg: 2.12% (1.1061 => 1.1296, std. dev.: 0.0013) MultiSource/Applications/lambda-0_1_3/lambda: 2.02% (0.7038 => 0.7180, std. dev.: 0.0044) MultiSource/Applications/treecc/treecc: 2.00% (1.9270 => 1.9656, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.97% (0.7460 => 0.7607, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.92% (0.7710 => 0.7858, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.80% (13.2842 => 13.5230, std. dev.: 0.0049) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.80% (1.3813 => 1.4061, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.77% (1.3819 => 1.4064, std. dev.: 0.0027) MultiSource/Applications/sqlite3/sqlite3: 1.74% (16.2614 => 16.5440, std. dev.: 0.0016) MultiSource/Applications/hbd/hbd: 1.51% (1.3693 => 1.3900, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.49% (3.6692 => 3.7237, std. dev.: 0.0031) MultiSource/Applications/SIBsim4/SIBsim4: 1.28% (1.2749 => 1.2912, std. dev.: 0.0048) MultiSource/Applications/JM/lencod/lencod: 1.17% (14.8535 => 15.0272, std. dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.16% (3.2742 => 3.3121, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.02% (1.1333 => 1.1449, std. dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.21% (1.8175 => 2.2576, std. dev.: 0.0087) SingleSource/Benchmarks/Misc/mandel-2: 8.12% (1.2998 => 1.4054, std. dev.: 0.0133) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.91% (1.5824 => 1.6759, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9877, std. dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 3.80% (4.5928 => 4.7673, std. dev.: 0.0052) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.63% (1.7688 => 1.8330, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/salsa20: 3.59% (7.4271 => 7.6937, std. dev.: 0.0065) MultiSource/Benchmarks/nbench/nbench: 3.13% (11.2619 => 11.6146, std. dev.: 0.0013) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4548, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: 2.84% (1.9199 => 1.9745, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9394, std. dev.: 0.0024) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.59% (7.9275 => 8.1326, std. dev.: 0.0108) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.57% (8.8259 => 9.0529, std. dev.: 0.0243) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/ffbench: 1.52% (0.8273 => 0.8399, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 1.48% (3.2729 => 3.3212, std. dev.: 0.0007) MultiSource/Applications/lemon/lemon: 1.40% (1.4298 => 1.4498, std. dev.: 0.0012) MultiSource/Benchmarks/NPB-serial/is/is: 1.39% (8.3908 => 8.5078, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.27% (2.0200 => 2.0457, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.24% (1.9433 => 1.9674, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1774, std. dev.: 0.0020) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -22.76% (0.4657 => 0.3597, std. dev.: 0.0266) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.67% (0.2670 => 0.2492, std. dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.10% (22.5627 => 21.1869, std. dev.: 0.0162) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.92% (0.3511 => 0.3303, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: -4.22% (0.3623 => 0.3470, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.16% (0.3650 => 0.3498, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-4: -4.06% (0.3646 => 0.3498, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -4.05% (0.3578 => 0.3433, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -4.03% (0.3601 => 0.3456, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -4.01% (0.3663 => 0.3516, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -3.63% (0.3940 => 0.3797, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.57% (0.8818 => 0.8503, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -3.51% (0.3789 => 0.3656, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -3.50% (0.3914 => 0.3777, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: -3.42% (0.4003 => 0.3866, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.03% (0.6576 => 0.6377, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/bigfib: -2.19% (0.6250 => 0.6113, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: -2.02% (0.5748 => 0.5632, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.12% (0.9108 => 0.9006, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -10.05% (1.2308 => 1.1071, std. dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.16% (1.0460 => 0.9502, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.50% (0.3139 => 0.2935, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.23% (1.3780 => 1.3059, std. dev.: 0.0138) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9475, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0011) SingleSource/Benchmarks/Dhrystone/dry: -4.04% (2.5089 => 2.4076, std. dev.: 0.0035) MultiSource/Benchmarks/Olden/bh/bh: -3.68% (1.9762 => 1.9034, std. dev.: 0.0042) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.67% (0.3458 => 0.3331, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: -2.11% (1.1560 => 1.1316, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.99% (20.3410 => 19.9364, std. dev.: 0.0757) SingleSource/Benchmarks/Shootout/lists: -1.96% (6.3560 => 6.2314, std. dev.: 0.0062) MultiSource/Benchmarks/mafft/pairlocalalign: -1.89% (28.2225 => 27.6905, std. dev.: 0.0028) MultiSource/Applications/minisat/minisat: -1.85% (9.3358 => 9.1631, std. dev.: 0.0075) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.79% (6.6320 => 6.5134, std. dev.: 0.0052) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3446, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9954, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.56% (0.9692 => 0.9541, std. dev.: 0.0000) MultiSource/Applications/lua/lua: -1.52% (26.5159 => 26.1116, std. dev.: 0.0410) SingleSource/Benchmarks/Shootout/heapsort: -1.49% (3.9173 => 3.8589, std. dev.: 0.0057) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.20s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat May 19 13:04:43 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 19 May 2012 15:04:43 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120519200443.7E2C02A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/717?compare_to=716&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 717, Order: 157121, Start Time: 2012-05-19 19:08:58, End Time: 2012-05-19 20:05:35 To: 716, Order: 157118, Start Time: 2012-05-19 17:45:29, End Time: 2012-05-19 18:42:01 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (59 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (790 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.49% (2.0176 => 2.2696, std. dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.06% (0.3130 => 0.3351, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.23% (0.2721 => 0.2836, std. dev.: 0.0029) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.35% (3.9660 => 4.0987, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.18% (0.6959 => 0.7180, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.04% (0.5265 => 0.5425, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.91% (0.9199 => 0.9467, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 2.91% (1.0594 => 1.0902, std. dev.: 0.0037) MultiSource/Applications/SPASS/SPASS: 2.80% (13.8202 => 14.2073, std. dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/football/football: 2.68% (0.8310 => 0.8533, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.53% (1.1364 => 1.1652, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.50% (0.5637 => 0.5778, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.50% (1.3245 => 1.3576, std. dev.: 0.0009) MultiSource/Applications/kimwitu++/kc: 2.49% (16.6129 => 17.0261, std. dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.49% (1.2193 => 1.2496, std. dev.: 0.0087) MultiSource/Applications/siod/siod: 2.40% (2.1791 => 2.2313, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.28% (0.5577 => 0.5704, std. dev.: 0.0024) MultiSource/Benchmarks/MallocBench/gs/gs: 2.20% (3.8646 => 3.9496, std. dev.: 0.0153) MultiSource/Applications/lambda-0_1_3/lambda: 2.19% (0.7038 => 0.7192, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.16% (1.4563 => 1.4878, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.05% (0.7710 => 0.7868, std. dev.: 0.0015) MultiSource/Applications/Burg/burg: 1.98% (1.1061 => 1.1280, std. dev.: 0.0071) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.92% (13.2842 => 13.5393, std. dev.: 0.0059) MultiSource/Applications/treecc/treecc: 1.86% (1.9270 => 1.9629, std. dev.: 0.0023) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.74% (0.7460 => 0.7590, std. dev.: 0.0010) MultiSource/Applications/hbd/hbd: 1.54% (1.3693 => 1.3904, std. dev.: 0.0017) MultiSource/Applications/sqlite3/sqlite3: 1.50% (16.2614 => 16.5057, std. dev.: 0.0185) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.42% (2.1007 => 2.1305, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.41% (3.6692 => 3.7208, std. dev.: 0.0047) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.37% (1.3819 => 1.4008, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.34% (1.3813 => 1.3998, std. dev.: 0.0009) MultiSource/Applications/SIBsim4/SIBsim4: 1.25% (1.2749 => 1.2908, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.17% (3.2742 => 3.3125, std. dev.: 0.0030) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 23.78% (1.8175 => 2.2497, std. dev.: 0.0170) SingleSource/Benchmarks/Misc/mandel-2: 8.74% (1.2998 => 1.4134, std. dev.: 0.0050) SingleSource/Benchmarks/Misc/flops-4: 6.52% (1.0640 => 1.1334, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7298, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.90% (1.5824 => 1.6757, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8146, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9882, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.72% (1.7688 => 1.8346, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 3.61% (7.4271 => 7.6952, std. dev.: 0.0026) MultiSource/Benchmarks/nbench/nbench: 3.21% (11.2619 => 11.6236, std. dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 3.01% (12.0921 => 12.4563, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: 2.90% (1.9199 => 1.9756, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9394, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.58% (8.8259 => 9.0537, std. dev.: 0.0298) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.33% (7.9275 => 8.1125, std. dev.: 0.0197) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.56% (0.8273 => 0.8402, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 1.46% (3.2729 => 3.3208, std. dev.: 0.0078) MultiSource/Benchmarks/NPB-serial/is/is: 1.45% (8.3908 => 8.5123, std. dev.: 0.0052) MultiSource/Applications/lemon/lemon: 1.37% (1.4298 => 1.4494, std. dev.: 0.0009) MultiSource/Benchmarks/Olden/bisort/bisort: 1.29% (0.8239 => 0.8345, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: 1.29% (1.9290 => 1.9538, std. dev.: 0.0030) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.27% (2.0200 => 2.0457, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0035) MultiSource/Benchmarks/sim/sim: 1.13% (5.0168 => 5.0736, std. dev.: 0.0131) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1779, std. dev.: 0.0019) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -18.30% (0.4657 => 0.3805, std. dev.: 0.0175) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.89% (0.2670 => 0.2486, std. dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.35% (22.5627 => 21.1289, std. dev.: 0.0062) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.32% (0.3511 => 0.3289, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-2: -3.61% (0.3601 => 0.3471, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.53% (0.3650 => 0.3521, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/trivial-interface: -3.52% (0.3578 => 0.3452, std. dev.: 0.0034) SingleSource/UnitTests/ObjC/exceptions-3: -3.51% (0.3623 => 0.3496, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -3.49% (0.3663 => 0.3535, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-4: -3.48% (0.3646 => 0.3519, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.41% (0.8818 => 0.8517, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -3.02% (0.3940 => 0.3821, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -2.90% (0.3789 => 0.3679, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.71% (0.6576 => 0.6398, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/parameter-passing: -2.60% (0.4003 => 0.3899, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: -2.22% (0.6250 => 0.6111, std. dev.: 0.0006) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -9.92% (1.2308 => 1.1087, std. dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.16% (1.0460 => 0.9502, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.59% (0.3139 => 0.2932, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9474, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.48% (1.3780 => 1.3163, std. dev.: 0.0042) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -4.05% (2.5089 => 2.4074, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/bh/bh: -3.68% (1.9762 => 1.9035, std. dev.: 0.0092) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.67% (0.3458 => 0.3331, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -2.39% (6.3560 => 6.2042, std. dev.: 0.0136) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.14% (20.3410 => 19.9051, std. dev.: 0.0789) SingleSource/Benchmarks/Misc/richards_benchmark: -2.14% (1.1560 => 1.1313, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.92% (6.6320 => 6.5048, std. dev.: 0.0040) MultiSource/Applications/minisat/minisat: -1.92% (9.3358 => 9.1569, std. dev.: 0.0461) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6914, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3446, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9953, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) MultiSource/Applications/lua/lua: -1.39% (26.5159 => 26.1480, std. dev.: 0.0160) SingleSource/Benchmarks/Shootout/heapsort: -1.29% (3.9173 => 3.8668, std. dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.02% (3.8887 => 3.8490, std. dev.: 0.0034) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.36s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat May 19 14:28:14 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 19 May 2012 16:28:14 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120519212814.0FF182A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/718?compare_to=717&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 718, Order: 157127, Start Time: 2012-05-19 20:32:36, End Time: 2012-05-19 21:29:06 To: 717, Order: 157121, Start Time: 2012-05-19 19:08:58, End Time: 2012-05-19 20:05:35 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (55 on baseline) Performance Improvements: 1 (43 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 891 (790 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -3.84% (0.3805 => 0.3659, std. dev.: 0.0005) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.08% (2.0176 => 2.2614, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.90% (0.3130 => 0.3346, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.08% (0.2721 => 0.2832, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.21% (3.9660 => 4.0935, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.85% (0.5265 => 0.5415, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.85% (0.9199 => 0.9461, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.79% (0.6959 => 0.7153, std. dev.: 0.0074) MultiSource/Applications/SPASS/SPASS: 2.58% (13.8202 => 14.1762, std. dev.: 0.0143) MultiSource/Benchmarks/nbench/nbench: 2.51% (1.0594 => 1.0860, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 2.36% (0.8310 => 0.8506, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.29% (1.2193 => 1.2472, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.27% (0.5637 => 0.5765, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.21% (1.3245 => 1.3538, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.21% (1.1364 => 1.1615, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 2.07% (2.1791 => 2.2243, std. dev.: 0.0047) MultiSource/Benchmarks/MallocBench/gs/gs: 1.99% (3.8646 => 3.9416, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.97% (0.5577 => 0.5687, std. dev.: 0.0008) MultiSource/Applications/kimwitu++/kc: 1.91% (16.6129 => 16.9308, std. dev.: 0.0200) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.86% (1.4563 => 1.4834, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.76% (13.2842 => 13.5178, std. dev.: 0.0021) MultiSource/Applications/Burg/burg: 1.74% (1.1061 => 1.1254, std. dev.: 0.0041) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.69% (0.7460 => 0.7586, std. dev.: 0.0008) MultiSource/Applications/lambda-0_1_3/lambda: 1.66% (0.7038 => 0.7155, std. dev.: 0.0015) MultiSource/Applications/treecc/treecc: 1.65% (1.9270 => 1.9588, std. dev.: 0.0035) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.57% (0.7710 => 0.7831, std. dev.: 0.0024) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.50% (1.3813 => 1.4020, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.50% (1.3819 => 1.4026, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 1.34% (16.2614 => 16.4789, std. dev.: 0.0085) MultiSource/Applications/hbd/hbd: 1.16% (1.3693 => 1.3852, std. dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: 1.07% (1.2749 => 1.2885, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.04% (3.6692 => 3.7074, std. dev.: 0.0033) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.32% (1.8175 => 2.2595, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/mandel-2: 7.63% (1.2998 => 1.3990, std. dev.: 0.0105) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7298, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6754, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8146, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9877, std. dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.68% (1.7688 => 1.8339, std. dev.: 0.0059) SingleSource/Benchmarks/Misc/salsa20: 3.52% (7.4271 => 7.6885, std. dev.: 0.0075) MultiSource/Benchmarks/nbench/nbench: 3.14% (11.2619 => 11.6158, std. dev.: 0.0017) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4543, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.81% (8.8259 => 9.0739, std. dev.: 0.0247) SingleSource/Benchmarks/Misc/flops-6: 2.80% (1.9199 => 1.9736, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9394, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.47% (7.9275 => 8.1231, std. dev.: 0.0223) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.56% (0.8273 => 0.8402, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 1.48% (3.2729 => 3.3212, std. dev.: 0.0005) MultiSource/Applications/lemon/lemon: 1.46% (1.4298 => 1.4507, std. dev.: 0.0027) MultiSource/Benchmarks/NPB-serial/is/is: 1.43% (8.3908 => 8.5108, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.27% (2.0200 => 2.0457, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 1.13% (9.0760 => 9.1783, std. dev.: 0.0018) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -21.43% (0.4657 => 0.3659, std. dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.72% (22.5627 => 21.0475, std. dev.: 0.0135) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.67% (0.2670 => 0.2492, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.49% (0.3511 => 0.3283, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: -4.39% (0.3623 => 0.3464, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -4.36% (0.3601 => 0.3444, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.33% (0.3650 => 0.3492, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -4.23% (0.3663 => 0.3508, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -4.22% (0.3646 => 0.3492, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: -4.22% (0.3578 => 0.3427, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -3.91% (0.3940 => 0.3786, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -3.73% (0.3914 => 0.3768, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: -3.64% (0.3789 => 0.3651, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -3.47% (0.4003 => 0.3864, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.13% (0.8818 => 0.8542, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.65% (0.6576 => 0.6402, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: -2.56% (0.6250 => 0.6090, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: -2.17% (0.5748 => 0.5623, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: -1.72% (0.5818 => 0.5718, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: -1.52% (0.7061 => 0.6954, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.02% (1.9828 => 1.9626, std. dev.: 0.0009) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -9.92% (1.2308 => 1.1087, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.56% (0.3139 => 0.2933, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2640, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/perlin: -4.84% (6.2497 => 5.9475, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.80% (1.3780 => 1.3119, std. dev.: 0.0032) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -3.97% (2.5089 => 2.4093, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.73% (0.3458 => 0.3329, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.66% (1.9762 => 1.9038, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/lists: -2.35% (6.3560 => 6.2064, std. dev.: 0.0114) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.13% (20.3410 => 19.9070, std. dev.: 0.0396) SingleSource/Benchmarks/Misc/richards_benchmark: -2.12% (1.1560 => 1.1315, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.95% (6.6320 => 6.5030, std. dev.: 0.0043) MultiSource/Applications/minisat/minisat: -1.90% (9.3358 => 9.1584, std. dev.: 0.0082) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6907, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3446, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9954, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.53% (3.9173 => 3.8572, std. dev.: 0.0042) MultiSource/Applications/lua/lua: -1.41% (26.5159 => 26.1416, std. dev.: 0.0382) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.24s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat May 19 15:51:39 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 19 May 2012 17:51:39 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120519225139.C7C3C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/719?compare_to=718&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 719, Order: 157132, Start Time: 2012-05-19 21:56:01, End Time: 2012-05-19 22:52:31 To: 718, Order: 157127, Start Time: 2012-05-19 20:32:36, End Time: 2012-05-19 21:29:06 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (54 on baseline) Performance Improvements: 1 (44 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 890 (790 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/McGill/chomp: 11.23% (1.1087 => 1.2332, std. dev.: 0.0022) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/siod/siod: -1.16% (3.3212 => 3.2827, std. dev.: 0.0079) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.49% (2.0176 => 2.2695, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.03% (0.3130 => 0.3350, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.90% (0.2721 => 0.2827, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.21% (3.9660 => 4.0933, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.89% (0.5265 => 0.5417, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.86% (0.6959 => 0.7158, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.76% (0.9199 => 0.9453, std. dev.: 0.0037) MultiSource/Applications/SPASS/SPASS: 2.56% (13.8202 => 14.1746, std. dev.: 0.0065) MultiSource/Benchmarks/nbench/nbench: 2.49% (1.0594 => 1.0858, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 2.39% (0.8310 => 0.8509, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.32% (0.5637 => 0.5768, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.16% (1.1364 => 1.1610, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.16% (1.2193 => 1.2456, std. dev.: 0.0037) MultiSource/Applications/siod/siod: 2.14% (2.1791 => 2.2257, std. dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.11% (1.3245 => 1.3525, std. dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.01% (0.5577 => 0.5689, std. dev.: 0.0012) MultiSource/Applications/kimwitu++/kc: 1.91% (16.6129 => 16.9298, std. dev.: 0.0025) MultiSource/Benchmarks/MallocBench/gs/gs: 1.85% (3.8646 => 3.9362, std. dev.: 0.0092) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.84% (1.4563 => 1.4831, std. dev.: 0.0016) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.82% (0.7710 => 0.7850, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.81% (0.7460 => 0.7595, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.76% (13.2842 => 13.5177, std. dev.: 0.0117) MultiSource/Applications/lambda-0_1_3/lambda: 1.75% (0.7038 => 0.7161, std. dev.: 0.0009) MultiSource/Applications/treecc/treecc: 1.74% (1.9270 => 1.9605, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.58% (1.3819 => 1.4037, std. dev.: 0.0021) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.49% (1.3813 => 1.4019, std. dev.: 0.0016) MultiSource/Applications/sqlite3/sqlite3: 1.22% (16.2614 => 16.4591, std. dev.: 0.0119) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.08% (3.6692 => 3.7090, std. dev.: 0.0027) MultiSource/Applications/hbd/hbd: 1.02% (1.3693 => 1.3832, std. dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.40% (1.8175 => 2.2609, std. dev.: 0.0155) SingleSource/Benchmarks/Misc/mandel-2: 8.40% (1.2998 => 1.4090, std. dev.: 0.0136) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6754, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.81% (1.9144 => 1.9873, std. dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.75% (1.7688 => 1.8351, std. dev.: 0.0174) SingleSource/Benchmarks/Misc/salsa20: 3.58% (7.4271 => 7.6927, std. dev.: 0.0099) MultiSource/Benchmarks/nbench/nbench: 3.13% (11.2619 => 11.6147, std. dev.: 0.0049) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4535, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: 2.94% (1.9199 => 1.9763, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.83% (8.8259 => 9.0757, std. dev.: 0.0073) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9392, std. dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.43% (7.9275 => 8.1201, std. dev.: 0.0143) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.58% (0.8273 => 0.8404, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.47% (1.4298 => 1.4508, std. dev.: 0.0006) SingleSource/Benchmarks/Dhrystone/fldry: 1.47% (1.9290 => 1.9573, std. dev.: 0.0014) MultiSource/Benchmarks/NPB-serial/is/is: 1.43% (8.3908 => 8.5112, std. dev.: 0.0051) MultiSource/Benchmarks/sim/sim: 1.31% (5.0168 => 5.0826, std. dev.: 0.0065) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.28% (2.0200 => 2.0458, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.22% (1.9433 => 1.9671, std. dev.: 0.0057) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 1.14% (9.0760 => 9.1797, std. dev.: 0.0014) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -16.23% (0.4657 => 0.3901, std. dev.: 0.0158) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.04% (0.2670 => 0.2482, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.84% (0.3511 => 0.3271, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.70% (22.5627 => 21.0508, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions-3: -4.64% (0.3623 => 0.3455, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.55% (0.3650 => 0.3484, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -4.50% (0.3601 => 0.3439, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: -4.42% (0.3578 => 0.3420, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -4.42% (0.3646 => 0.3485, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -4.40% (0.3663 => 0.3502, std. dev.: 0.0027) SingleSource/UnitTests/ObjC/property: -4.09% (0.3940 => 0.3779, std. dev.: 0.0020) SingleSource/UnitTests/ObjC/for-in: -4.01% (0.3789 => 0.3637, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -3.86% (0.3914 => 0.3763, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.62% (0.8818 => 0.8499, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: -3.60% (0.4003 => 0.3859, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.25% (0.6576 => 0.6362, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: -2.51% (0.6250 => 0.6093, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: -2.42% (0.5748 => 0.5609, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: -1.98% (0.5818 => 0.5703, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: -1.67% (0.7061 => 0.6943, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.57% (0.9108 => 0.8965, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.02% (1.9828 => 1.9626, std. dev.: 0.0019) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.16% (1.0460 => 0.9502, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.53% (0.3139 => 0.2934, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.98% (1.3780 => 1.3094, std. dev.: 0.0023) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9623, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -4.05% (2.5089 => 2.4074, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: -3.61% (1.9762 => 1.9049, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/richards_benchmark: -2.16% (1.1560 => 1.1310, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -2.02% (6.3560 => 6.2276, std. dev.: 0.0038) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.02% (20.3410 => 19.9307, std. dev.: 0.0083) MultiSource/Applications/minisat/minisat: -1.99% (9.3358 => 9.1504, std. dev.: 0.0271) MultiSource/Benchmarks/mafft/pairlocalalign: -1.89% (28.2225 => 27.6903, std. dev.: 0.0017) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.80% (6.6320 => 6.5124, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3444, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9957, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.56% (0.9692 => 0.9541, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout/heapsort: -1.54% (3.9173 => 3.8571, std. dev.: 0.0047) MultiSource/Applications/lua/lua: -1.49% (26.5159 => 26.1200, std. dev.: 0.0680) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.05% (3.8887 => 3.8479, std. dev.: 0.0039) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.22s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat May 19 17:14:56 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 19 May 2012 19:14:56 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120520001456.A18DF2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/720?compare_to=719&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 720, Order: 157133, Start Time: 2012-05-19 23:19:22, End Time: 2012-05-20 00:15:48 To: 719, Order: 157132, Start Time: 2012-05-19 21:56:01, End Time: 2012-05-19 22:52:31 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (54 on baseline) Performance Improvements: 1 (45 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 891 (789 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -6.97% (0.3901 => 0.3629, std. dev.: 0.0044) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.51% (2.0176 => 2.2700, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.90% (0.3130 => 0.3346, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.93% (0.2721 => 0.2828, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.21% (3.9660 => 4.0932, std. dev.: 0.0102) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.91% (0.5265 => 0.5418, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.77% (0.6959 => 0.7152, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.70% (0.9199 => 0.9447, std. dev.: 0.0018) MultiSource/Applications/SPASS/SPASS: 2.57% (13.8202 => 14.1759, std. dev.: 0.0108) MultiSource/Benchmarks/nbench/nbench: 2.56% (1.0594 => 1.0865, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: 2.30% (0.8310 => 0.8501, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.27% (0.5637 => 0.5765, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.25% (1.2193 => 1.2467, std. dev.: 0.0027) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.18% (1.1364 => 1.1612, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.16% (1.3245 => 1.3531, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.01% (0.5577 => 0.5689, std. dev.: 0.0015) MultiSource/Applications/siod/siod: 1.97% (2.1791 => 2.2220, std. dev.: 0.0060) MultiSource/Applications/kimwitu++/kc: 1.83% (16.6129 => 16.9177, std. dev.: 0.0109) MultiSource/Benchmarks/MallocBench/gs/gs: 1.83% (3.8646 => 3.9354, std. dev.: 0.0085) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.83% (1.4563 => 1.4829, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.80% (0.7460 => 0.7594, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.73% (13.2842 => 13.5138, std. dev.: 0.0201) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.71% (0.7710 => 0.7842, std. dev.: 0.0009) MultiSource/Applications/Burg/burg: 1.70% (1.1061 => 1.1249, std. dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: 1.66% (0.7038 => 0.7155, std. dev.: 0.0008) MultiSource/Applications/treecc/treecc: 1.63% (1.9270 => 1.9585, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.56% (1.3819 => 1.4034, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.52% (1.3813 => 1.4023, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 1.18% (16.2614 => 16.4526, std. dev.: 0.0060) MultiSource/Applications/hbd/hbd: 1.04% (1.3693 => 1.3835, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.01% (3.6692 => 3.7061, std. dev.: 0.0010) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.92% (1.8175 => 2.2705, std. dev.: 0.0397) SingleSource/Benchmarks/Misc/mandel-2: 7.66% (1.2998 => 1.3994, std. dev.: 0.0050) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7298, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.87% (1.5824 => 1.6753, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9881, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.69% (1.7688 => 1.8341, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: 3.67% (7.4271 => 7.6995, std. dev.: 0.0068) MultiSource/Benchmarks/nbench/nbench: 3.13% (11.2619 => 11.6144, std. dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4536, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-6: 2.92% (1.9199 => 1.9759, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9394, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.66% (8.8259 => 9.0608, std. dev.: 0.0134) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.33% (7.9275 => 8.1120, std. dev.: 0.0106) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.60% (0.8273 => 0.8405, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.46% (1.4298 => 1.4507, std. dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5097, std. dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.29% (2.0200 => 2.0461, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.24% (1.9433 => 1.9673, std. dev.: 0.0091) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1772, std. dev.: 0.0014) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -22.07% (0.4657 => 0.3629, std. dev.: 0.0044) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.04% (0.2670 => 0.2482, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.84% (0.3511 => 0.3271, std. dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.75% (22.5627 => 21.0386, std. dev.: 0.0154) SingleSource/UnitTests/ObjC/exceptions-3: -4.58% (0.3623 => 0.3457, std. dev.: 0.0019) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.58% (0.3650 => 0.3483, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: -4.47% (0.3578 => 0.3418, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -4.44% (0.3601 => 0.3441, std. dev.: 0.0031) SingleSource/UnitTests/ObjC/synchronized: -4.42% (0.3663 => 0.3501, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-4: -4.36% (0.3646 => 0.3487, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/property: -4.09% (0.3940 => 0.3779, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: -3.93% (0.3789 => 0.3640, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -3.88% (0.3914 => 0.3762, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: -3.72% (0.4003 => 0.3854, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.63% (0.8818 => 0.8498, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.24% (0.6576 => 0.6363, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: -2.54% (0.6250 => 0.6091, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: -2.26% (0.5748 => 0.5618, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: -2.01% (0.5818 => 0.5701, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: -1.69% (0.7061 => 0.6942, std. dev.: 0.0031) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.57% (0.9108 => 0.8965, std. dev.: 0.0003) MultiSource/Applications/lua/lua: -1.02% (3.7467 => 3.7086, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.01% (1.9828 => 1.9627, std. dev.: 0.0014) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.59% (0.3139 => 0.2932, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9622, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.41% (1.3780 => 1.3172, std. dev.: 0.0129) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -4.00% (2.5089 => 2.4085, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -3.67% (1.9762 => 1.9036, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.67% (0.3458 => 0.3331, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -2.46% (6.3560 => 6.1998, std. dev.: 0.0150) SingleSource/Benchmarks/Misc/richards_benchmark: -2.15% (1.1560 => 1.1312, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: -1.89% (9.3358 => 9.1592, std. dev.: 0.0440) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.88% (20.3410 => 19.9576, std. dev.: 0.0577) MultiSource/Benchmarks/mafft/pairlocalalign: -1.87% (28.2225 => 27.6940, std. dev.: 0.0019) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.84% (6.6320 => 6.5099, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3446, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9952, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.55% (3.9173 => 3.8567, std. dev.: 0.0172) MultiSource/Applications/lua/lua: -1.46% (26.5159 => 26.1293, std. dev.: 0.0236) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.12% (3.8887 => 3.8450, std. dev.: 0.0103) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.40s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat May 19 18:38:26 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 19 May 2012 20:38:26 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120520013826.DFFC02A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/721?compare_to=720&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 721, Order: 157137, Start Time: 2012-05-20 00:42:44, End Time: 2012-05-20 01:39:19 To: 720, Order: 157133, Start Time: 2012-05-19 23:19:22, End Time: 2012-05-20 00:15:48 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (53 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 891 (795 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/siod/siod: 1.10% (3.2850 => 3.3212, std. dev.: 0.0084) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.49% (2.0176 => 2.2695, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.19% (0.3130 => 0.3355, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.90% (0.2721 => 0.2827, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.44% (3.9660 => 4.1023, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.13% (0.6959 => 0.7177, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.97% (0.9199 => 0.9472, std. dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 2.73% (13.8202 => 14.1978, std. dev.: 0.0161) MultiSource/Benchmarks/Prolangs-C/football/football: 2.56% (0.8310 => 0.8523, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.54% (0.5637 => 0.5780, std. dev.: 0.0032) MultiSource/Benchmarks/nbench/nbench: 2.53% (1.0594 => 1.0862, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.44% (1.2193 => 1.2490, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.40% (0.5577 => 0.5711, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.38% (1.3245 => 1.3560, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.36% (1.4563 => 1.4907, std. dev.: 0.0027) MultiSource/Applications/siod/siod: 2.34% (2.1791 => 2.2300, std. dev.: 0.0010) MultiSource/Applications/kimwitu++/kc: 2.26% (16.6129 => 16.9881, std. dev.: 0.0069) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.25% (1.1364 => 1.1620, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/gs/gs: 2.23% (3.8646 => 3.9509, std. dev.: 0.0067) MultiSource/Applications/lambda-0_1_3/lambda: 2.20% (0.7038 => 0.7193, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.17% (0.7710 => 0.7877, std. dev.: 0.0017) MultiSource/Applications/Burg/burg: 2.03% (1.1061 => 1.1285, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.90% (13.2842 => 13.5370, std. dev.: 0.0061) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.85% (0.7460 => 0.7598, std. dev.: 0.0014) MultiSource/Applications/treecc/treecc: 1.82% (1.9270 => 1.9621, std. dev.: 0.0019) MultiSource/Applications/hbd/hbd: 1.31% (1.3693 => 1.3872, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.27% (1.3819 => 1.3994, std. dev.: 0.0022) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.26% (1.3813 => 1.3987, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 1.22% (16.2614 => 16.4598, std. dev.: 0.0150) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.20% (3.6692 => 3.7134, std. dev.: 0.0012) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.06% (1.8175 => 2.2547, std. dev.: 0.0174) SingleSource/Benchmarks/Misc/mandel-2: 6.73% (1.2998 => 1.3873, std. dev.: 0.0117) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.87% (1.5824 => 1.6753, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8146, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.78% (1.9144 => 1.9868, std. dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.66% (1.7688 => 1.8335, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/salsa20: 3.45% (7.4271 => 7.6835, std. dev.: 0.0120) MultiSource/Benchmarks/nbench/nbench: 3.15% (11.2619 => 11.6164, std. dev.: 0.0017) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4536, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-6: 2.84% (1.9199 => 1.9745, std. dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.75% (8.8259 => 9.0690, std. dev.: 0.0207) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.74% (2.8606 => 2.9391, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.41% (7.9275 => 8.1189, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9603, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.57% (0.8273 => 0.8403, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 1.48% (3.2729 => 3.3212, std. dev.: 0.0084) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5088, std. dev.: 0.0026) MultiSource/Applications/lemon/lemon: 1.33% (1.4298 => 1.4488, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.28% (2.0200 => 2.0458, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.14% (9.0760 => 9.1794, std. dev.: 0.0005) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -21.17% (0.4657 => 0.3671, std. dev.: 0.0264) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.38% (0.2670 => 0.2473, std. dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.85% (22.5627 => 21.0179, std. dev.: 0.0170) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.69% (0.3511 => 0.3276, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.66% (0.8818 => 0.8495, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: -3.53% (0.3623 => 0.3495, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -3.47% (0.3601 => 0.3476, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -3.43% (0.3646 => 0.3521, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.37% (0.3650 => 0.3527, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -3.33% (0.3663 => 0.3541, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -3.33% (0.3578 => 0.3459, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -2.99% (0.3940 => 0.3822, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -2.93% (0.3789 => 0.3678, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -2.89% (0.3914 => 0.3801, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -2.67% (0.4003 => 0.3896, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.42% (0.6576 => 0.6417, std. dev.: 0.0049) SingleSource/Benchmarks/Misc-C++/bigfib: -2.13% (0.6250 => 0.6117, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: -1.95% (0.5748 => 0.5636, std. dev.: 0.0026) SingleSource/UnitTests/ObjC++/property-reference-object: -1.72% (0.5818 => 0.5718, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.44% (0.9108 => 0.8977, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.53% (0.3139 => 0.2934, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9623, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0009) SingleSource/Benchmarks/Dhrystone/dry: -4.01% (2.5089 => 2.4082, std. dev.: 0.0041) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.67% (1.9762 => 1.9037, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/lists: -2.36% (6.3560 => 6.2057, std. dev.: 0.0117) SingleSource/Benchmarks/Misc/richards_benchmark: -2.12% (1.1560 => 1.1315, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: -2.00% (9.3358 => 9.1489, std. dev.: 0.0176) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.97% (6.6320 => 6.5011, std. dev.: 0.0052) MultiSource/Benchmarks/mafft/pairlocalalign: -1.89% (28.2225 => 27.6905, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.69% (20.3410 => 19.9982, std. dev.: 0.0668) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9956, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0013) MultiSource/Applications/lua/lua: -1.38% (26.5159 => 26.1508, std. dev.: 0.0184) SingleSource/Benchmarks/Shootout/heapsort: -1.17% (3.9173 => 3.8714, std. dev.: 0.0016) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.40s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat May 19 20:01:52 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 19 May 2012 22:01:52 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120520030152.3E6F72A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/722?compare_to=721&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 722, Order: 157140, Start Time: 2012-05-20 02:06:15, End Time: 2012-05-20 03:02:44 To: 721, Order: 157137, Start Time: 2012-05-20 00:42:44, End Time: 2012-05-20 01:39:19 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (59 on baseline) Performance Improvements: 0 (38 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (791 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.71% (2.0176 => 2.2741, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.16% (0.3130 => 0.3354, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.97% (0.2721 => 0.2829, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.53% (3.9660 => 4.1060, std. dev.: 0.0081) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.21% (0.5265 => 0.5434, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.09% (0.9199 => 0.9483, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.08% (0.6959 => 0.7173, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 2.81% (13.8202 => 14.2090, std. dev.: 0.0187) MultiSource/Applications/kimwitu++/kc: 2.72% (16.6129 => 17.0654, std. dev.: 0.0101) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.59% (0.5637 => 0.5783, std. dev.: 0.0014) MultiSource/Benchmarks/nbench/nbench: 2.57% (1.0594 => 1.0866, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: 2.55% (0.8310 => 0.8522, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.52% (1.2193 => 1.2500, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 2.39% (2.1791 => 2.2312, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.39% (1.3245 => 1.3561, std. dev.: 0.0042) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.37% (1.1364 => 1.1633, std. dev.: 0.0017) MultiSource/Benchmarks/MallocBench/gs/gs: 2.34% (3.8646 => 3.9551, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.31% (0.5577 => 0.5706, std. dev.: 0.0008) MultiSource/Applications/lambda-0_1_3/lambda: 2.29% (0.7038 => 0.7199, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.27% (0.7710 => 0.7885, std. dev.: 0.0038) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.08% (0.7460 => 0.7615, std. dev.: 0.0033) MultiSource/Applications/treecc/treecc: 2.03% (1.9270 => 1.9662, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.03% (1.4563 => 1.4859, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.80% (13.2842 => 13.5230, std. dev.: 0.0101) MultiSource/Applications/hbd/hbd: 1.64% (1.3693 => 1.3917, std. dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 1.35% (16.2614 => 16.4810, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.24% (1.3819 => 1.3991, std. dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.24% (3.6692 => 3.7148, std. dev.: 0.0043) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.20% (1.3813 => 1.3979, std. dev.: 0.0021) MultiSource/Applications/SIBsim4/SIBsim4: 1.20% (1.2749 => 1.2902, std. dev.: 0.0015) MultiSource/Applications/JM/lencod/lencod: 1.09% (14.8535 => 15.0148, std. dev.: 0.0015) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.24% (1.8175 => 2.2580, std. dev.: 0.0062) SingleSource/Benchmarks/Misc/mandel-2: 7.62% (1.2998 => 1.3989, std. dev.: 0.0068) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.86% (1.5824 => 1.6752, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.81% (1.9144 => 1.9873, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.72% (1.7688 => 1.8346, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: 3.69% (7.4271 => 7.7011, std. dev.: 0.0034) MultiSource/Benchmarks/nbench/nbench: 3.14% (11.2619 => 11.6155, std. dev.: 0.0032) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4537, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.87% (8.8259 => 9.0794, std. dev.: 0.0101) SingleSource/Benchmarks/Misc/flops-6: 2.85% (1.9199 => 1.9746, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9392, std. dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.46% (7.9275 => 8.1223, std. dev.: 0.0126) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.60% (0.8273 => 0.8405, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: 1.51% (1.9290 => 1.9582, std. dev.: 0.0010) MultiSource/Applications/siod/siod: 1.48% (3.2729 => 3.3212, std. dev.: 0.0022) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5102, std. dev.: 0.0061) MultiSource/Applications/lemon/lemon: 1.38% (1.4298 => 1.4496, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/bisort/bisort: 1.31% (0.8239 => 0.8347, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.27% (2.0200 => 2.0456, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 1.14% (9.0760 => 9.1796, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.10% (1.9433 => 1.9647, std. dev.: 0.0014) MultiSource/Benchmarks/sim/sim: 1.08% (5.0168 => 5.0712, std. dev.: 0.0058) SingleSource/Benchmarks/McGill/chomp: 1.02% (1.2308 => 1.2434, std. dev.: 0.0029) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -21.39% (0.4657 => 0.3661, std. dev.: 0.0054) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.34% (0.2670 => 0.2474, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.92% (0.3511 => 0.3268, std. dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.75% (22.5627 => 21.0387, std. dev.: 0.0039) SingleSource/UnitTests/ObjC/exceptions-3: -3.78% (0.3623 => 0.3486, std. dev.: 0.0026) SingleSource/UnitTests/ObjC/exceptions-4: -3.59% (0.3646 => 0.3515, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.59% (0.3650 => 0.3519, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/trivial-interface: -3.55% (0.3578 => 0.3451, std. dev.: 0.0036) SingleSource/UnitTests/ObjC/exceptions-2: -3.50% (0.3601 => 0.3475, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -3.47% (0.3663 => 0.3536, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -3.22% (0.3940 => 0.3813, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.22% (0.8818 => 0.8534, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -3.11% (0.3789 => 0.3671, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: -3.07% (0.3914 => 0.3794, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.87% (0.6576 => 0.6387, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -2.82% (0.4003 => 0.3890, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: -2.30% (0.6250 => 0.6106, std. dev.: 0.0005) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.56% (0.3139 => 0.2933, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.23% (1.3780 => 1.3059, std. dev.: 0.0111) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9622, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -4.03% (2.5089 => 2.4078, std. dev.: 0.0014) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.67% (1.9762 => 1.9036, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/lists: -2.17% (6.3560 => 6.2181, std. dev.: 0.0115) SingleSource/Benchmarks/Misc/richards_benchmark: -2.16% (1.1560 => 1.1310, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: -1.94% (9.3358 => 9.1543, std. dev.: 0.0241) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.91% (6.6320 => 6.5050, std. dev.: 0.0038) MultiSource/Benchmarks/mafft/pairlocalalign: -1.89% (28.2225 => 27.6901, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9950, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.56% (0.9692 => 0.9541, std. dev.: 0.0000) MultiSource/Applications/lua/lua: -1.47% (26.5159 => 26.1260, std. dev.: 0.0316) SingleSource/Benchmarks/Shootout/heapsort: -1.40% (3.9173 => 3.8623, std. dev.: 0.0027) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.35% (20.3410 => 20.0654, std. dev.: 0.0255) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.23s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat May 19 21:25:36 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 19 May 2012 23:25:36 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120520042536.2CA332A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/723?compare_to=722&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 723, Order: 157145, Start Time: 2012-05-20 03:29:53, End Time: 2012-05-20 04:26:28 To: 722, Order: 157140, Start Time: 2012-05-20 02:06:15, End Time: 2012-05-20 03:02:44 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (63 on baseline) Performance Improvements: 0 (38 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (787 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.89% (2.0176 => 2.2777, std. dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.32% (0.3130 => 0.3359, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.48% (0.2721 => 0.2843, std. dev.: 0.0043) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.85% (3.9660 => 4.1185, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.53% (0.5265 => 0.5451, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.39% (0.6959 => 0.7195, std. dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.22% (0.9199 => 0.9495, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 3.04% (13.8202 => 14.2409, std. dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/football/football: 2.92% (0.8310 => 0.8553, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.90% (0.5577 => 0.5739, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 2.80% (1.0594 => 1.0891, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.79% (0.5637 => 0.5794, std. dev.: 0.0011) MultiSource/Applications/kimwitu++/kc: 2.75% (16.6129 => 17.0698, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.75% (1.2193 => 1.2528, std. dev.: 0.0055) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.66% (1.1364 => 1.1666, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.61% (1.3245 => 1.3591, std. dev.: 0.0011) MultiSource/Applications/siod/siod: 2.57% (2.1791 => 2.2350, std. dev.: 0.0040) MultiSource/Benchmarks/MallocBench/gs/gs: 2.53% (3.8646 => 3.9624, std. dev.: 0.0047) MultiSource/Applications/lambda-0_1_3/lambda: 2.53% (0.7038 => 0.7216, std. dev.: 0.0001) MultiSource/Applications/Burg/burg: 2.51% (1.1061 => 1.1339, std. dev.: 0.0017) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.48% (0.7710 => 0.7901, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.27% (1.4563 => 1.4894, std. dev.: 0.0015) MultiSource/Applications/treecc/treecc: 2.22% (1.9270 => 1.9698, std. dev.: 0.0023) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.21% (0.7460 => 0.7625, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.08% (13.2842 => 13.5605, std. dev.: 0.0136) MultiSource/Applications/hbd/hbd: 1.72% (1.3693 => 1.3929, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: 1.64% (0.7506 => 0.7629, std. dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: 1.58% (16.2614 => 16.5177, std. dev.: 0.0099) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.52% (3.6692 => 3.7248, std. dev.: 0.0059) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.48% (1.3819 => 1.4024, std. dev.: 0.0015) MultiSource/Applications/SIBsim4/SIBsim4: 1.47% (1.2749 => 1.2937, std. dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 1.44% (14.8535 => 15.0680, std. dev.: 0.0106) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.40% (1.3813 => 1.4007, std. dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.31% (3.2742 => 3.3170, std. dev.: 0.0049) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.20% (2.1007 => 2.1259, std. dev.: 0.0016) MultiSource/Applications/JM/ldecod/ldecod: 1.11% (6.5754 => 6.6482, std. dev.: 0.0195) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.36% (1.8175 => 2.2603, std. dev.: 0.0507) SingleSource/Benchmarks/Misc/mandel-2: 8.06% (1.2998 => 1.4045, std. dev.: 0.0050) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6755, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8146, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.81% (1.9144 => 1.9873, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.70% (1.7688 => 1.8342, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/salsa20: 3.59% (7.4271 => 7.6935, std. dev.: 0.0085) MultiSource/Benchmarks/nbench/nbench: 3.12% (11.2619 => 11.6130, std. dev.: 0.0037) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4531, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/flops-6: 2.91% (1.9199 => 1.9757, std. dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.82% (8.8259 => 9.0749, std. dev.: 0.0103) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9394, std. dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.30% (7.9275 => 8.1096, std. dev.: 0.0052) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9600, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 1.56% (0.8273 => 0.8402, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 1.51% (3.2729 => 3.3223, std. dev.: 0.0062) MultiSource/Applications/lemon/lemon: 1.50% (1.4298 => 1.4512, std. dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5095, std. dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: 1.39% (1.2308 => 1.2479, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.27% (2.0200 => 2.0456, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.24% (1.9433 => 1.9673, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 1.11% (9.0760 => 9.1767, std. dev.: 0.0010) MultiSource/Benchmarks/sim/sim: 1.10% (5.0168 => 5.0720, std. dev.: 0.0116) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -21.90% (0.4657 => 0.3637, std. dev.: 0.0032) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.15% (0.2670 => 0.2479, std. dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.58% (22.5627 => 21.0782, std. dev.: 0.0136) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.07% (0.3511 => 0.3298, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -3.67% (0.3623 => 0.3490, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.64% (0.3650 => 0.3517, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -3.64% (0.3601 => 0.3470, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: -3.60% (0.3663 => 0.3531, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -3.54% (0.3646 => 0.3517, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: -3.41% (0.3578 => 0.3456, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/property: -3.17% (0.3940 => 0.3815, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -3.09% (0.3789 => 0.3672, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.94% (0.8818 => 0.8559, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -2.86% (0.3914 => 0.3802, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: -2.65% (0.4003 => 0.3897, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.54% (0.6576 => 0.6409, std. dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/bigfib: -1.97% (0.6250 => 0.6127, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.16% (1.0460 => 0.9502, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.56% (0.3139 => 0.2933, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2650, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9623, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.44% (1.3780 => 1.3168, std. dev.: 0.0065) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -4.05% (2.5089 => 2.4074, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: -3.69% (1.9762 => 1.9032, std. dev.: 0.0102) SingleSource/Benchmarks/Misc/richards_benchmark: -2.12% (1.1560 => 1.1315, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: -2.00% (9.3358 => 9.1489, std. dev.: 0.0173) SingleSource/Benchmarks/Shootout/lists: -1.97% (6.3560 => 6.2307, std. dev.: 0.0106) MultiSource/Benchmarks/mafft/pairlocalalign: -1.89% (28.2225 => 27.6887, std. dev.: 0.0014) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.81% (6.6320 => 6.5119, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3446, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9955, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.55% (20.3410 => 20.0260, std. dev.: 0.0297) MultiSource/Applications/lua/lua: -1.49% (26.5159 => 26.1197, std. dev.: 0.0294) SingleSource/Benchmarks/Shootout/heapsort: -1.47% (3.9173 => 3.8597, std. dev.: 0.0059) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.25s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat May 19 22:49:17 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 20 May 2012 00:49:17 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120520054917.1A14D2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/724?compare_to=723&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 724, Order: 157146, Start Time: 2012-05-20 04:53:34, End Time: 2012-05-20 05:50:09 To: 723, Order: 157145, Start Time: 2012-05-20 03:29:53, End Time: 2012-05-20 04:26:28 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (64 on baseline) Performance Improvements: 0 (38 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (786 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.89% (2.0176 => 2.2776, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.28% (0.3130 => 0.3358, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.37% (0.2721 => 0.2840, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.84% (3.9660 => 4.1182, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.53% (0.6959 => 0.7205, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.46% (0.5265 => 0.5447, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.27% (0.3246 => 0.3352, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.25% (0.9199 => 0.9498, std. dev.: 0.0032) MultiSource/Applications/SPASS/SPASS: 3.06% (13.8202 => 14.2434, std. dev.: 0.0147) MultiSource/Benchmarks/Prolangs-C/football/football: 2.97% (0.8310 => 0.8557, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.89% (0.5637 => 0.5800, std. dev.: 0.0022) MultiSource/Benchmarks/nbench/nbench: 2.87% (1.0594 => 1.0898, std. dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.78% (1.2193 => 1.2532, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.70% (1.3245 => 1.3602, std. dev.: 0.0012) MultiSource/Applications/siod/siod: 2.68% (2.1791 => 2.2376, std. dev.: 0.0077) MultiSource/Applications/kimwitu++/kc: 2.67% (16.6129 => 17.0565, std. dev.: 0.0226) MultiSource/Benchmarks/MallocBench/gs/gs: 2.60% (3.8646 => 3.9650, std. dev.: 0.0023) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.57% (1.1364 => 1.1656, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.44% (0.5577 => 0.5713, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.43% (0.7710 => 0.7897, std. dev.: 0.0011) MultiSource/Applications/Burg/burg: 2.41% (1.1061 => 1.1328, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.29% (1.4563 => 1.4896, std. dev.: 0.0012) MultiSource/Applications/treecc/treecc: 2.20% (1.9270 => 1.9694, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.18% (0.7460 => 0.7623, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.06% (13.2842 => 13.5578, std. dev.: 0.0061) MultiSource/Applications/hbd/hbd: 1.74% (1.3693 => 1.3931, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.61% (1.3819 => 1.4042, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 1.55% (0.7506 => 0.7622, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.51% (3.6692 => 3.7245, std. dev.: 0.0019) MultiSource/Applications/sqlite3/sqlite3: 1.50% (16.2614 => 16.5051, std. dev.: 0.0068) MultiSource/Applications/SIBsim4/SIBsim4: 1.48% (1.2749 => 1.2938, std. dev.: 0.0065) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.42% (1.3813 => 1.4009, std. dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 1.40% (14.8535 => 15.0613, std. dev.: 0.0112) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.33% (3.2742 => 3.3177, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.25% (2.1007 => 2.1270, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.18% (1.1333 => 1.1467, std. dev.: 0.0031) MultiSource/Applications/JM/ldecod/ldecod: 1.15% (6.5754 => 6.6511, std. dev.: 0.0032) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.54% (1.8175 => 2.2635, std. dev.: 0.0245) SingleSource/Benchmarks/Misc/mandel-2: 7.28% (1.2998 => 1.3944, std. dev.: 0.0079) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.89% (1.5824 => 1.6756, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9881, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.67% (1.7688 => 1.8337, std. dev.: 0.0061) SingleSource/Benchmarks/Misc/salsa20: 3.44% (7.4271 => 7.6827, std. dev.: 0.0039) MultiSource/Benchmarks/nbench/nbench: 3.11% (11.2619 => 11.6125, std. dev.: 0.0038) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4535, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-6: 2.95% (1.9199 => 1.9765, std. dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.82% (8.8259 => 9.0748, std. dev.: 0.0168) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.76% (2.8606 => 2.9396, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.25% (7.9275 => 8.1057, std. dev.: 0.0139) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9603, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.60% (0.8273 => 0.8405, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 1.47% (3.2729 => 3.3210, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5099, std. dev.: 0.0010) MultiSource/Applications/lemon/lemon: 1.41% (1.4298 => 1.4499, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.30% (2.0200 => 2.0462, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.25% (1.9433 => 1.9676, std. dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 1.20% (4.5928 => 4.6481, std. dev.: 0.0079) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0019) MultiSource/Benchmarks/sim/sim: 1.14% (5.0168 => 5.0739, std. dev.: 0.0058) SingleSource/Benchmarks/Misc/flops: 1.13% (9.0760 => 9.1789, std. dev.: 0.0011) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.12% (0.2670 => 0.2480, std. dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.53% (22.5627 => 21.0887, std. dev.: 0.0113) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.10% (0.3511 => 0.3297, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -3.84% (0.3623 => 0.3484, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -3.72% (0.3601 => 0.3467, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.67% (0.3650 => 0.3516, std. dev.: 0.0025) SingleSource/UnitTests/ObjC/trivial-interface: -3.61% (0.3578 => 0.3449, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -3.60% (0.3663 => 0.3531, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -3.57% (0.3646 => 0.3516, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -3.25% (0.3940 => 0.3812, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -3.07% (0.3914 => 0.3794, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -2.98% (0.3789 => 0.3676, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.96% (0.8818 => 0.8557, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -2.82% (0.4003 => 0.3890, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.46% (0.6576 => 0.6414, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: -2.11% (0.6250 => 0.6118, std. dev.: 0.0008) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.16% (1.0460 => 0.9502, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.63% (0.3139 => 0.2931, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2642, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.01% (1.3780 => 1.3090, std. dev.: 0.0059) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9623, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -4.09% (2.5089 => 2.4062, std. dev.: 0.0045) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.73% (0.3458 => 0.3329, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.65% (1.9762 => 1.9041, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: -2.12% (1.1560 => 1.1315, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -2.07% (6.3560 => 6.2245, std. dev.: 0.0107) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.95% (20.3410 => 19.9447, std. dev.: 0.0363) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6911, std. dev.: 0.0024) MultiSource/Applications/minisat/minisat: -1.87% (9.3358 => 9.1615, std. dev.: 0.0079) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.82% (6.6320 => 6.5115, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9957, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) MultiSource/Applications/lua/lua: -1.43% (26.5159 => 26.1363, std. dev.: 0.0085) SingleSource/Benchmarks/Shootout/heapsort: -1.32% (3.9173 => 3.8655, std. dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.01% (3.8887 => 3.8495, std. dev.: 0.0042) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.24s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun May 20 01:38:16 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 20 May 2012 03:38:16 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120520083816.3CD822A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/725?compare_to=724&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 725, Order: 157154, Start Time: 2012-05-20 07:42:20, End Time: 2012-05-20 08:39:08 To: 724, Order: 157146, Start Time: 2012-05-20 04:53:34, End Time: 2012-05-20 05:50:09 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (63 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (788 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.73% (2.0176 => 2.2745, std. dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.32% (0.3130 => 0.3359, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.19% (0.2721 => 0.2835, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.73% (3.9660 => 4.1141, std. dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.72% (0.6959 => 0.7218, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.36% (0.5265 => 0.5442, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.20% (0.9199 => 0.9493, std. dev.: 0.0026) MultiSource/Applications/SPASS/SPASS: 3.13% (13.8202 => 14.2521, std. dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.80% (0.5637 => 0.5795, std. dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/football/football: 2.72% (0.8310 => 0.8536, std. dev.: 0.0068) MultiSource/Applications/kimwitu++/kc: 2.71% (16.6129 => 17.0638, std. dev.: 0.0207) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.68% (1.2193 => 1.2520, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.62% (1.3245 => 1.3592, std. dev.: 0.0015) MultiSource/Benchmarks/nbench/nbench: 2.61% (1.0594 => 1.0871, std. dev.: 0.0017) MultiSource/Applications/lambda-0_1_3/lambda: 2.61% (0.7038 => 0.7222, std. dev.: 0.0026) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.54% (0.7710 => 0.7906, std. dev.: 0.0024) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.51% (1.1364 => 1.1649, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/gs/gs: 2.50% (3.8646 => 3.9611, std. dev.: 0.0066) MultiSource/Applications/Burg/burg: 2.50% (1.1061 => 1.1337, std. dev.: 0.0070) MultiSource/Applications/siod/siod: 2.48% (2.1791 => 2.2331, std. dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.47% (0.5577 => 0.5715, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 2.36% (0.4328 => 0.4430, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.35% (0.7460 => 0.7635, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.23% (1.4563 => 1.4888, std. dev.: 0.0023) MultiSource/Applications/treecc/treecc: 2.22% (1.9270 => 1.9697, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.96% (13.2842 => 13.5450, std. dev.: 0.0035) MultiSource/Applications/hbd/hbd: 1.92% (1.3693 => 1.3956, std. dev.: 0.0081) MultiSource/Applications/spiff/spiff: 1.72% (0.7506 => 0.7635, std. dev.: 0.0012) MultiSource/Applications/SIBsim4/SIBsim4: 1.62% (1.2749 => 1.2955, std. dev.: 0.0069) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.43% (3.6692 => 3.7215, std. dev.: 0.0062) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.41% (1.3813 => 1.4008, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.40% (1.3819 => 1.4012, std. dev.: 0.0020) MultiSource/Applications/sqlite3/sqlite3: 1.32% (16.2614 => 16.4755, std. dev.: 0.0154) MultiSource/Applications/JM/lencod/lencod: 1.25% (14.8535 => 15.0392, std. dev.: 0.0052) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.14% (2.1007 => 2.1247, std. dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: 1.08% (6.5754 => 6.6464, std. dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.07% (3.2742 => 3.3092, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.06% (1.1333 => 1.1453, std. dev.: 0.0038) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.00% (1.8175 => 2.2537, std. dev.: 0.0118) SingleSource/Benchmarks/Misc/mandel-2: 7.33% (1.2998 => 1.3951, std. dev.: 0.0138) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.86% (1.5824 => 1.6751, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8146, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9877, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 3.69% (7.4271 => 7.7009, std. dev.: 0.0030) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.64% (1.7688 => 1.8332, std. dev.: 0.0016) MultiSource/Benchmarks/nbench/nbench: 3.12% (11.2619 => 11.6134, std. dev.: 0.0043) MultiSource/Applications/hexxagon/hexxagon: 2.98% (12.0921 => 12.4527, std. dev.: 0.0024) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.93% (8.8259 => 9.0847, std. dev.: 0.0120) SingleSource/Benchmarks/Misc/flops-6: 2.92% (1.9199 => 1.9759, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9393, std. dev.: 0.0023) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.25% (7.9275 => 8.1058, std. dev.: 0.0082) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0086) SingleSource/Benchmarks/Misc/ffbench: 1.61% (0.8273 => 0.8406, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.53% (1.4298 => 1.4517, std. dev.: 0.0042) MultiSource/Applications/siod/siod: 1.44% (3.2729 => 3.3199, std. dev.: 0.0009) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5092, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.29% (2.0200 => 2.0460, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 1.13% (9.0760 => 9.1782, std. dev.: 0.0016) MultiSource/Benchmarks/sim/sim: 1.08% (5.0168 => 5.0712, std. dev.: 0.0101) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.45% (0.2670 => 0.2471, std. dev.: 0.0022) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.89% (0.3511 => 0.3269, std. dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.58% (22.5627 => 21.0786, std. dev.: 0.0094) SingleSource/UnitTests/ObjC/exceptions-3: -3.45% (0.3623 => 0.3498, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-2: -3.36% (0.3601 => 0.3480, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -3.32% (0.3646 => 0.3525, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -3.30% (0.3578 => 0.3460, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: -3.28% (0.3663 => 0.3543, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.15% (0.3650 => 0.3535, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.03% (0.8818 => 0.8551, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/property: -2.99% (0.3940 => 0.3822, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/for-in: -2.85% (0.3789 => 0.3681, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -2.71% (0.3914 => 0.3808, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.62% (0.6576 => 0.6404, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/bigfib: -1.95% (0.6250 => 0.6128, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.16% (1.0460 => 0.9502, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.53% (0.3139 => 0.2934, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.20% (1.3780 => 1.3063, std. dev.: 0.0248) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9623, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -4.05% (2.5089 => 2.4073, std. dev.: 0.0039) MultiSource/Benchmarks/Olden/bh/bh: -3.70% (1.9762 => 1.9031, std. dev.: 0.0014) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.67% (0.3458 => 0.3331, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -3.58% (20.3410 => 19.6136, std. dev.: 0.1782) SingleSource/Benchmarks/Misc/richards_benchmark: -2.13% (1.1560 => 1.1314, std. dev.: 0.0015) MultiSource/Applications/minisat/minisat: -1.93% (9.3358 => 9.1558, std. dev.: 0.0183) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.91% (6.6320 => 6.5054, std. dev.: 0.0065) MultiSource/Benchmarks/mafft/pairlocalalign: -1.89% (28.2225 => 27.6890, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout/lists: -1.87% (6.3560 => 6.2369, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3446, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9959, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.53% (3.9173 => 3.8572, std. dev.: 0.0019) MultiSource/Applications/lua/lua: -1.46% (26.5159 => 26.1289, std. dev.: 0.0219) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.16% (3.8887 => 3.8437, std. dev.: 0.0071) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.44s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun May 20 05:55:39 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 20 May 2012 07:55:39 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120520125539.980F52A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/726?compare_to=725&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 726, Order: 157155, Start Time: 2012-05-20 11:59:56, End Time: 2012-05-20 12:56:32 To: 725, Order: 157154, Start Time: 2012-05-20 07:42:20, End Time: 2012-05-20 08:39:08 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (58 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 891 (791 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/CoyoteBench/huffbench: 2.17% (19.6136 => 20.0388, std. dev.: 0.0118) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.61% (2.0176 => 2.2721, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.28% (0.3130 => 0.3358, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.04% (0.2721 => 0.2831, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.55% (3.9660 => 4.1068, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.46% (0.5265 => 0.5447, std. dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.35% (0.6959 => 0.7192, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.10% (0.9199 => 0.9484, std. dev.: 0.0033) MultiSource/Applications/SPASS/SPASS: 2.82% (13.8202 => 14.2100, std. dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/football/football: 2.71% (0.8310 => 0.8535, std. dev.: 0.0012) MultiSource/Applications/kimwitu++/kc: 2.60% (16.6129 => 17.0454, std. dev.: 0.0083) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.56% (1.3245 => 1.3584, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.56% (1.2193 => 1.2505, std. dev.: 0.0026) MultiSource/Benchmarks/nbench/nbench: 2.55% (1.0594 => 1.0864, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.54% (0.5637 => 0.5780, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 2.50% (0.7038 => 0.7214, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.41% (1.1364 => 1.1638, std. dev.: 0.0030) MultiSource/Applications/siod/siod: 2.39% (2.1791 => 2.2311, std. dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.37% (0.5577 => 0.5709, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.36% (0.7710 => 0.7892, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/gs/gs: 2.35% (3.8646 => 3.9556, std. dev.: 0.0039) MultiSource/Applications/Burg/burg: 2.20% (1.1061 => 1.1304, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.13% (1.4563 => 1.4873, std. dev.: 0.0044) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.08% (0.7460 => 0.7615, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 2.00% (1.9270 => 1.9656, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.77% (13.2842 => 13.5189, std. dev.: 0.0259) MultiSource/Applications/hbd/hbd: 1.71% (1.3693 => 1.3927, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 1.35% (16.2614 => 16.4805, std. dev.: 0.0272) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.29% (3.6692 => 3.7167, std. dev.: 0.0054) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.28% (1.3819 => 1.3996, std. dev.: 0.0026) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.27% (1.3813 => 1.3989, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.10% (2.1007 => 2.1238, std. dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 1.08% (14.8535 => 15.0146, std. dev.: 0.0105) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.02% (3.2742 => 3.3076, std. dev.: 0.0021) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 23.83% (1.8175 => 2.2506, std. dev.: 0.0374) SingleSource/Benchmarks/Misc/mandel-2: 6.95% (1.2998 => 1.3902, std. dev.: 0.0094) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6754, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.81% (1.9144 => 1.9873, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.64% (1.7688 => 1.8331, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/salsa20: 3.52% (7.4271 => 7.6883, std. dev.: 0.0087) MultiSource/Benchmarks/nbench/nbench: 3.18% (11.2619 => 11.6195, std. dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 3.16% (8.8259 => 9.1047, std. dev.: 0.0068) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4534, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/flops-6: 2.87% (1.9199 => 1.9750, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.76% (2.8606 => 2.9395, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.18% (7.9275 => 8.1003, std. dev.: 0.0074) SingleSource/Benchmarks/Misc/ffbench: 1.60% (0.8273 => 0.8405, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 1.48% (3.2729 => 3.3213, std. dev.: 0.0077) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5098, std. dev.: 0.0005) MultiSource/Applications/lemon/lemon: 1.39% (1.4298 => 1.4497, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.27% (2.0200 => 2.0457, std. dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/fldry: 1.25% (1.9290 => 1.9531, std. dev.: 0.0033) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.22% (1.9433 => 1.9670, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/flops: 1.10% (9.0760 => 9.1762, std. dev.: 0.0013) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.00% (0.2670 => 0.2483, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.84% (22.5627 => 21.0205, std. dev.: 0.0093) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.75% (0.3511 => 0.3274, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-3: -3.70% (0.3623 => 0.3489, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: -3.69% (0.3601 => 0.3468, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.64% (0.3650 => 0.3517, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -3.55% (0.3578 => 0.3451, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -3.54% (0.3646 => 0.3517, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -3.49% (0.3663 => 0.3535, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.40% (0.8818 => 0.8518, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: -3.17% (0.3940 => 0.3815, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -3.04% (0.3789 => 0.3674, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -3.01% (0.3914 => 0.3796, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -2.75% (0.4003 => 0.3893, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.59% (0.6576 => 0.6406, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/bigfib: -2.22% (0.6250 => 0.6111, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.17% (0.9108 => 0.9001, std. dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.66% (0.3139 => 0.2930, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.73% (1.3780 => 1.3128, std. dev.: 0.0056) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9623, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0011) SingleSource/Benchmarks/Dhrystone/dry: -4.01% (2.5089 => 2.4083, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.65% (1.9762 => 1.9041, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -2.14% (6.6320 => 6.4901, std. dev.: 0.0101) SingleSource/Benchmarks/Misc/richards_benchmark: -2.13% (1.1560 => 1.1314, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.96% (6.3560 => 6.2317, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: -1.92% (9.3358 => 9.1563, std. dev.: 0.0287) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6916, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3446, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9955, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.49% (20.3410 => 20.0388, std. dev.: 0.0118) MultiSource/Applications/lua/lua: -1.47% (26.5159 => 26.1253, std. dev.: 0.0638) SingleSource/Benchmarks/Shootout/heapsort: -1.42% (3.9173 => 3.8618, std. dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.05% (3.8887 => 3.8480, std. dev.: 0.0019) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.17s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun May 20 08:51:18 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 20 May 2012 10:51:18 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120520155118.1C98A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/727?compare_to=726&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 727, Order: 157158, Start Time: 2012-05-20 14:55:35, End Time: 2012-05-20 15:52:11 To: 726, Order: 157155, Start Time: 2012-05-20 11:59:56, End Time: 2012-05-20 12:56:32 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (53 on baseline) Performance Improvements: 1 (40 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 891 (795 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary3: -1.30% (3.7483 => 3.6997, std. dev.: 0.0111) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.21% (2.0176 => 2.2640, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.68% (0.3130 => 0.3339, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.82% (0.2721 => 0.2825, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.03% (3.9660 => 4.0863, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.67% (0.6959 => 0.7145, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.55% (0.5265 => 0.5399, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.54% (0.9199 => 0.9433, std. dev.: 0.0048) MultiSource/Applications/SPASS/SPASS: 2.34% (13.8202 => 14.1432, std. dev.: 0.0117) MultiSource/Benchmarks/nbench/nbench: 2.25% (1.0594 => 1.0832, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/football/football: 2.17% (0.8310 => 0.8490, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.10% (1.1364 => 1.1603, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.06% (0.5637 => 0.5753, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.02% (1.2193 => 1.2439, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.02% (1.3245 => 1.3512, std. dev.: 0.0097) MultiSource/Applications/hbd/hbd: 1.89% (1.3693 => 1.3952, std. dev.: 0.0039) MultiSource/Applications/siod/siod: 1.86% (2.1791 => 2.2196, std. dev.: 0.0038) MultiSource/Applications/kimwitu++/kc: 1.81% (16.6129 => 16.9134, std. dev.: 0.0050) MultiSource/Applications/lambda-0_1_3/lambda: 1.76% (0.7038 => 0.7162, std. dev.: 0.0042) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.71% (1.4563 => 1.4812, std. dev.: 0.0028) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.67% (0.7710 => 0.7839, std. dev.: 0.0040) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.58% (0.7460 => 0.7578, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/gs/gs: 1.57% (3.8646 => 3.9253, std. dev.: 0.0075) MultiSource/Applications/Burg/burg: 1.52% (1.1061 => 1.1229, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.50% (13.2842 => 13.4828, std. dev.: 0.0066) MultiSource/Applications/treecc/treecc: 1.48% (1.9270 => 1.9555, std. dev.: 0.0035) MultiSource/Applications/sqlite3/sqlite3: 1.09% (16.2614 => 16.4388, std. dev.: 0.0443) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.06% (1.3819 => 1.3965, std. dev.: 0.0021) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 25.95% (1.8175 => 2.2891, std. dev.: 0.0272) SingleSource/Benchmarks/Misc/mandel-2: 7.61% (1.2998 => 1.3987, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.86% (1.5824 => 1.6751, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8146, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 3.79% (1.9144 => 1.9870, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.69% (1.7688 => 1.8341, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: 3.50% (7.4271 => 7.6870, std. dev.: 0.0145) MultiSource/Benchmarks/nbench/nbench: 3.16% (11.2619 => 11.6182, std. dev.: 0.0038) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4540, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: 2.88% (1.9199 => 1.9751, std. dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.76% (8.8259 => 9.0696, std. dev.: 0.0222) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9393, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.31% (7.9275 => 8.1106, std. dev.: 0.0165) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.58% (0.8273 => 0.8404, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.54% (1.4298 => 1.4518, std. dev.: 0.0017) MultiSource/Applications/siod/siod: 1.45% (3.2729 => 3.3203, std. dev.: 0.0028) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5086, std. dev.: 0.0017) MultiSource/Applications/sqlite3/sqlite3: 1.33% (4.5928 => 4.6539, std. dev.: 0.0116) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.26% (2.0200 => 2.0455, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.25% (1.9433 => 1.9676, std. dev.: 0.0061) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 1.14% (9.0760 => 9.1797, std. dev.: 0.0014) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -13.89% (0.4657 => 0.4010, std. dev.: 0.0150) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.12% (0.2670 => 0.2480, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.07% (22.5627 => 20.9672, std. dev.: 0.0127) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.86% (0.3511 => 0.3270, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: -4.75% (0.3623 => 0.3451, std. dev.: 0.0027) SingleSource/UnitTests/ObjC/exceptions-2: -4.72% (0.3601 => 0.3431, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.71% (0.3650 => 0.3478, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/synchronized: -4.67% (0.3663 => 0.3492, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: -4.67% (0.3578 => 0.3411, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -4.61% (0.3646 => 0.3478, std. dev.: 0.0017) SingleSource/UnitTests/ObjC/property: -4.29% (0.3940 => 0.3771, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -4.14% (0.3789 => 0.3632, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -4.06% (0.3914 => 0.3755, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -3.90% (0.4003 => 0.3847, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.73% (0.8818 => 0.8489, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.42% (0.6576 => 0.6351, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: -2.30% (0.6250 => 0.6106, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.59% (0.9108 => 0.8963, std. dev.: 0.0004) MultiSource/Applications/lua/lua: -1.14% (3.7467 => 3.7041, std. dev.: 0.0029) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.59% (0.3139 => 0.2932, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.20% (2.4152 => 2.2654, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.14% (1.3780 => 1.3072, std. dev.: 0.0104) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9624, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -4.03% (2.5089 => 2.4077, std. dev.: 0.0016) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.67% (0.3458 => 0.3331, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -3.66% (1.9762 => 1.9038, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout/lists: -2.35% (6.3560 => 6.2066, std. dev.: 0.0092) SingleSource/Benchmarks/Misc/richards_benchmark: -2.14% (1.1560 => 1.1313, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: -1.95% (9.3358 => 9.1534, std. dev.: 0.0125) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6907, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.81% (6.6320 => 6.5121, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.65% (20.3410 => 20.0058, std. dev.: 0.0546) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9951, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) MultiSource/Applications/lua/lua: -1.42% (26.5159 => 26.1384, std. dev.: 0.0202) SingleSource/Benchmarks/Shootout/heapsort: -1.17% (3.9173 => 3.8714, std. dev.: 0.0112) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.24s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun May 20 11:41:27 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 20 May 2012 13:41:27 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120520184127.652282A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/728?compare_to=727&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 728, Order: 157159, Start Time: 2012-05-20 17:45:50, End Time: 2012-05-20 18:42:20 To: 727, Order: 157158, Start Time: 2012-05-20 14:55:35, End Time: 2012-05-20 15:52:11 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (55 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (793 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.21% (2.0176 => 2.2639, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.77% (0.3130 => 0.3342, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.86% (0.2721 => 0.2826, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.04% (3.9660 => 4.0866, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.73% (0.6959 => 0.7149, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.55% (0.9199 => 0.9434, std. dev.: 0.0061) MultiSource/Benchmarks/nbench/nbench: 2.40% (1.0594 => 1.0848, std. dev.: 0.0020) MultiSource/Applications/SPASS/SPASS: 2.34% (13.8202 => 14.1440, std. dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/football/football: 2.26% (0.8310 => 0.8498, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.20% (0.5637 => 0.5761, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.08% (1.3245 => 1.3520, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.03% (1.2193 => 1.2441, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.98% (1.1364 => 1.1589, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.96% (1.4563 => 1.4849, std. dev.: 0.0009) MultiSource/Applications/siod/siod: 1.94% (2.1791 => 2.2213, std. dev.: 0.0018) MultiSource/Applications/kimwitu++/kc: 1.86% (16.6129 => 16.9216, std. dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.81% (0.5577 => 0.5678, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 1.65% (1.9270 => 1.9587, std. dev.: 0.0089) MultiSource/Benchmarks/MallocBench/gs/gs: 1.64% (3.8646 => 3.9279, std. dev.: 0.0045) MultiSource/Applications/Burg/burg: 1.64% (1.1061 => 1.1242, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.62% (0.7710 => 0.7835, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.56% (13.2842 => 13.4912, std. dev.: 0.0115) MultiSource/Applications/hbd/hbd: 1.54% (1.3693 => 1.3904, std. dev.: 0.0017) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.45% (0.7460 => 0.7568, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.24% (1.3819 => 1.3990, std. dev.: 0.0018) MultiSource/Applications/sqlite3/sqlite3: 1.10% (16.2614 => 16.4400, std. dev.: 0.0206) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.03% (3.6692 => 3.7071, std. dev.: 0.0024) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 26.11% (1.8175 => 2.2920, std. dev.: 0.0276) SingleSource/Benchmarks/Misc/mandel-2: 8.52% (1.2998 => 1.4105, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6755, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8146, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9875, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.69% (1.7688 => 1.8341, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/salsa20: 3.68% (7.4271 => 7.7001, std. dev.: 0.0021) MultiSource/Benchmarks/nbench/nbench: 3.15% (11.2619 => 11.6170, std. dev.: 0.0031) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4531, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-6: 2.97% (1.9199 => 1.9770, std. dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 2.83% (4.5928 => 4.7227, std. dev.: 0.0404) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.75% (8.8259 => 9.0682, std. dev.: 0.0235) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.74% (2.8606 => 2.9391, std. dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.35% (7.9275 => 8.1136, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.61% (0.8273 => 0.8406, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 1.48% (3.2729 => 3.3213, std. dev.: 0.0066) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5089, std. dev.: 0.0034) MultiSource/Applications/lemon/lemon: 1.41% (1.4298 => 1.4499, std. dev.: 0.0007) MultiSource/Benchmarks/llubenchmark/llu: 1.31% (3.7731 => 3.8225, std. dev.: 0.0101) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.29% (2.0200 => 2.0461, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.18% (1.9433 => 1.9663, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 1.13% (9.0760 => 9.1784, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 1.07% (1.2308 => 1.2440, std. dev.: 0.0017) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -16.81% (0.4657 => 0.3874, std. dev.: 0.0149) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.18% (22.5627 => 20.9433, std. dev.: 0.0177) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.97% (0.2670 => 0.2484, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.92% (0.3511 => 0.3268, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: -4.47% (0.3623 => 0.3461, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.41% (0.3650 => 0.3489, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -4.39% (0.3601 => 0.3443, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -4.30% (0.3578 => 0.3424, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -4.23% (0.3663 => 0.3508, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -4.22% (0.3646 => 0.3492, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -3.93% (0.3940 => 0.3785, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -3.77% (0.3789 => 0.3646, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -3.76% (0.3914 => 0.3767, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.75% (0.8818 => 0.8487, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/parameter-passing: -3.62% (0.4003 => 0.3858, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.13% (0.6576 => 0.6370, std. dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/bigfib: -2.22% (0.6250 => 0.6111, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.66% (0.9108 => 0.8957, std. dev.: 0.0002) MultiSource/Applications/lua/lua: -1.20% (3.7467 => 3.7017, std. dev.: 0.0041) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.16% (1.0460 => 0.9502, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.50% (0.3139 => 0.2935, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.93% (1.3780 => 1.3100, std. dev.: 0.0060) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9623, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0010) SingleSource/Benchmarks/Dhrystone/dry: -4.04% (2.5089 => 2.4076, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.65% (1.9762 => 1.9041, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -2.13% (6.3560 => 6.2204, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/richards_benchmark: -2.13% (1.1560 => 1.1314, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: -1.98% (9.3358 => 9.1510, std. dev.: 0.0212) MultiSource/Benchmarks/mafft/pairlocalalign: -1.89% (28.2225 => 27.6892, std. dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.85% (20.3410 => 19.9656, std. dev.: 0.0138) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.80% (6.6320 => 6.5126, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9960, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.36% (3.9173 => 3.8639, std. dev.: 0.0012) MultiSource/Applications/lua/lua: -1.31% (26.5159 => 26.1684, std. dev.: 0.0045) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.31s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun May 20 13:04:33 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 20 May 2012 15:04:33 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120520200433.567D92A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/729?compare_to=728&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 729, Order: 157162, Start Time: 2012-05-20 19:08:53, End Time: 2012-05-20 20:05:26 To: 728, Order: 157159, Start Time: 2012-05-20 17:45:50, End Time: 2012-05-20 18:42:20 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (59 on baseline) Performance Improvements: 1 (34 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 891 (795 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/sqlite3/sqlite3: -1.62% (4.7227 => 4.6463, std. dev.: 0.0040) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.14% (2.0176 => 2.2828, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.87% (0.3130 => 0.3345, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.90% (0.2721 => 0.2827, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.44% (3.9660 => 4.1026, std. dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.94% (0.5265 => 0.5420, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.87% (0.9199 => 0.9463, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.83% (0.6959 => 0.7156, std. dev.: 0.0027) MultiSource/Applications/SPASS/SPASS: 2.64% (13.8202 => 14.1855, std. dev.: 0.0063) MultiSource/Benchmarks/nbench/nbench: 2.52% (1.0594 => 1.0861, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 2.52% (0.8310 => 0.8519, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.43% (0.5637 => 0.5774, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.33% (1.2193 => 1.2477, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.29% (1.1364 => 1.1624, std. dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.26% (1.3245 => 1.3544, std. dev.: 0.0010) MultiSource/Applications/kimwitu++/kc: 2.18% (16.6129 => 16.9758, std. dev.: 0.0079) MultiSource/Applications/siod/siod: 2.15% (2.1791 => 2.2260, std. dev.: 0.0123) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.99% (0.5577 => 0.5688, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.98% (1.4563 => 1.4851, std. dev.: 0.0077) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.91% (0.7710 => 0.7857, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.87% (13.2842 => 13.5326, std. dev.: 0.0056) MultiSource/Applications/Burg/burg: 1.86% (1.1061 => 1.1267, std. dev.: 0.0043) MultiSource/Benchmarks/MallocBench/gs/gs: 1.86% (3.8646 => 3.9365, std. dev.: 0.0060) MultiSource/Applications/treecc/treecc: 1.70% (1.9270 => 1.9597, std. dev.: 0.0020) MultiSource/Applications/lambda-0_1_3/lambda: 1.65% (0.7038 => 0.7154, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.60% (0.7460 => 0.7579, std. dev.: 0.0010) MultiSource/Applications/hbd/hbd: 1.48% (1.3693 => 1.3895, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.21% (3.6692 => 3.7137, std. dev.: 0.0034) MultiSource/Applications/JM/lencod/lencod: 1.17% (14.8535 => 15.0275, std. dev.: 0.0025) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.16% (1.3813 => 1.3973, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.14% (1.3819 => 1.3977, std. dev.: 0.0011) MultiSource/Applications/SIBsim4/SIBsim4: 1.09% (1.2749 => 1.2888, std. dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: 1.07% (16.2614 => 16.4355, std. dev.: 0.0179) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.46% (1.8175 => 2.2620, std. dev.: 0.0411) SingleSource/Benchmarks/Misc/mandel-2: 8.54% (1.2998 => 1.4108, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7298, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.86% (1.5824 => 1.6751, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9877, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.69% (1.7688 => 1.8341, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/salsa20: 3.59% (7.4271 => 7.6935, std. dev.: 0.0066) MultiSource/Benchmarks/nbench/nbench: 3.11% (11.2619 => 11.6124, std. dev.: 0.0020) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4549, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 3.00% (8.8259 => 9.0905, std. dev.: 0.0105) SingleSource/Benchmarks/Misc/flops-6: 2.88% (1.9199 => 1.9752, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9392, std. dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.41% (7.9275 => 8.1182, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9603, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/ffbench: 1.60% (0.8273 => 0.8405, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 1.42% (3.2729 => 3.3195, std. dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5083, std. dev.: 0.0035) MultiSource/Applications/lemon/lemon: 1.37% (1.4298 => 1.4494, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.30% (2.0200 => 2.0463, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0034) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.17% (1.9433 => 1.9660, std. dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: 1.16% (4.5928 => 4.6463, std. dev.: 0.0040) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1775, std. dev.: 0.0007) MultiSource/Benchmarks/sim/sim: 1.08% (5.0168 => 5.0712, std. dev.: 0.0063) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.23% (0.2670 => 0.2477, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.74% (22.5627 => 21.0423, std. dev.: 0.0148) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.07% (0.3511 => 0.3298, std. dev.: 0.0046) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.44% (0.8818 => 0.8515, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: -3.23% (0.3623 => 0.3506, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.12% (0.3650 => 0.3536, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -3.10% (0.3646 => 0.3533, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -3.08% (0.3601 => 0.3490, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -3.05% (0.3578 => 0.3469, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -3.00% (0.3663 => 0.3553, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: -2.32% (0.6250 => 0.6105, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.99% (0.6576 => 0.6445, std. dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.27% (0.9108 => 0.8992, std. dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.59% (0.3139 => 0.2932, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2642, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.85% (1.3780 => 1.3112, std. dev.: 0.0032) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9623, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.99% (2.5089 => 2.4089, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.67% (0.3458 => 0.3331, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.65% (1.9762 => 1.9040, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/richards_benchmark: -2.15% (1.1560 => 1.1312, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -2.11% (6.3560 => 6.2222, std. dev.: 0.0141) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.02% (20.3410 => 19.9300, std. dev.: 0.0319) MultiSource/Applications/minisat/minisat: -1.97% (9.3358 => 9.1515, std. dev.: 0.0316) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6906, std. dev.: 0.0020) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.84% (6.6320 => 6.5100, std. dev.: 0.0056) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3446, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9960, std. dev.: 0.0003) MultiSource/Applications/lua/lua: -1.58% (26.5159 => 26.0971, std. dev.: 0.0374) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.53% (3.9173 => 3.8572, std. dev.: 0.0039) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.33s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun May 20 14:27:05 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 20 May 2012 16:27:05 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120520212705.1F38C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/730?compare_to=729&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 730, Order: 157165, Start Time: 2012-05-20 20:31:21, End Time: 2012-05-20 21:27:55 To: 729, Order: 157162, Start Time: 2012-05-20 19:08:53, End Time: 2012-05-20 20:05:26 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (57 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (794 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.73% (2.0176 => 2.2745, std. dev.: 0.0135) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.71% (0.3130 => 0.3340, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.86% (0.2721 => 0.2826, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.36% (3.9660 => 4.0994, std. dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.89% (0.5265 => 0.5417, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.86% (0.6959 => 0.7158, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.86% (0.9199 => 0.9462, std. dev.: 0.0022) MultiSource/Applications/SPASS/SPASS: 2.72% (13.8202 => 14.1966, std. dev.: 0.0122) MultiSource/Benchmarks/nbench/nbench: 2.49% (1.0594 => 1.0858, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/football/football: 2.44% (0.8310 => 0.8513, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.34% (0.5637 => 0.5769, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.33% (1.2193 => 1.2477, std. dev.: 0.0037) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.27% (0.7710 => 0.7885, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.26% (1.3245 => 1.3544, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.23% (1.1364 => 1.1617, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.15% (0.5577 => 0.5697, std. dev.: 0.0018) MultiSource/Applications/kimwitu++/kc: 2.09% (16.6129 => 16.9609, std. dev.: 0.0254) MultiSource/Applications/siod/siod: 2.08% (2.1791 => 2.2245, std. dev.: 0.0066) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.96% (1.4563 => 1.4848, std. dev.: 0.0015) MultiSource/Applications/Burg/burg: 1.91% (1.1061 => 1.1272, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/gs/gs: 1.88% (3.8646 => 3.9372, std. dev.: 0.0055) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.83% (13.2842 => 13.5274, std. dev.: 0.0075) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.74% (0.7460 => 0.7590, std. dev.: 0.0015) MultiSource/Applications/lambda-0_1_3/lambda: 1.73% (0.7038 => 0.7160, std. dev.: 0.0026) MultiSource/Applications/treecc/treecc: 1.67% (1.9270 => 1.9591, std. dev.: 0.0058) MultiSource/Applications/hbd/hbd: 1.42% (1.3693 => 1.3888, std. dev.: 0.0048) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.22% (1.3819 => 1.3988, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.18% (3.6692 => 3.7124, std. dev.: 0.0119) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.17% (1.3813 => 1.3974, std. dev.: 0.0027) MultiSource/Applications/sqlite3/sqlite3: 1.06% (16.2614 => 16.4344, std. dev.: 0.0092) MultiSource/Applications/SIBsim4/SIBsim4: 1.04% (1.2749 => 1.2881, std. dev.: 0.0012) MultiSource/Applications/JM/lencod/lencod: 1.01% (14.8535 => 15.0033, std. dev.: 0.0064) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.04% (1.8175 => 2.2544, std. dev.: 0.0536) SingleSource/Benchmarks/Misc/mandel-2: 8.47% (1.2998 => 1.4099, std. dev.: 0.0078) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.90% (1.5824 => 1.6757, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9877, std. dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.61% (1.7688 => 1.8327, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/salsa20: 3.61% (7.4271 => 7.6951, std. dev.: 0.0081) MultiSource/Benchmarks/nbench/nbench: 3.14% (11.2619 => 11.6153, std. dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4549, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: 2.93% (1.9199 => 1.9761, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9393, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.62% (8.8259 => 9.0567, std. dev.: 0.0221) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.34% (7.9275 => 8.1129, std. dev.: 0.0090) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.60% (0.8273 => 0.8405, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 1.47% (3.2729 => 3.3211, std. dev.: 0.0012) MultiSource/Applications/lemon/lemon: 1.45% (1.4298 => 1.4506, std. dev.: 0.0017) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5097, std. dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.25% (2.0200 => 2.0453, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1773, std. dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: 1.08% (1.2308 => 1.2441, std. dev.: 0.0023) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -17.95% (0.4657 => 0.3821, std. dev.: 0.0322) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.30% (0.2670 => 0.2475, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.89% (0.3511 => 0.3269, std. dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.74% (22.5627 => 21.0410, std. dev.: 0.0138) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.65% (0.8818 => 0.8496, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: -3.20% (0.3623 => 0.3507, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.12% (0.3650 => 0.3536, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -3.05% (0.3601 => 0.3491, std. dev.: 0.0029) SingleSource/UnitTests/ObjC/exceptions-4: -3.02% (0.3646 => 0.3536, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -3.00% (0.3663 => 0.3553, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: -2.99% (0.3578 => 0.3471, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -2.66% (0.3940 => 0.3835, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -2.58% (0.3914 => 0.3813, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.40% (0.6576 => 0.6418, std. dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/bigfib: -2.14% (0.6250 => 0.6116, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.56% (0.3139 => 0.2933, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9624, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.51% (1.3780 => 1.3159, std. dev.: 0.0034) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -4.01% (2.5089 => 2.4083, std. dev.: 0.0012) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.73% (0.3458 => 0.3329, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.64% (1.9762 => 1.9042, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/lists: -2.23% (6.3560 => 6.2141, std. dev.: 0.0083) SingleSource/Benchmarks/Misc/richards_benchmark: -2.12% (1.1560 => 1.1315, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: -1.96% (9.3358 => 9.1524, std. dev.: 0.0138) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.90% (6.6320 => 6.5061, std. dev.: 0.0019) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6909, std. dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.77% (20.3410 => 19.9816, std. dev.: 0.0697) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9956, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.44% (3.9173 => 3.8607, std. dev.: 0.0186) MultiSource/Applications/lua/lua: -1.44% (26.5159 => 26.1336, std. dev.: 0.0328) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.01% (3.8887 => 3.8493, std. dev.: 0.0042) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.58s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun May 20 15:49:37 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 20 May 2012 17:49:37 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120520224937.764832A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/731?compare_to=730&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 731, Order: 157167, Start Time: 2012-05-20 21:53:57, End Time: 2012-05-20 22:50:30 To: 730, Order: 157165, Start Time: 2012-05-20 20:31:21, End Time: 2012-05-20 21:27:55 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (54 on baseline) Performance Improvements: 0 (31 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (803 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.64% (2.0176 => 2.2727, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.65% (0.3130 => 0.3338, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.20% (3.9660 => 4.0928, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.77% (0.5265 => 0.5411, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.64% (0.9199 => 0.9442, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 2.59% (13.8202 => 14.1779, std. dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.56% (0.6959 => 0.7137, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.32% (0.5637 => 0.5768, std. dev.: 0.0020) MultiSource/Benchmarks/nbench/nbench: 2.32% (1.0594 => 1.0840, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/football/football: 2.25% (0.8310 => 0.8497, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.17% (1.2193 => 1.2457, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.01% (1.1364 => 1.1592, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.96% (0.7710 => 0.7861, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.95% (0.5577 => 0.5686, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.92% (1.4563 => 1.4842, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.89% (1.3245 => 1.3495, std. dev.: 0.0065) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.77% (13.2842 => 13.5187, std. dev.: 0.0157) MultiSource/Applications/kimwitu++/kc: 1.75% (16.6129 => 16.9041, std. dev.: 0.0119) MultiSource/Applications/Burg/burg: 1.74% (1.1061 => 1.1254, std. dev.: 0.0036) MultiSource/Applications/siod/siod: 1.68% (2.1791 => 2.2157, std. dev.: 0.0005) MultiSource/Applications/hbd/hbd: 1.63% (1.3693 => 1.3916, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: 1.60% (3.8646 => 3.9266, std. dev.: 0.0152) MultiSource/Applications/lambda-0_1_3/lambda: 1.53% (0.7038 => 0.7146, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.53% (0.7460 => 0.7574, std. dev.: 0.0013) MultiSource/Applications/treecc/treecc: 1.51% (1.9270 => 1.9561, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.26% (1.3819 => 1.3993, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.09% (3.6692 => 3.7093, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.04% (1.3813 => 1.3956, std. dev.: 0.0011) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.25% (1.8175 => 2.2582, std. dev.: 0.0458) SingleSource/Benchmarks/Misc/mandel-2: 7.36% (1.2998 => 1.3955, std. dev.: 0.0086) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.86% (1.5824 => 1.6751, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8147, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9882, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.72% (1.7688 => 1.8346, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/salsa20: 3.63% (7.4271 => 7.6968, std. dev.: 0.0022) MultiSource/Benchmarks/nbench/nbench: 3.15% (11.2619 => 11.6170, std. dev.: 0.0055) MultiSource/Applications/hexxagon/hexxagon: 2.98% (12.0921 => 12.4526, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-6: 2.90% (1.9199 => 1.9756, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.74% (2.8606 => 2.9391, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.66% (8.8259 => 9.0607, std. dev.: 0.0126) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.35% (7.9275 => 8.1138, std. dev.: 0.0189) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.61% (0.8273 => 0.8406, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.52% (1.4298 => 1.4516, std. dev.: 0.0014) MultiSource/Applications/siod/siod: 1.46% (3.2729 => 3.3207, std. dev.: 0.0023) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5101, std. dev.: 0.0087) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.25% (2.0200 => 2.0453, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0033) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.14% (1.9433 => 1.9654, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops: 1.11% (9.0760 => 9.1768, std. dev.: 0.0014) MultiSource/Benchmarks/sim/sim: 1.06% (5.0168 => 5.0699, std. dev.: 0.0126) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -15.91% (0.4657 => 0.3916, std. dev.: 0.0057) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.34% (0.2670 => 0.2474, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.86% (0.3511 => 0.3270, std. dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.85% (22.5627 => 21.0163, std. dev.: 0.0050) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.95% (0.8818 => 0.8470, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.19% (0.6576 => 0.6432, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/bigfib: -2.10% (0.6250 => 0.6119, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.76% (0.9108 => 0.8948, std. dev.: 0.0005) MultiSource/Applications/lua/lua: -1.09% (3.7467 => 3.7058, std. dev.: 0.0061) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.50% (0.3139 => 0.2935, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.10% (1.3780 => 1.3077, std. dev.: 0.0046) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9622, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -4.07% (2.5089 => 2.4069, std. dev.: 0.0016) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.66% (1.9762 => 1.9038, std. dev.: 0.0103) SingleSource/Benchmarks/Shootout/lists: -2.17% (6.3560 => 6.2183, std. dev.: 0.0047) SingleSource/Benchmarks/Misc/richards_benchmark: -2.14% (1.1560 => 1.1313, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.96% (6.6320 => 6.5023, std. dev.: 0.0060) MultiSource/Applications/minisat/minisat: -1.94% (9.3358 => 9.1549, std. dev.: 0.0348) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6907, std. dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.71% (20.3410 => 19.9939, std. dev.: 0.0563) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3444, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9954, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.52% (3.9173 => 3.8577, std. dev.: 0.0021) MultiSource/Applications/lua/lua: -1.30% (26.5159 => 26.1720, std. dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.12% (3.8887 => 3.8453, std. dev.: 0.0062) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.51s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun May 20 17:12:03 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 20 May 2012 19:12:03 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120521001203.7DDC32A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/732?compare_to=731&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 732, Order: 157170, Start Time: 2012-05-20 23:16:25, End Time: 2012-05-21 00:12:55 To: 731, Order: 157167, Start Time: 2012-05-20 21:53:57, End Time: 2012-05-20 22:50:30 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (50 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (798 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.29% (2.0176 => 2.2656, std. dev.: 0.0137) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.52% (0.3130 => 0.3334, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.01% (3.9660 => 4.0855, std. dev.: 0.0081) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.74% (0.5265 => 0.5409, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.57% (0.6959 => 0.7138, std. dev.: 0.0017) MultiSource/Applications/SPASS/SPASS: 2.54% (13.8202 => 14.1709, std. dev.: 0.0116) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.48% (0.9199 => 0.9427, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 2.35% (1.0594 => 1.0843, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/football/football: 2.20% (0.8310 => 0.8493, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.06% (1.2193 => 1.2444, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.04% (0.5637 => 0.5752, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.01% (1.1364 => 1.1592, std. dev.: 0.0015) MultiSource/Applications/kimwitu++/kc: 2.00% (16.6129 => 16.9451, std. dev.: 0.0161) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.96% (0.7710 => 0.7861, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.92% (1.3245 => 1.3499, std. dev.: 0.0020) MultiSource/Applications/siod/siod: 1.87% (2.1791 => 2.2198, std. dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: 1.73% (0.7038 => 0.7160, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/gs/gs: 1.66% (3.8646 => 3.9289, std. dev.: 0.0051) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.65% (1.4563 => 1.4803, std. dev.: 0.0015) MultiSource/Applications/Burg/burg: 1.61% (1.1061 => 1.1239, std. dev.: 0.0035) MultiSource/Applications/treecc/treecc: 1.46% (1.9270 => 1.9552, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.45% (0.7460 => 0.7568, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.39% (13.2842 => 13.4694, std. dev.: 0.0012) MultiSource/Applications/hbd/hbd: 1.14% (1.3693 => 1.3849, std. dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.60% (1.8175 => 2.2646, std. dev.: 0.0112) SingleSource/Benchmarks/Misc/mandel-2: 6.72% (1.2998 => 1.3871, std. dev.: 0.0097) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6754, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8143, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9877, std. dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.65% (1.7688 => 1.8334, std. dev.: 0.0057) SingleSource/Benchmarks/Misc/salsa20: 3.54% (7.4271 => 7.6901, std. dev.: 0.0081) MultiSource/Benchmarks/nbench/nbench: 3.12% (11.2619 => 11.6138, std. dev.: 0.0024) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 3.05% (8.8259 => 9.0948, std. dev.: 0.0064) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4550, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: 2.92% (1.9199 => 1.9760, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9392, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.36% (7.9275 => 8.1145, std. dev.: 0.0157) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.62% (0.8273 => 0.8407, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 1.47% (3.2729 => 3.3209, std. dev.: 0.0007) MultiSource/Applications/lemon/lemon: 1.46% (1.4298 => 1.4507, std. dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5090, std. dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.28% (2.0200 => 2.0458, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.24% (1.9433 => 1.9673, std. dev.: 0.0059) MultiSource/Applications/sqlite3/sqlite3: 1.21% (4.5928 => 4.6483, std. dev.: 0.0041) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2135, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1779, std. dev.: 0.0009) MultiSource/Benchmarks/sim/sim: 1.10% (5.0168 => 5.0721, std. dev.: 0.0057) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -21.32% (0.4657 => 0.3664, std. dev.: 0.0166) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.64% (0.2670 => 0.2466, std. dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.83% (22.5627 => 21.0227, std. dev.: 0.0111) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.35% (0.3511 => 0.3288, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: -3.73% (0.3623 => 0.3488, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.67% (0.3650 => 0.3516, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -3.64% (0.3601 => 0.3470, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.63% (0.8818 => 0.8498, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-4: -3.57% (0.3646 => 0.3516, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: -3.55% (0.3578 => 0.3451, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -3.55% (0.3663 => 0.3533, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -3.15% (0.3940 => 0.3816, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -3.09% (0.3914 => 0.3793, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -3.04% (0.3789 => 0.3674, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -2.90% (0.4003 => 0.3887, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: -2.30% (0.6250 => 0.6106, std. dev.: 0.0041) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.96% (0.6576 => 0.6447, std. dev.: 0.0012) MultiSource/Applications/lua/lua: -1.17% (3.7467 => 3.7027, std. dev.: 0.0022) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.59% (0.3139 => 0.2932, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.01% (1.3780 => 1.3089, std. dev.: 0.0076) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9622, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -4.03% (2.5089 => 2.4079, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.73% (0.3458 => 0.3329, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.66% (1.9762 => 1.9039, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.18% (20.3410 => 19.8966, std. dev.: 0.0405) SingleSource/Benchmarks/Shootout/lists: -2.18% (6.3560 => 6.2176, std. dev.: 0.0086) SingleSource/Benchmarks/Misc/richards_benchmark: -2.11% (1.1560 => 1.1316, std. dev.: 0.0013) MultiSource/Applications/minisat/minisat: -1.98% (9.3358 => 9.1511, std. dev.: 0.0113) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.92% (6.6320 => 6.5048, std. dev.: 0.0037) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6925, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9950, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.56% (3.9173 => 3.8562, std. dev.: 0.0114) MultiSource/Applications/lua/lua: -1.45% (26.5159 => 26.1316, std. dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.06% (3.8887 => 3.8474, std. dev.: 0.0089) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.83s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun May 20 18:34:35 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 20 May 2012 20:34:35 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120521013435.C76AF2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/733?compare_to=732&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 733, Order: 157173, Start Time: 2012-05-21 00:38:56, End Time: 2012-05-21 01:35:27 To: 732, Order: 157170, Start Time: 2012-05-20 23:16:25, End Time: 2012-05-21 00:12:55 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (55 on baseline) Performance Improvements: 0 (31 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (802 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.09% (2.0176 => 2.2615, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.36% (0.3130 => 0.3329, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.79% (0.2721 => 0.2824, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.14% (3.9660 => 4.0906, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.83% (0.5265 => 0.5414, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.73% (0.6959 => 0.7149, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.72% (0.9199 => 0.9449, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 2.65% (13.8202 => 14.1861, std. dev.: 0.0121) MultiSource/Benchmarks/nbench/nbench: 2.27% (1.0594 => 1.0834, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.18% (0.5637 => 0.5760, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.17% (1.2193 => 1.2458, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/football/football: 2.14% (0.8310 => 0.8488, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.07% (1.3245 => 1.3519, std. dev.: 0.0020) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.04% (0.7710 => 0.7867, std. dev.: 0.0020) MultiSource/Applications/kimwitu++/kc: 2.00% (16.6129 => 16.9450, std. dev.: 0.0036) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.94% (1.1364 => 1.1584, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.86% (0.5577 => 0.5681, std. dev.: 0.0017) MultiSource/Applications/siod/siod: 1.81% (2.1791 => 2.2186, std. dev.: 0.0033) MultiSource/Applications/Burg/burg: 1.80% (1.1061 => 1.1260, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/gs/gs: 1.78% (3.8646 => 3.9335, std. dev.: 0.0107) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.72% (1.4563 => 1.4814, std. dev.: 0.0024) MultiSource/Applications/treecc/treecc: 1.56% (1.9270 => 1.9571, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.56% (13.2842 => 13.4912, std. dev.: 0.0141) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.55% (0.7460 => 0.7576, std. dev.: 0.0011) MultiSource/Applications/hbd/hbd: 1.18% (1.3693 => 1.3854, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.12% (1.3813 => 1.3968, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.06% (1.3819 => 1.3965, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.03% (3.6692 => 3.7070, std. dev.: 0.0027) MultiSource/Applications/sqlite3/sqlite3: 1.03% (16.2614 => 16.4285, std. dev.: 0.0093) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.29% (1.8175 => 2.2590, std. dev.: 0.0410) SingleSource/Benchmarks/Misc/mandel-2: 6.60% (1.2998 => 1.3856, std. dev.: 0.0159) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6754, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8146, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9876, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.69% (1.7688 => 1.8341, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: 3.61% (7.4271 => 7.6955, std. dev.: 0.0014) MultiSource/Benchmarks/nbench/nbench: 3.13% (11.2619 => 11.6142, std. dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4535, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-6: 2.84% (1.9199 => 1.9745, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.82% (8.8259 => 9.0750, std. dev.: 0.0133) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9393, std. dev.: 0.0023) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.49% (7.9275 => 8.1247, std. dev.: 0.0069) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.61% (0.8273 => 0.8406, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 1.47% (3.2729 => 3.3209, std. dev.: 0.0026) MultiSource/Applications/lemon/lemon: 1.41% (1.4298 => 1.4500, std. dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5084, std. dev.: 0.0064) MultiSource/Benchmarks/sim/sim: 1.34% (5.0168 => 5.0839, std. dev.: 0.0056) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.30% (2.0200 => 2.0462, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.22% (1.9433 => 1.9671, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/flops: 1.13% (9.0760 => 9.1784, std. dev.: 0.0009) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -20.10% (0.4657 => 0.3721, std. dev.: 0.0354) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.49% (0.2670 => 0.2470, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.87% (22.5627 => 21.0116, std. dev.: 0.0160) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.52% (0.3511 => 0.3282, std. dev.: 0.0065) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.87% (0.8818 => 0.8477, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: -2.40% (0.6250 => 0.6100, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.64% (0.6576 => 0.6468, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.62% (0.9108 => 0.8960, std. dev.: 0.0002) MultiSource/Applications/lua/lua: -1.14% (3.7467 => 3.7039, std. dev.: 0.0078) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.59% (0.3139 => 0.2932, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.62% (1.3780 => 1.3143, std. dev.: 0.0052) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9621, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -4.06% (2.5089 => 2.4071, std. dev.: 0.0020) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.63% (1.9762 => 1.9044, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/lists: -2.17% (6.3560 => 6.2183, std. dev.: 0.0061) SingleSource/Benchmarks/Misc/richards_benchmark: -2.15% (1.1560 => 1.1312, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: -2.02% (9.3358 => 9.1476, std. dev.: 0.0321) MultiSource/Benchmarks/mafft/pairlocalalign: -1.89% (28.2225 => 27.6889, std. dev.: 0.0024) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.86% (6.6320 => 6.5084, std. dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.76% (20.3410 => 19.9834, std. dev.: 0.0945) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9955, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.50% (3.9173 => 3.8584, std. dev.: 0.0010) MultiSource/Applications/lua/lua: -1.43% (26.5159 => 26.1356, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.02% (3.8887 => 3.8490, std. dev.: 0.0031) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.47s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun May 20 21:40:34 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 20 May 2012 23:40:34 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120521044034.1642A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/734?compare_to=733&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 734, Order: 157174, Start Time: 2012-05-21 03:44:52, End Time: 2012-05-21 04:41:25 To: 733, Order: 157173, Start Time: 2012-05-21 00:38:56, End Time: 2012-05-21 01:35:27 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (50 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (804 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.41% (2.0176 => 2.2679, std. dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.94% (0.3130 => 0.3316, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.06% (3.9660 => 4.0874, std. dev.: 0.0031) MultiSource/Applications/SPASS/SPASS: 2.69% (13.8202 => 14.1922, std. dev.: 0.0103) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.68% (0.5265 => 0.5406, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.67% (0.6959 => 0.7145, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.55% (0.9199 => 0.9434, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 2.29% (0.8310 => 0.8500, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 2.26% (1.0594 => 1.0833, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.22% (0.7710 => 0.7881, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.07% (1.2193 => 1.2446, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.04% (0.5637 => 0.5752, std. dev.: 0.0025) MultiSource/Applications/kimwitu++/kc: 1.96% (16.6129 => 16.9389, std. dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.93% (1.3245 => 1.3501, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.93% (1.1364 => 1.1583, std. dev.: 0.0029) MultiSource/Applications/siod/siod: 1.82% (2.1791 => 2.2187, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.75% (13.2842 => 13.5165, std. dev.: 0.0149) MultiSource/Benchmarks/MallocBench/gs/gs: 1.70% (3.8646 => 3.9303, std. dev.: 0.0088) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.68% (1.4563 => 1.4808, std. dev.: 0.0033) MultiSource/Applications/treecc/treecc: 1.65% (1.9270 => 1.9587, std. dev.: 0.0024) MultiSource/Applications/lambda-0_1_3/lambda: 1.59% (0.7038 => 0.7150, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.42% (0.7460 => 0.7566, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.23% (1.3819 => 1.3989, std. dev.: 0.0012) MultiSource/Applications/hbd/hbd: 1.22% (1.3693 => 1.3860, std. dev.: 0.0024) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.06% (1.3813 => 1.3959, std. dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 23.93% (1.8175 => 2.2524, std. dev.: 0.0481) SingleSource/Benchmarks/Misc/mandel-2: 7.52% (1.2998 => 1.3975, std. dev.: 0.0142) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.89% (1.5824 => 1.6756, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8146, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9878, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.63% (1.7688 => 1.8330, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/salsa20: 3.54% (7.4271 => 7.6898, std. dev.: 0.0073) MultiSource/Benchmarks/nbench/nbench: 3.12% (11.2619 => 11.6130, std. dev.: 0.0022) MultiSource/Applications/hexxagon/hexxagon: 2.98% (12.0921 => 12.4529, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-6: 2.89% (1.9199 => 1.9754, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9392, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.68% (8.8259 => 9.0626, std. dev.: 0.0179) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.58% (7.9275 => 8.1318, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.62% (0.8273 => 0.8407, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 1.48% (3.2729 => 3.3212, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: 1.45% (1.4298 => 1.4506, std. dev.: 0.0009) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5086, std. dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.27% (2.0200 => 2.0457, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.20% (1.9433 => 1.9666, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.11% (9.0760 => 9.1768, std. dev.: 0.0014) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -21.13% (0.4657 => 0.3673, std. dev.: 0.0059) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.15% (0.2670 => 0.2479, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.82% (22.5627 => 21.0232, std. dev.: 0.0182) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.29% (0.3511 => 0.3290, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.90% (0.8818 => 0.8474, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -2.88% (0.3650 => 0.3545, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -2.84% (0.3623 => 0.3520, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -2.73% (0.3663 => 0.3563, std. dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/bigfib: -2.29% (0.6250 => 0.6107, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.78% (0.6576 => 0.6459, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.61% (0.9108 => 0.8961, std. dev.: 0.0003) MultiSource/Applications/lua/lua: -1.17% (3.7467 => 3.7029, std. dev.: 0.0156) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.16% (1.0460 => 0.9502, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.63% (0.3139 => 0.2931, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.85% (1.3780 => 1.3112, std. dev.: 0.0105) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9622, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -3.99% (2.5089 => 2.4089, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: -3.64% (1.9762 => 1.9043, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.59% (0.3458 => 0.3334, std. dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.24% (20.3410 => 19.8848, std. dev.: 0.1128) SingleSource/Benchmarks/Shootout/lists: -2.19% (6.3560 => 6.2171, std. dev.: 0.0093) SingleSource/Benchmarks/Misc/richards_benchmark: -2.16% (1.1560 => 1.1310, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -2.04% (6.6320 => 6.4967, std. dev.: 0.0075) MultiSource/Benchmarks/mafft/pairlocalalign: -1.89% (28.2225 => 27.6902, std. dev.: 0.0028) MultiSource/Applications/minisat/minisat: -1.81% (9.3358 => 9.1665, std. dev.: 0.0108) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9954, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) MultiSource/Applications/lua/lua: -1.40% (26.5159 => 26.1452, std. dev.: 0.0133) SingleSource/Benchmarks/Shootout/heapsort: -1.11% (3.9173 => 3.8740, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.02% (3.8887 => 3.8491, std. dev.: 0.0070) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.73s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon May 21 01:15:10 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 21 May 2012 03:15:10 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120521081510.C3E142A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/735?compare_to=734&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 735, Order: 157175, Start Time: 2012-05-21 07:19:12, End Time: 2012-05-21 08:16:03 To: 734, Order: 157174, Start Time: 2012-05-21 03:44:52, End Time: 2012-05-21 04:41:25 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (54 on baseline) Performance Improvements: 0 (29 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (805 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.21% (2.0176 => 2.2640, std. dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.01% (0.3130 => 0.3318, std. dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.12% (3.9660 => 4.0898, std. dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.83% (0.5265 => 0.5414, std. dev.: 0.0024) MultiSource/Applications/SPASS/SPASS: 2.79% (13.8202 => 14.2058, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.77% (0.6959 => 0.7152, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.73% (0.9199 => 0.9450, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.65% (0.7710 => 0.7914, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.25% (0.5637 => 0.5764, std. dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 2.25% (1.0594 => 1.0832, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/football/football: 2.23% (0.8310 => 0.8495, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.12% (1.2193 => 1.2451, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.08% (1.1364 => 1.1600, std. dev.: 0.0009) MultiSource/Applications/kimwitu++/kc: 2.05% (16.6129 => 16.9542, std. dev.: 0.0129) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.04% (1.3245 => 1.3515, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.92% (0.5577 => 0.5684, std. dev.: 0.0019) MultiSource/Applications/Burg/burg: 1.90% (1.1061 => 1.1271, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.86% (0.7460 => 0.7599, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.82% (1.4563 => 1.4828, std. dev.: 0.0025) MultiSource/Applications/siod/siod: 1.80% (2.1791 => 2.2183, std. dev.: 0.0066) MultiSource/Benchmarks/MallocBench/gs/gs: 1.75% (3.8646 => 3.9321, std. dev.: 0.0036) MultiSource/Applications/treecc/treecc: 1.61% (1.9270 => 1.9581, std. dev.: 0.0032) MultiSource/Applications/lambda-0_1_3/lambda: 1.53% (0.7038 => 0.7146, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.47% (13.2842 => 13.4790, std. dev.: 0.0045) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.32% (1.3819 => 1.4002, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.14% (1.3813 => 1.3971, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.05% (3.6692 => 3.7079, std. dev.: 0.0052) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.83% (1.8175 => 2.2687, std. dev.: 0.0251) SingleSource/Benchmarks/Misc/mandel-2: 8.27% (1.2998 => 1.4073, std. dev.: 0.0078) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6755, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8147, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9878, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.75% (1.7688 => 1.8352, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/salsa20: 3.55% (7.4271 => 7.6910, std. dev.: 0.0075) MultiSource/Benchmarks/nbench/nbench: 3.13% (11.2619 => 11.6145, std. dev.: 0.0015) MultiSource/Applications/hexxagon/hexxagon: 2.98% (12.0921 => 12.4530, std. dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.90% (8.8259 => 9.0818, std. dev.: 0.0054) SingleSource/Benchmarks/Misc/flops-6: 2.81% (1.9199 => 1.9739, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.76% (2.8606 => 2.9396, std. dev.: 0.0047) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.14% (7.9275 => 8.0969, std. dev.: 0.0120) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9603, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ffbench: 1.55% (0.8273 => 0.8401, std. dev.: 0.0015) MultiSource/Applications/siod/siod: 1.45% (3.2729 => 3.3203, std. dev.: 0.0008) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5090, std. dev.: 0.0009) MultiSource/Benchmarks/sim/sim: 1.33% (5.0168 => 5.0834, std. dev.: 0.0051) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.32% (2.0200 => 2.0466, std. dev.: 0.0012) MultiSource/Applications/lemon/lemon: 1.31% (1.4298 => 1.4486, std. dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.21% (1.9433 => 1.9669, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2135, std. dev.: 0.0042) SingleSource/Benchmarks/Misc/flops: 1.13% (9.0760 => 9.1790, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 1.02% (1.2308 => 1.2433, std. dev.: 0.0041) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.72% (0.2670 => 0.2464, std. dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.93% (22.5627 => 20.9995, std. dev.: 0.0152) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.49% (0.3511 => 0.3283, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.72% (0.8818 => 0.8490, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/bigfib: -2.16% (0.6250 => 0.6115, std. dev.: 0.0040) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.72% (0.9108 => 0.8951, std. dev.: 0.0005) MultiSource/Applications/lua/lua: -1.15% (3.7467 => 3.7037, std. dev.: 0.0029) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.16% (1.0460 => 0.9502, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.56% (0.3139 => 0.2933, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2650, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.88% (1.3780 => 1.3107, std. dev.: 0.0056) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9623, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -4.03% (2.5089 => 2.4079, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.59% (1.9762 => 1.9053, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout/lists: -2.24% (6.3560 => 6.2135, std. dev.: 0.0110) SingleSource/Benchmarks/Misc/richards_benchmark: -2.16% (1.1560 => 1.1310, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.98% (20.3410 => 19.9391, std. dev.: 0.0540) MultiSource/Applications/minisat/minisat: -1.90% (9.3358 => 9.1585, std. dev.: 0.0060) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6919, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.87% (6.6320 => 6.5080, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9956, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) MultiSource/Applications/lua/lua: -1.54% (26.5159 => 26.1086, std. dev.: 0.0627) SingleSource/Benchmarks/Shootout/heapsort: -1.44% (3.9173 => 3.8609, std. dev.: 0.0165) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.01% (3.8887 => 3.8495, std. dev.: 0.0106) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.69s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon May 21 05:10:19 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 21 May 2012 07:10:19 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120521121019.309302A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/736?compare_to=735&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 736, Order: 157182, Start Time: 2012-05-21 11:14:25, End Time: 2012-05-21 12:11:13 To: 735, Order: 157175, Start Time: 2012-05-21 07:19:12, End Time: 2012-05-21 08:16:03 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (55 on baseline) Performance Improvements: 0 (28 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (805 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.96% (2.0176 => 2.2791, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.23% (0.3130 => 0.3325, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.33% (3.9660 => 4.0980, std. dev.: 0.0048) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.96% (0.7710 => 0.7938, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.75% (0.5265 => 0.5410, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.67% (0.9199 => 0.9445, std. dev.: 0.0017) MultiSource/Applications/SPASS/SPASS: 2.60% (13.8202 => 14.1800, std. dev.: 0.0163) SingleSource/Benchmarks/Shootout-C++/hash2: 2.56% (0.4328 => 0.4439, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 2.47% (1.0594 => 1.0856, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.29% (0.5637 => 0.5766, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/football/football: 2.29% (0.8310 => 0.8500, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.17% (1.2193 => 1.2457, std. dev.: 0.0017) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.13% (1.1364 => 1.1606, std. dev.: 0.0019) MultiSource/Applications/kimwitu++/kc: 2.08% (16.6129 => 16.9591, std. dev.: 0.0106) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.01% (0.5577 => 0.5689, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.96% (1.3245 => 1.3505, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.94% (1.4563 => 1.4846, std. dev.: 0.0019) MultiSource/Applications/treecc/treecc: 1.89% (1.9270 => 1.9635, std. dev.: 0.0110) MultiSource/Benchmarks/MallocBench/gs/gs: 1.84% (3.8646 => 3.9357, std. dev.: 0.0024) MultiSource/Applications/Burg/burg: 1.82% (1.1061 => 1.1262, std. dev.: 0.0046) MultiSource/Applications/lambda-0_1_3/lambda: 1.78% (0.7038 => 0.7163, std. dev.: 0.0009) MultiSource/Applications/siod/siod: 1.78% (2.1791 => 2.2178, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.73% (13.2842 => 13.5143, std. dev.: 0.0067) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.72% (0.7460 => 0.7588, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.32% (1.3813 => 1.3995, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.26% (1.3819 => 1.3993, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.20% (3.6692 => 3.7132, std. dev.: 0.0050) MultiSource/Applications/JM/lencod/lencod: 1.05% (14.8535 => 15.0089, std. dev.: 0.0039) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.23% (1.8175 => 2.2579, std. dev.: 0.0176) SingleSource/Benchmarks/Misc/mandel-2: 7.40% (1.2998 => 1.3960, std. dev.: 0.0134) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.90% (1.5824 => 1.6757, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8146, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.87% (1.9144 => 1.9884, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.68% (1.7688 => 1.8339, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: 3.62% (7.4271 => 7.6959, std. dev.: 0.0036) MultiSource/Benchmarks/nbench/nbench: 3.18% (11.2619 => 11.6198, std. dev.: 0.0017) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4546, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: 2.95% (1.9199 => 1.9766, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.81% (8.8259 => 9.0739, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.74% (2.8606 => 2.9390, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.55% (7.9275 => 8.1299, std. dev.: 0.0080) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Benchmarks/llubenchmark/llu: 2.14% (3.7731 => 3.8540, std. dev.: 0.0055) SingleSource/Benchmarks/Dhrystone/fldry: 1.59% (1.9290 => 1.9597, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/ffbench: 1.55% (0.8273 => 0.8401, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 1.48% (3.2729 => 3.3215, std. dev.: 0.0028) MultiSource/Applications/lemon/lemon: 1.46% (1.4298 => 1.4507, std. dev.: 0.0030) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5094, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.28% (2.0200 => 2.0458, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.14% (9.0760 => 9.1792, std. dev.: 0.0005) MultiSource/Benchmarks/sim/sim: 1.12% (5.0168 => 5.0731, std. dev.: 0.0060) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.08% (1.9433 => 1.9643, std. dev.: 0.0041) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.19% (0.2670 => 0.2478, std. dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.87% (22.5627 => 21.0120, std. dev.: 0.0030) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.52% (0.3511 => 0.3282, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.70% (0.8818 => 0.8492, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.58% (0.6576 => 0.6472, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.58% (0.9108 => 0.8964, std. dev.: 0.0002) MultiSource/Applications/lua/lua: -1.13% (3.7467 => 3.7042, std. dev.: 0.0022) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.16% (1.0460 => 0.9502, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.53% (0.3139 => 0.2934, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.14% (1.3780 => 1.3072, std. dev.: 0.0020) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9623, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -4.00% (2.5089 => 2.4086, std. dev.: 0.0043) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -3.65% (1.9762 => 1.9040, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/lists: -2.17% (6.3560 => 6.2183, std. dev.: 0.0058) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.13% (20.3410 => 19.9074, std. dev.: 0.0491) SingleSource/Benchmarks/Misc/richards_benchmark: -2.13% (1.1560 => 1.1314, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.92% (6.6320 => 6.5049, std. dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6912, std. dev.: 0.0008) MultiSource/Applications/minisat/minisat: -1.81% (9.3358 => 9.1670, std. dev.: 0.0051) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9955, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.52% (3.9173 => 3.8578, std. dev.: 0.0180) MultiSource/Applications/lua/lua: -1.37% (26.5159 => 26.1537, std. dev.: 0.0227) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.42s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon May 21 06:32:59 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 21 May 2012 08:32:59 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120521133259.C7BA72A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/737?compare_to=736&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 737, Order: 157183, Start Time: 2012-05-21 12:37:16, End Time: 2012-05-21 13:33:54 To: 736, Order: 157182, Start Time: 2012-05-21 11:14:25, End Time: 2012-05-21 12:11:13 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (52 on baseline) Performance Improvements: 0 (38 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (798 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.43% (2.0176 => 2.2683, std. dev.: 0.0140) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.97% (0.3130 => 0.3317, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.79% (0.2721 => 0.2824, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.02% (3.9660 => 4.0857, std. dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.68% (0.5265 => 0.5406, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.60% (0.6959 => 0.7140, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.59% (0.9199 => 0.9437, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 2.30% (0.8310 => 0.8501, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 2.26% (13.8202 => 14.1330, std. dev.: 0.0140) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.25% (0.5637 => 0.5764, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 2.25% (1.0594 => 1.0832, std. dev.: 0.0046) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.10% (0.7710 => 0.7872, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.06% (1.1364 => 1.1598, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.98% (1.2193 => 1.2434, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.97% (1.3245 => 1.3506, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.90% (1.4563 => 1.4840, std. dev.: 0.0011) MultiSource/Applications/kimwitu++/kc: 1.85% (16.6129 => 16.9199, std. dev.: 0.0137) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.64% (1.3813 => 1.4040, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/gs/gs: 1.64% (3.8646 => 3.9280, std. dev.: 0.0027) MultiSource/Applications/Burg/burg: 1.59% (1.1061 => 1.1237, std. dev.: 0.0032) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.59% (13.2842 => 13.4950, std. dev.: 0.0086) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.55% (0.7460 => 0.7576, std. dev.: 0.0007) MultiSource/Applications/siod/siod: 1.51% (2.1791 => 2.2121, std. dev.: 0.0039) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.50% (1.3819 => 1.4026, std. dev.: 0.0020) MultiSource/Applications/treecc/treecc: 1.47% (1.9270 => 1.9554, std. dev.: 0.0016) MultiSource/Applications/hbd/hbd: 1.37% (1.3693 => 1.3880, std. dev.: 0.0048) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.02% (3.6692 => 3.7067, std. dev.: 0.0072) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.18% (1.8175 => 2.2570, std. dev.: 0.0087) SingleSource/Benchmarks/Misc/mandel-2: 7.05% (1.2998 => 1.3915, std. dev.: 0.0142) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6755, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9877, std. dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.69% (1.7688 => 1.8341, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: 3.61% (7.4271 => 7.6953, std. dev.: 0.0032) MultiSource/Benchmarks/nbench/nbench: 3.14% (11.2619 => 11.6150, std. dev.: 0.0028) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4543, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: 2.92% (1.9199 => 1.9760, std. dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.85% (8.8259 => 9.0773, std. dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.76% (2.8606 => 2.9396, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.21% (7.9275 => 8.1030, std. dev.: 0.0178) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.61% (0.8273 => 0.8406, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.49% (1.4298 => 1.4511, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 1.48% (3.2729 => 3.3213, std. dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.43% (8.3908 => 8.5105, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.29% (2.0200 => 2.0460, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.23% (1.9433 => 1.9672, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 1.13% (9.0760 => 9.1784, std. dev.: 0.0012) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.20% (22.5627 => 20.9387, std. dev.: 0.0170) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.00% (0.2670 => 0.2483, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.32% (0.3511 => 0.3289, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-3: -3.48% (0.3623 => 0.3497, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.40% (0.8818 => 0.8518, std. dev.: 0.0015) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.37% (0.3650 => 0.3527, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -3.28% (0.3663 => 0.3543, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -3.26% (0.3646 => 0.3527, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -3.22% (0.3601 => 0.3485, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: -3.21% (0.3578 => 0.3463, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -2.94% (0.3940 => 0.3824, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -2.84% (0.3914 => 0.3803, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -2.80% (0.3789 => 0.3683, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -2.70% (0.4003 => 0.3895, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.11% (0.6576 => 0.6437, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.57% (0.9108 => 0.8965, std. dev.: 0.0030) MultiSource/Applications/lua/lua: -1.36% (3.7467 => 3.6956, std. dev.: 0.0077) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.56% (0.3139 => 0.2933, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2650, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.70% (1.3780 => 1.3133, std. dev.: 0.0044) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9624, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.99% (2.5089 => 2.4089, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.73% (0.3458 => 0.3329, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -3.61% (1.9762 => 1.9048, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -2.25% (6.3560 => 6.2131, std. dev.: 0.0098) SingleSource/Benchmarks/Misc/richards_benchmark: -2.12% (1.1560 => 1.1315, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.00% (20.3410 => 19.9336, std. dev.: 0.0242) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.92% (6.6320 => 6.5045, std. dev.: 0.0069) MultiSource/Applications/minisat/minisat: -1.89% (9.3358 => 9.1589, std. dev.: 0.0121) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6925, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9956, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) MultiSource/Applications/lua/lua: -1.23% (26.5159 => 26.1890, std. dev.: 0.0112) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.09% (3.8887 => 3.8465, std. dev.: 0.0029) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.20s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon May 21 07:55:32 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 21 May 2012 09:55:32 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120521145532.441112A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/738?compare_to=737&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 738, Order: 157184, Start Time: 2012-05-21 13:59:47, End Time: 2012-05-21 14:56:26 To: 737, Order: 157183, Start Time: 2012-05-21 12:37:16, End Time: 2012-05-21 13:33:54 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (51 on baseline) Performance Improvements: 0 (41 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (796 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.42% (2.0176 => 2.2681, std. dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.01% (0.3130 => 0.3318, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.95% (3.9660 => 4.0828, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.56% (0.5265 => 0.5400, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.49% (0.9199 => 0.9428, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.47% (0.6959 => 0.7131, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/football/football: 2.27% (0.8310 => 0.8499, std. dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.25% (0.5637 => 0.5764, std. dev.: 0.0015) MultiSource/Benchmarks/nbench/nbench: 2.24% (1.0594 => 1.0831, std. dev.: 0.0036) MultiSource/Applications/SPASS/SPASS: 2.20% (13.8202 => 14.1244, std. dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.06% (0.5577 => 0.5692, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.98% (1.2193 => 1.2434, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.95% (1.1364 => 1.1586, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.90% (1.3245 => 1.3496, std. dev.: 0.0023) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.83% (0.7710 => 0.7851, std. dev.: 0.0030) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.79% (1.4563 => 1.4824, std. dev.: 0.0017) MultiSource/Applications/kimwitu++/kc: 1.68% (16.6129 => 16.8918, std. dev.: 0.0087) MultiSource/Benchmarks/MallocBench/gs/gs: 1.61% (3.8646 => 3.9269, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.59% (13.2842 => 13.4953, std. dev.: 0.0194) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.53% (1.3813 => 1.4024, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.50% (1.3819 => 1.4026, std. dev.: 0.0011) MultiSource/Applications/siod/siod: 1.45% (2.1791 => 2.2108, std. dev.: 0.0048) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.43% (0.7460 => 0.7567, std. dev.: 0.0011) MultiSource/Applications/treecc/treecc: 1.36% (1.9270 => 1.9533, std. dev.: 0.0025) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 23.94% (1.8175 => 2.2526, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/mandel-2: 7.70% (1.2998 => 1.3999, std. dev.: 0.0108) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.89% (1.5824 => 1.6756, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8146, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9879, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.65% (1.7688 => 1.8333, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: 3.60% (7.4271 => 7.6945, std. dev.: 0.0106) MultiSource/Benchmarks/nbench/nbench: 3.13% (11.2619 => 11.6148, std. dev.: 0.0031) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4553, std. dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.91% (8.8259 => 9.0831, std. dev.: 0.0102) SingleSource/Benchmarks/Misc/flops-6: 2.88% (1.9199 => 1.9751, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9392, std. dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.55% (7.9275 => 8.1299, std. dev.: 0.0084) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.56% (0.8273 => 0.8402, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 1.55% (3.2729 => 3.3235, std. dev.: 0.0107) MultiSource/Applications/lemon/lemon: 1.45% (1.4298 => 1.4505, std. dev.: 0.0016) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5093, std. dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.27% (2.0200 => 2.0457, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.20% (1.9433 => 1.9666, std. dev.: 0.0010) SingleSource/Benchmarks/McGill/chomp: 1.18% (1.2308 => 1.2453, std. dev.: 0.0044) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 1.10% (9.0760 => 9.1761, std. dev.: 0.0018) MultiSource/Benchmarks/sim/sim: 1.01% (5.0168 => 5.0676, std. dev.: 0.0105) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -14.88% (0.4657 => 0.3964, std. dev.: 0.0254) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.18% (22.5627 => 20.9423, std. dev.: 0.0175) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.93% (0.2670 => 0.2485, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.38% (0.3511 => 0.3287, std. dev.: 0.0062) SingleSource/UnitTests/ObjC/exceptions-3: -3.51% (0.3623 => 0.3496, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.50% (0.8818 => 0.8509, std. dev.: 0.0021) SingleSource/UnitTests/ObjC/exceptions-2: -3.33% (0.3601 => 0.3481, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.32% (0.3650 => 0.3529, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/synchronized: -3.30% (0.3663 => 0.3542, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -3.24% (0.3578 => 0.3462, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -3.21% (0.3646 => 0.3529, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -3.05% (0.3940 => 0.3820, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -2.90% (0.3789 => 0.3679, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions: -2.89% (0.3914 => 0.3801, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -2.67% (0.4003 => 0.3896, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: -2.26% (0.6250 => 0.6109, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.14% (0.6576 => 0.6435, std. dev.: 0.0028) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.56% (0.9108 => 0.8966, std. dev.: 0.0004) MultiSource/Applications/lua/lua: -1.25% (3.7467 => 3.6999, std. dev.: 0.0113) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.59% (0.3139 => 0.2932, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.05% (1.3780 => 1.3084, std. dev.: 0.0074) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9623, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.96% (2.5089 => 2.4095, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.73% (0.3458 => 0.3329, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.61% (1.9762 => 1.9049, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -2.35% (6.3560 => 6.2068, std. dev.: 0.0178) SingleSource/Benchmarks/Misc/richards_benchmark: -2.13% (1.1560 => 1.1314, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -2.07% (6.6320 => 6.4950, std. dev.: 0.0064) MultiSource/Applications/minisat/minisat: -1.92% (9.3358 => 9.1562, std. dev.: 0.0170) MultiSource/Benchmarks/mafft/pairlocalalign: -1.90% (28.2225 => 27.6871, std. dev.: 0.0037) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.75% (20.3410 => 19.9850, std. dev.: 0.0474) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9953, std. dev.: 0.0001) MultiSource/Applications/lua/lua: -1.58% (26.5159 => 26.0967, std. dev.: 0.0183) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.35% (3.9173 => 3.8644, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.05% (3.8887 => 3.8480, std. dev.: 0.0069) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.39s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon May 21 09:18:05 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 21 May 2012 11:18:05 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120521161805.176D72A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/739?compare_to=738&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 739, Order: 157186, Start Time: 2012-05-21 15:22:21, End Time: 2012-05-21 16:18:59 To: 738, Order: 157184, Start Time: 2012-05-21 13:59:47, End Time: 2012-05-21 14:56:26 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (53 on baseline) Performance Improvements: 0 (41 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (794 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.44% (2.0176 => 2.2686, std. dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.10% (0.3130 => 0.3321, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.68% (0.2721 => 0.2821, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.94% (3.9660 => 4.0826, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.51% (0.5265 => 0.5397, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.46% (0.9199 => 0.9425, std. dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.43% (0.6959 => 0.7128, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/football/football: 2.33% (0.8310 => 0.8504, std. dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 2.33% (1.0594 => 1.0841, std. dev.: 0.0021) MultiSource/Applications/SPASS/SPASS: 2.30% (13.8202 => 14.1381, std. dev.: 0.0081) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.20% (0.5637 => 0.5761, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.15% (0.7710 => 0.7876, std. dev.: 0.0025) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.02% (1.1364 => 1.1593, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.98% (1.2193 => 1.2435, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.94% (1.3245 => 1.3502, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.86% (0.5577 => 0.5681, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.84% (1.4563 => 1.4831, std. dev.: 0.0012) MultiSource/Applications/kimwitu++/kc: 1.73% (16.6129 => 16.9009, std. dev.: 0.0153) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.68% (1.3819 => 1.4051, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 1.66% (3.8646 => 3.9286, std. dev.: 0.0045) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.64% (13.2842 => 13.5015, std. dev.: 0.0027) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.60% (0.7460 => 0.7579, std. dev.: 0.0012) MultiSource/Applications/siod/siod: 1.59% (2.1791 => 2.2137, std. dev.: 0.0055) MultiSource/Applications/Burg/burg: 1.56% (1.1061 => 1.1233, std. dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: 1.53% (0.7038 => 0.7146, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.48% (1.3813 => 1.4018, std. dev.: 0.0008) MultiSource/Applications/treecc/treecc: 1.44% (1.9270 => 1.9548, std. dev.: 0.0013) MultiSource/Applications/hbd/hbd: 1.31% (1.3693 => 1.3873, std. dev.: 0.0045) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 23.80% (1.8175 => 2.2500, std. dev.: 0.0089) SingleSource/Benchmarks/Misc/mandel-2: 7.77% (1.2998 => 1.4008, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6754, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9875, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.65% (1.7688 => 1.8333, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/salsa20: 3.55% (7.4271 => 7.6907, std. dev.: 0.0027) MultiSource/Benchmarks/nbench/nbench: 3.16% (11.2619 => 11.6181, std. dev.: 0.0018) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4538, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: 2.78% (1.9199 => 1.9733, std. dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9394, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.72% (8.8259 => 9.0662, std. dev.: 0.0100) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.24% (7.9275 => 8.1048, std. dev.: 0.0084) SingleSource/Benchmarks/Dhrystone/fldry: 1.57% (1.9290 => 1.9592, std. dev.: 0.0012) MultiSource/Applications/lemon/lemon: 1.51% (1.4298 => 1.4514, std. dev.: 0.0047) MultiSource/Applications/siod/siod: 1.45% (3.2729 => 3.3203, std. dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5098, std. dev.: 0.0017) SingleSource/Benchmarks/McGill/chomp: 1.36% (1.2308 => 1.2476, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.29% (2.0200 => 2.0460, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.18% (1.9433 => 1.9662, std. dev.: 0.0045) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 1.13% (9.0760 => 9.1787, std. dev.: 0.0013) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -17.03% (0.4657 => 0.3864, std. dev.: 0.0252) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.11% (22.5627 => 20.9578, std. dev.: 0.0142) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.00% (0.2670 => 0.2483, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.32% (0.3511 => 0.3289, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.42% (0.8818 => 0.8516, std. dev.: 0.0020) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.40% (0.3650 => 0.3526, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -3.39% (0.3623 => 0.3500, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-2: -3.33% (0.3601 => 0.3481, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/synchronized: -3.25% (0.3663 => 0.3544, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -3.24% (0.3646 => 0.3528, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -3.19% (0.3578 => 0.3464, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -3.02% (0.3940 => 0.3821, std. dev.: 0.0030) SingleSource/UnitTests/ObjC/exceptions: -2.86% (0.3914 => 0.3802, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -2.85% (0.3789 => 0.3681, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: -2.70% (0.4003 => 0.3895, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.24% (0.6576 => 0.6429, std. dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/bigfib: -2.18% (0.6250 => 0.6114, std. dev.: 0.0045) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.52% (0.9108 => 0.8970, std. dev.: 0.0003) MultiSource/Applications/lua/lua: -1.29% (3.7467 => 3.6983, std. dev.: 0.0027) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.16% (1.0460 => 0.9502, std. dev.: 0.0008) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.66% (0.3139 => 0.2930, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std. dev.: 0.0004) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9623, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.59% (1.3780 => 1.3148, std. dev.: 0.0046) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -3.97% (2.5089 => 2.4094, std. dev.: 0.0027) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.73% (0.3458 => 0.3329, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.68% (1.9762 => 1.9035, std. dev.: 0.0039) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.24% (20.3410 => 19.8851, std. dev.: 0.0311) SingleSource/Benchmarks/Misc/richards_benchmark: -2.12% (1.1560 => 1.1315, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -1.94% (6.3560 => 6.2325, std. dev.: 0.0093) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.90% (6.6320 => 6.5063, std. dev.: 0.0045) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6911, std. dev.: 0.0015) MultiSource/Applications/minisat/minisat: -1.85% (9.3358 => 9.1628, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9951, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.44% (3.9173 => 3.8608, std. dev.: 0.0169) MultiSource/Applications/lua/lua: -1.35% (26.5159 => 26.1588, std. dev.: 0.0250) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.20% (3.8887 => 3.8420, std. dev.: 0.0079) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.32s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon May 21 11:24:28 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 21 May 2012 13:24:28 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120521182428.B11752A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/740?compare_to=739&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 740, Order: 157191, Start Time: 2012-05-21 17:28:45, End Time: 2012-05-21 18:25:23 To: 739, Order: 157186, Start Time: 2012-05-21 15:22:21, End Time: 2012-05-21 16:18:59 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (53 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (796 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.45% (2.0176 => 2.2688, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.91% (0.3130 => 0.3315, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.75% (0.2721 => 0.2823, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.91% (3.9660 => 4.0813, std. dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.47% (0.6959 => 0.7131, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.46% (0.9199 => 0.9425, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 2.27% (1.0594 => 1.0834, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/football/football: 2.24% (0.8310 => 0.8496, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 2.21% (13.8202 => 14.1254, std. dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.02% (0.5637 => 0.5751, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.01% (1.1364 => 1.1592, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.94% (1.2193 => 1.2429, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.86% (1.3245 => 1.3491, std. dev.: 0.0017) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.82% (0.7710 => 0.7850, std. dev.: 0.0036) MultiSource/Applications/kimwitu++/kc: 1.71% (16.6129 => 16.8978, std. dev.: 0.0046) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.71% (1.4563 => 1.4812, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.61% (13.2842 => 13.4977, std. dev.: 0.0157) MultiSource/Applications/siod/siod: 1.57% (2.1791 => 2.2133, std. dev.: 0.0023) MultiSource/Benchmarks/MallocBench/gs/gs: 1.56% (3.8646 => 3.9250, std. dev.: 0.0052) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.45% (1.3819 => 1.4020, std. dev.: 0.0020) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.45% (1.3813 => 1.4013, std. dev.: 0.0019) MultiSource/Applications/Burg/burg: 1.44% (1.1061 => 1.1220, std. dev.: 0.0051) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.39% (0.7460 => 0.7564, std. dev.: 0.0011) MultiSource/Applications/treecc/treecc: 1.34% (1.9270 => 1.9529, std. dev.: 0.0020) MultiSource/Applications/hbd/hbd: 1.27% (1.3693 => 1.3867, std. dev.: 0.0039) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.01% (3.6692 => 3.7062, std. dev.: 0.0025) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.21% (1.8175 => 2.2576, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/mandel-2: 8.02% (1.2998 => 1.4040, std. dev.: 0.0082) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6754, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 3.78% (1.9144 => 1.9868, std. dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.69% (1.7688 => 1.8341, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: 3.61% (7.4271 => 7.6951, std. dev.: 0.0067) MultiSource/Benchmarks/nbench/nbench: 3.13% (11.2619 => 11.6139, std. dev.: 0.0053) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4548, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-6: 2.91% (1.9199 => 1.9757, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.86% (8.8259 => 9.0786, std. dev.: 0.0219) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9394, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.67% (7.9275 => 8.1392, std. dev.: 0.0091) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/ffbench: 1.61% (0.8273 => 0.8406, std. dev.: 0.0014) MultiSource/Applications/siod/siod: 1.49% (3.2729 => 3.3216, std. dev.: 0.0091) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5086, std. dev.: 0.0012) MultiSource/Applications/lemon/lemon: 1.36% (1.4298 => 1.4493, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.28% (2.0200 => 2.0459, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.18% (1.9433 => 1.9662, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 1.13% (9.0760 => 9.1786, std. dev.: 0.0008) MultiSource/Benchmarks/sim/sim: 1.12% (5.0168 => 5.0732, std. dev.: 0.0101) SingleSource/Benchmarks/McGill/chomp: 1.07% (1.2308 => 1.2440, std. dev.: 0.0031) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.13% (22.5627 => 20.9542, std. dev.: 0.0133) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.97% (0.2670 => 0.2484, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.07% (0.3511 => 0.3298, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.47% (0.8818 => 0.8512, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -3.39% (0.3623 => 0.3500, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -3.30% (0.3601 => 0.3482, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -3.29% (0.3646 => 0.3526, std. dev.: 0.0034) SingleSource/UnitTests/ObjC/synchronized: -3.28% (0.3663 => 0.3543, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: -3.27% (0.3578 => 0.3461, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.18% (0.3650 => 0.3534, std. dev.: 0.0022) SingleSource/UnitTests/ObjC/property: -2.99% (0.3940 => 0.3822, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -2.85% (0.3789 => 0.3681, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -2.73% (0.3914 => 0.3807, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -2.67% (0.4003 => 0.3896, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: -2.26% (0.6250 => 0.6109, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.20% (0.6576 => 0.6431, std. dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.57% (0.9108 => 0.8965, std. dev.: 0.0002) MultiSource/Applications/lua/lua: -1.35% (3.7467 => 3.6961, std. dev.: 0.0095) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.16% (1.0460 => 0.9502, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.56% (0.3139 => 0.2933, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2650, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.87% (1.3780 => 1.3109, std. dev.: 0.0137) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9624, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -3.93% (2.5089 => 2.4102, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.65% (1.9762 => 1.9040, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout/lists: -2.20% (6.3560 => 6.2159, std. dev.: 0.0057) SingleSource/Benchmarks/Misc/richards_benchmark: -2.15% (1.1560 => 1.1311, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.01% (20.3410 => 19.9321, std. dev.: 0.0628) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.91% (6.6320 => 6.5054, std. dev.: 0.0034) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6906, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: -1.86% (9.3358 => 9.1623, std. dev.: 0.0092) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3446, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9955, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/heapsort: -1.45% (3.9173 => 3.8605, std. dev.: 0.0069) MultiSource/Applications/lua/lua: -1.26% (26.5159 => 26.1819, std. dev.: 0.0072) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.27s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon May 21 12:46:56 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 21 May 2012 14:46:56 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120521194656.08D0C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/741?compare_to=740&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 741, Order: 157200, Start Time: 2012-05-21 18:51:17, End Time: 2012-05-21 19:47:50 To: 740, Order: 157191, Start Time: 2012-05-21 17:28:45, End Time: 2012-05-21 18:25:23 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (54 on baseline) Performance Improvements: 0 (41 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 891 (793 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 3.03% (2.2576 => 2.3261, std. dev.: 0.0237) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.40% (2.0176 => 2.2880, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.29% (0.3130 => 0.3327, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.82% (0.2721 => 0.2825, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.08% (3.9660 => 4.0883, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.73% (0.6959 => 0.7149, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.60% (0.9199 => 0.9438, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.55% (0.5265 => 0.5399, std. dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 2.47% (13.8202 => 14.1621, std. dev.: 0.0091) MultiSource/Benchmarks/Prolangs-C/football/football: 2.42% (0.8310 => 0.8511, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 2.31% (0.4328 => 0.4428, std. dev.: 0.0034) MultiSource/Benchmarks/nbench/nbench: 2.30% (1.0594 => 1.0838, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.21% (1.1364 => 1.1615, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.10% (1.2193 => 1.2449, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.06% (0.5637 => 0.5753, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.99% (1.3245 => 1.3509, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.95% (13.2842 => 13.5437, std. dev.: 0.0077) MultiSource/Applications/kimwitu++/kc: 1.91% (16.6129 => 16.9295, std. dev.: 0.0130) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.85% (0.5577 => 0.5680, std. dev.: 0.0021) MultiSource/Benchmarks/MallocBench/gs/gs: 1.84% (3.8646 => 3.9358, std. dev.: 0.0049) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.83% (1.4563 => 1.4830, std. dev.: 0.0014) MultiSource/Applications/Burg/burg: 1.74% (1.1061 => 1.1253, std. dev.: 0.0039) MultiSource/Applications/siod/siod: 1.72% (2.1791 => 2.2166, std. dev.: 0.0068) MultiSource/Applications/treecc/treecc: 1.45% (1.9270 => 1.9549, std. dev.: 0.0022) MultiSource/Applications/lambda-0_1_3/lambda: 1.44% (0.7038 => 0.7139, std. dev.: 0.0019) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.39% (0.7710 => 0.7817, std. dev.: 0.0023) MultiSource/Applications/hbd/hbd: 1.35% (1.3693 => 1.3878, std. dev.: 0.0069) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.35% (1.3819 => 1.4005, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.34% (0.7460 => 0.7560, std. dev.: 0.0018) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.30% (1.3813 => 1.3993, std. dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 27.98% (1.8175 => 2.3261, std. dev.: 0.0237) SingleSource/Benchmarks/Misc/mandel-2: 8.36% (1.2998 => 1.4085, std. dev.: 0.0108) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.90% (1.5824 => 1.6757, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8146, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.86% (1.9144 => 1.9883, std. dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.71% (1.7688 => 1.8344, std. dev.: 0.0168) SingleSource/Benchmarks/Misc/salsa20: 3.59% (7.4271 => 7.6941, std. dev.: 0.0041) MultiSource/Benchmarks/nbench/nbench: 3.12% (11.2619 => 11.6137, std. dev.: 0.0042) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4544, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-6: 2.83% (1.9199 => 1.9742, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9393, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.36% (7.9275 => 8.1143, std. dev.: 0.0122) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.55% (0.8273 => 0.8401, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 1.48% (3.2729 => 3.3212, std. dev.: 0.0008) MultiSource/Applications/lemon/lemon: 1.48% (1.4298 => 1.4509, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5089, std. dev.: 0.0149) MultiSource/Benchmarks/sim/sim: 1.30% (5.0168 => 5.0822, std. dev.: 0.0056) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.26% (2.0200 => 2.0455, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.22% (1.9433 => 1.9670, std. dev.: 0.0087) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.12% (1.9290 => 1.9507, std. dev.: 0.0044) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1775, std. dev.: 0.0016) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -16.21% (0.4657 => 0.3902, std. dev.: 0.0275) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.07% (22.5627 => 20.9676, std. dev.: 0.0133) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.55% (0.2670 => 0.2495, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.01% (0.3511 => 0.3300, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -4.20% (0.3623 => 0.3471, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -4.08% (0.3601 => 0.3454, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.08% (0.3650 => 0.3501, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -4.04% (0.3663 => 0.3515, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -3.95% (0.3646 => 0.3502, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -3.94% (0.3578 => 0.3437, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -3.65% (0.3940 => 0.3796, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.64% (0.8818 => 0.8497, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -3.59% (0.3789 => 0.3653, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: -3.47% (0.3914 => 0.3778, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -3.25% (0.4003 => 0.3873, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.55% (0.6576 => 0.6408, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: -2.14% (0.6250 => 0.6116, std. dev.: 0.0048) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.61% (0.9108 => 0.8961, std. dev.: 0.0002) MultiSource/Applications/lua/lua: -1.22% (3.7467 => 3.7010, std. dev.: 0.0027) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.16% (1.0460 => 0.9502, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.59% (0.3139 => 0.2932, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.65% (1.3780 => 1.3139, std. dev.: 0.0049) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9623, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -4.00% (2.5089 => 2.4085, std. dev.: 0.0014) MultiSource/Benchmarks/Olden/bh/bh: -3.62% (1.9762 => 1.9047, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.59% (0.3458 => 0.3334, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -2.15% (1.1560 => 1.1311, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -2.11% (6.3560 => 6.2217, std. dev.: 0.0058) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.07% (20.3410 => 19.9190, std. dev.: 0.0812) MultiSource/Applications/minisat/minisat: -2.01% (9.3358 => 9.1479, std. dev.: 0.0299) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6912, std. dev.: 0.0018) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.84% (6.6320 => 6.5099, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3444, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9954, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) MultiSource/Applications/lua/lua: -1.45% (26.5159 => 26.1320, std. dev.: 0.0222) SingleSource/Benchmarks/Shootout/heapsort: -1.41% (3.9173 => 3.8621, std. dev.: 0.0196) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.01% (3.8887 => 3.8496, std. dev.: 0.0023) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.44s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon May 21 14:10:15 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 21 May 2012 16:10:15 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120521211015.5A2562A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/742?compare_to=741&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 742, Order: 157204, Start Time: 2012-05-21 20:14:18, End Time: 2012-05-21 21:11:09 To: 741, Order: 157200, Start Time: 2012-05-21 18:51:17, End Time: 2012-05-21 19:47:50 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (53 on baseline) Performance Improvements: 1 (39 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 891 (796 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/fbench: -3.06% (2.3261 => 2.2549, std. dev.: 0.0040) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.31% (2.0176 => 2.2861, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.33% (0.3130 => 0.3328, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.82% (0.2721 => 0.2825, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.05% (3.9660 => 4.0869, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.61% (0.9199 => 0.9439, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.58% (0.5265 => 0.5401, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 2.56% (1.0594 => 1.0865, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.50% (0.6959 => 0.7133, std. dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 2.45% (13.8202 => 14.1582, std. dev.: 0.0108) MultiSource/Benchmarks/Prolangs-C/football/football: 2.35% (0.8310 => 0.8505, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.07% (1.2193 => 1.2445, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.06% (1.1364 => 1.1598, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.04% (0.5637 => 0.5752, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.92% (1.3245 => 1.3499, std. dev.: 0.0012) MultiSource/Applications/kimwitu++/kc: 1.91% (16.6129 => 16.9304, std. dev.: 0.0158) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.89% (13.2842 => 13.5354, std. dev.: 0.0039) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.79% (1.4563 => 1.4823, std. dev.: 0.0068) MultiSource/Benchmarks/MallocBench/gs/gs: 1.75% (3.8646 => 3.9321, std. dev.: 0.0039) MultiSource/Applications/siod/siod: 1.68% (2.1791 => 2.2157, std. dev.: 0.0019) MultiSource/Applications/Burg/burg: 1.63% (1.1061 => 1.1241, std. dev.: 0.0030) MultiSource/Applications/treecc/treecc: 1.55% (1.9270 => 1.9569, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.52% (0.7710 => 0.7827, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.41% (0.7460 => 0.7565, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.33% (1.3819 => 1.4003, std. dev.: 0.0018) MultiSource/Applications/hbd/hbd: 1.31% (1.3693 => 1.3873, std. dev.: 0.0040) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.20% (1.3813 => 1.3979, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.05% (3.6692 => 3.7077, std. dev.: 0.0019) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.07% (1.8175 => 2.2549, std. dev.: 0.0040) SingleSource/Benchmarks/Misc/mandel-2: 8.11% (1.2998 => 1.4052, std. dev.: 0.0042) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6754, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8147, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9875, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.68% (1.7688 => 1.8339, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/salsa20: 3.60% (7.4271 => 7.6942, std. dev.: 0.0081) MultiSource/Benchmarks/nbench/nbench: 3.16% (11.2619 => 11.6175, std. dev.: 0.0023) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4551, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-6: 2.90% (1.9199 => 1.9755, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.88% (8.8259 => 9.0805, std. dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9392, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.58% (7.9275 => 8.1317, std. dev.: 0.0095) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.58% (0.8273 => 0.8404, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 1.48% (3.2729 => 3.3214, std. dev.: 0.0028) MultiSource/Applications/lemon/lemon: 1.45% (1.4298 => 1.4505, std. dev.: 0.0011) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5081, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.29% (2.0200 => 2.0461, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.23% (1.9433 => 1.9672, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1780, std. dev.: 0.0012) MultiSource/Benchmarks/sim/sim: 1.08% (5.0168 => 5.0710, std. dev.: 0.0085) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.02% (22.5627 => 20.9777, std. dev.: 0.0110) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.52% (0.2670 => 0.2496, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.95% (0.3511 => 0.3302, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-3: -4.25% (0.3623 => 0.3469, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.25% (0.3650 => 0.3495, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-2: -4.14% (0.3601 => 0.3452, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -4.10% (0.3663 => 0.3513, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -4.06% (0.3646 => 0.3498, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -4.02% (0.3578 => 0.3434, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.80% (0.8818 => 0.8483, std. dev.: 0.0036) SingleSource/UnitTests/ObjC/property: -3.78% (0.3940 => 0.3791, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -3.63% (0.3914 => 0.3772, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -3.62% (0.3789 => 0.3652, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -3.45% (0.4003 => 0.3865, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.51% (0.6576 => 0.6411, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: -2.27% (0.6250 => 0.6108, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.69% (0.9108 => 0.8954, std. dev.: 0.0006) MultiSource/Applications/lua/lua: -1.18% (3.7467 => 3.7025, std. dev.: 0.0017) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.53% (0.3139 => 0.2934, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9623, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.29% (1.3780 => 1.3189, std. dev.: 0.0116) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -4.00% (2.5089 => 2.4085, std. dev.: 0.0015) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.73% (0.3458 => 0.3329, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.67% (1.9762 => 1.9037, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: -2.14% (1.1560 => 1.1313, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -2.03% (6.3560 => 6.2268, std. dev.: 0.0111) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.96% (6.6320 => 6.5017, std. dev.: 0.0083) MultiSource/Applications/minisat/minisat: -1.94% (9.3358 => 9.1549, std. dev.: 0.0070) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6913, std. dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.70% (20.3410 => 19.9954, std. dev.: 0.0481) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3444, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9953, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) MultiSource/Applications/lua/lua: -1.44% (26.5159 => 26.1329, std. dev.: 0.0142) SingleSource/Benchmarks/Shootout/heapsort: -1.36% (3.9173 => 3.8640, std. dev.: 0.0024) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.45s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon May 21 15:32:41 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 21 May 2012 17:32:41 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120521223241.77A022A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/743?compare_to=742&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 743, Order: 157207, Start Time: 2012-05-21 21:37:01, End Time: 2012-05-21 22:33:35 To: 742, Order: 157204, Start Time: 2012-05-21 20:14:18, End Time: 2012-05-21 21:11:09 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (54 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 891 (795 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 3.88% (2.2549 => 2.3423, std. dev.: 0.0154) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.36% (2.0176 => 2.2872, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.20% (0.3130 => 0.3324, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.79% (0.2721 => 0.2824, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.12% (3.9660 => 4.0898, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.62% (0.5265 => 0.5403, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.55% (0.9199 => 0.9434, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.51% (0.6959 => 0.7134, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 2.42% (1.0594 => 1.0850, std. dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 2.37% (13.8202 => 14.1476, std. dev.: 0.0116) MultiSource/Benchmarks/Prolangs-C/football/football: 2.30% (0.8310 => 0.8501, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.27% (1.1364 => 1.1622, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.17% (1.2193 => 1.2457, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.06% (0.5637 => 0.5753, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.05% (0.7710 => 0.7868, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.02% (1.3245 => 1.3513, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.01% (1.4563 => 1.4855, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.87% (13.2842 => 13.5320, std. dev.: 0.0160) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.86% (0.5577 => 0.5681, std. dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 1.80% (16.6129 => 16.9120, std. dev.: 0.0262) MultiSource/Benchmarks/MallocBench/gs/gs: 1.75% (3.8646 => 3.9323, std. dev.: 0.0066) MultiSource/Applications/siod/siod: 1.69% (2.1791 => 2.2160, std. dev.: 0.0014) MultiSource/Applications/Burg/burg: 1.60% (1.1061 => 1.1238, std. dev.: 0.0036) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.58% (0.7460 => 0.7578, std. dev.: 0.0035) MultiSource/Applications/treecc/treecc: 1.55% (1.9270 => 1.9569, std. dev.: 0.0032) MultiSource/Applications/lambda-0_1_3/lambda: 1.55% (0.7038 => 0.7147, std. dev.: 0.0005) MultiSource/Applications/hbd/hbd: 1.48% (1.3693 => 1.3895, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.41% (1.3819 => 1.4014, std. dev.: 0.0027) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.35% (1.3813 => 1.4000, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.25% (3.6692 => 3.7151, std. dev.: 0.0010) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 28.87% (1.8175 => 2.3423, std. dev.: 0.0154) SingleSource/Benchmarks/Misc/mandel-2: 7.69% (1.2998 => 1.3997, std. dev.: 0.0077) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7298, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.90% (1.5824 => 1.6758, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9878, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 3.79% (7.4271 => 7.7084, std. dev.: 0.0016) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.67% (1.7688 => 1.8338, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 3.15% (11.2619 => 11.6169, std. dev.: 0.0032) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4540, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.89% (8.8259 => 9.0809, std. dev.: 0.0242) SingleSource/Benchmarks/Misc/flops-6: 2.89% (1.9199 => 1.9753, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9393, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.41% (7.9275 => 8.1185, std. dev.: 0.0130) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.56% (0.8273 => 0.8402, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 1.48% (3.2729 => 3.3212, std. dev.: 0.0070) MultiSource/Applications/lemon/lemon: 1.45% (1.4298 => 1.4505, std. dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5087, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.29% (2.0200 => 2.0460, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0035) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.17% (1.9433 => 1.9660, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1779, std. dev.: 0.0006) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -19.84% (0.4657 => 0.3733, std. dev.: 0.0018) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.09% (22.5627 => 20.9641, std. dev.: 0.0050) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.52% (0.2670 => 0.2496, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.98% (0.3511 => 0.3301, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.63% (0.8818 => 0.8498, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -3.56% (0.3623 => 0.3494, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.53% (0.3650 => 0.3521, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -3.50% (0.3601 => 0.3475, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/synchronized: -3.44% (0.3663 => 0.3537, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -3.38% (0.3578 => 0.3457, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -3.29% (0.3646 => 0.3526, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/property: -3.22% (0.3940 => 0.3813, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -2.99% (0.3914 => 0.3797, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -2.77% (0.3789 => 0.3684, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: -2.21% (0.6250 => 0.6112, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.10% (0.6576 => 0.6438, std. dev.: 0.0028) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.58% (0.9108 => 0.8964, std. dev.: 0.0003) MultiSource/Applications/lua/lua: -1.19% (3.7467 => 3.7023, std. dev.: 0.0104) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.63% (0.3139 => 0.2931, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2640, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.81% (1.3780 => 1.3117, std. dev.: 0.0055) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9622, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -4.09% (2.5089 => 2.4062, std. dev.: 0.0024) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.63% (1.9762 => 1.9044, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/richards_benchmark: -2.14% (1.1560 => 1.1313, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: -1.98% (9.3358 => 9.1512, std. dev.: 0.0316) SingleSource/Benchmarks/Shootout/lists: -1.94% (6.3560 => 6.2328, std. dev.: 0.0043) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.92% (6.6320 => 6.5045, std. dev.: 0.0030) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.90% (20.3410 => 19.9537, std. dev.: 0.0571) MultiSource/Benchmarks/mafft/pairlocalalign: -1.89% (28.2225 => 27.6899, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3446, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9955, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.56% (0.9692 => 0.9541, std. dev.: 0.0000) MultiSource/Applications/lua/lua: -1.46% (26.5159 => 26.1279, std. dev.: 0.0178) SingleSource/Benchmarks/Shootout/heapsort: -1.25% (3.9173 => 3.8683, std. dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.09% (3.8887 => 3.8463, std. dev.: 0.0059) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.49s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon May 21 16:55:09 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 21 May 2012 18:55:09 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120521235509.D3E442A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/744?compare_to=743&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 744, Order: 157212, Start Time: 2012-05-21 22:59:27, End Time: 2012-05-21 23:56:04 To: 743, Order: 157207, Start Time: 2012-05-21 21:37:01, End Time: 2012-05-21 22:33:35 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (54 on baseline) Performance Improvements: 1 (38 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 891 (796 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/fbench: -3.51% (2.3423 => 2.2600, std. dev.: 0.0208) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.76% (2.0176 => 2.2750, std. dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.10% (0.3130 => 0.3321, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.86% (0.2721 => 0.2826, std. dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.96% (3.9660 => 4.0835, std. dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.61% (0.9199 => 0.9439, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.53% (0.5265 => 0.5398, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/football/football: 2.27% (0.8310 => 0.8499, std. dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 2.27% (13.8202 => 14.1343, std. dev.: 0.0129) MultiSource/Benchmarks/nbench/nbench: 2.27% (1.0594 => 1.0834, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.09% (0.5637 => 0.5755, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.00% (1.1364 => 1.1591, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.97% (0.5577 => 0.5687, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.95% (1.2193 => 1.2431, std. dev.: 0.0018) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.93% (0.7710 => 0.7859, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.88% (1.3245 => 1.3494, std. dev.: 0.0023) MultiSource/Applications/kimwitu++/kc: 1.77% (16.6129 => 16.9075, std. dev.: 0.0293) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.75% (1.4563 => 1.4818, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.70% (13.2842 => 13.5096, std. dev.: 0.0025) MultiSource/Applications/siod/siod: 1.62% (2.1791 => 2.2145, std. dev.: 0.0027) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.58% (0.7460 => 0.7578, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/gs/gs: 1.58% (3.8646 => 3.9257, std. dev.: 0.0034) MultiSource/Applications/Burg/burg: 1.56% (1.1061 => 1.1233, std. dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: 1.53% (0.7038 => 0.7146, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 1.41% (1.9270 => 1.9542, std. dev.: 0.0044) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.21% (1.3819 => 1.3986, std. dev.: 0.0027) MultiSource/Applications/hbd/hbd: 1.20% (1.3693 => 1.3857, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.17% (1.3813 => 1.3975, std. dev.: 0.0028) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.03% (3.6692 => 3.7069, std. dev.: 0.0074) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.35% (1.8175 => 2.2600, std. dev.: 0.0208) SingleSource/Benchmarks/Misc/mandel-2: 8.28% (1.2998 => 1.4074, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.89% (1.5824 => 1.6756, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8146, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9881, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.71% (1.7688 => 1.8345, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/salsa20: 3.59% (7.4271 => 7.6936, std. dev.: 0.0070) MultiSource/Benchmarks/nbench/nbench: 3.15% (11.2619 => 11.6172, std. dev.: 0.0041) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4547, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-6: 2.99% (1.9199 => 1.9773, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.76% (2.8606 => 2.9395, std. dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.73% (8.8259 => 9.0666, std. dev.: 0.0142) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.26% (7.9275 => 8.1068, std. dev.: 0.0132) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.62% (0.8273 => 0.8407, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 1.43% (3.2729 => 3.3197, std. dev.: 0.0009) MultiSource/Applications/lemon/lemon: 1.43% (1.4298 => 1.4502, std. dev.: 0.0008) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5080, std. dev.: 0.0013) MultiSource/Benchmarks/Olden/bisort/bisort: 1.30% (0.8239 => 0.8346, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.29% (2.0200 => 2.0460, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 1.25% (1.2308 => 1.2462, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1778, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -16.83% (0.4657 => 0.3873, std. dev.: 0.0149) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.00% (22.5627 => 20.9834, std. dev.: 0.0052) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.85% (0.2670 => 0.2487, std. dev.: 0.0025) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.87% (0.3511 => 0.3305, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.91% (0.8818 => 0.8473, std. dev.: 0.0070) SingleSource/UnitTests/ObjC/exceptions-3: -3.86% (0.3623 => 0.3483, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -3.77% (0.3663 => 0.3525, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -3.75% (0.3601 => 0.3466, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.73% (0.3650 => 0.3514, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/trivial-interface: -3.69% (0.3578 => 0.3446, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -3.62% (0.3646 => 0.3514, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: -3.48% (0.3940 => 0.3803, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -3.17% (0.3914 => 0.3790, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -3.17% (0.3789 => 0.3669, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -3.10% (0.4003 => 0.3879, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: -2.30% (0.6250 => 0.6106, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.20% (0.6576 => 0.6431, std. dev.: 0.0011) MultiSource/Applications/lua/lua: -1.34% (3.7467 => 3.6966, std. dev.: 0.0028) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.53% (0.3139 => 0.2934, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2650, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9625, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0006) SingleSource/Benchmarks/Dhrystone/dry: -4.03% (2.5089 => 2.4079, std. dev.: 0.0026) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.63% (1.9762 => 1.9044, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/lists: -2.17% (6.3560 => 6.2181, std. dev.: 0.0044) SingleSource/Benchmarks/Misc/richards_benchmark: -2.12% (1.1560 => 1.1315, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.98% (6.6320 => 6.5005, std. dev.: 0.0067) MultiSource/Applications/minisat/minisat: -1.92% (9.3358 => 9.1569, std. dev.: 0.0134) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6908, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3444, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9953, std. dev.: 0.0004) MultiSource/Applications/lua/lua: -1.61% (26.5159 => 26.0900, std. dev.: 0.0284) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.56% (20.3410 => 20.0233, std. dev.: 0.0539) SingleSource/Benchmarks/Shootout/heapsort: -1.49% (3.9173 => 3.8590, std. dev.: 0.0035) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.31s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon May 21 18:17:38 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 21 May 2012 20:17:38 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120522011738.A5C612A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/745?compare_to=744&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 745, Order: 157221, Start Time: 2012-05-22 00:22:03, End Time: 2012-05-22 01:18:33 To: 744, Order: 157212, Start Time: 2012-05-21 22:59:27, End Time: 2012-05-21 23:56:04 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (50 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (799 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.57% (2.0176 => 2.2712, std. dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.10% (0.3130 => 0.3321, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.19% (0.2721 => 0.2835, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.87% (3.9660 => 4.0799, std. dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.46% (0.6959 => 0.7130, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.46% (0.9199 => 0.9425, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.39% (0.5265 => 0.5391, std. dev.: 0.0014) MultiSource/Benchmarks/nbench/nbench: 2.33% (1.0594 => 1.0841, std. dev.: 0.0031) MultiSource/Applications/SPASS/SPASS: 2.24% (13.8202 => 14.1296, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/football/football: 2.19% (0.8310 => 0.8492, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.03% (1.2193 => 1.2440, std. dev.: 0.0021) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.02% (1.1364 => 1.1593, std. dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.95% (0.5637 => 0.5747, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.87% (1.3245 => 1.3493, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.87% (0.7710 => 0.7854, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.70% (1.4563 => 1.4810, std. dev.: 0.0080) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.54% (13.2842 => 13.4894, std. dev.: 0.0179) MultiSource/Benchmarks/MallocBench/gs/gs: 1.52% (3.8646 => 3.9235, std. dev.: 0.0026) MultiSource/Applications/kimwitu++/kc: 1.46% (16.6129 => 16.8547, std. dev.: 0.0195) MultiSource/Applications/siod/siod: 1.43% (2.1791 => 2.2102, std. dev.: 0.0038) MultiSource/Applications/Burg/burg: 1.31% (1.1061 => 1.1206, std. dev.: 0.0024) MultiSource/Applications/treecc/treecc: 1.27% (1.9270 => 1.9515, std. dev.: 0.0013) MultiSource/Applications/hbd/hbd: 1.09% (1.3693 => 1.3842, std. dev.: 0.0021) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.04% (1.3813 => 1.3957, std. dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.02% (1.8175 => 2.2541, std. dev.: 0.0229) SingleSource/Benchmarks/Misc/mandel-2: 8.06% (1.2998 => 1.4045, std. dev.: 0.0051) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.90% (1.5824 => 1.6758, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9875, std. dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.74% (1.7688 => 1.8349, std. dev.: 0.0050) SingleSource/Benchmarks/Misc/salsa20: 3.61% (7.4271 => 7.6951, std. dev.: 0.0047) MultiSource/Benchmarks/nbench/nbench: 3.12% (11.2619 => 11.6137, std. dev.: 0.0014) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4534, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-6: 2.86% (1.9199 => 1.9748, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9392, std. dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.68% (8.8259 => 9.0622, std. dev.: 0.0180) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.63% (7.9275 => 8.1359, std. dev.: 0.0077) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.60% (0.8273 => 0.8405, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.49% (1.4298 => 1.4511, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 1.46% (3.2729 => 3.3208, std. dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.43% (8.3908 => 8.5104, std. dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.26% (2.0200 => 2.0455, std. dev.: 0.0006) SingleSource/Benchmarks/McGill/chomp: 1.24% (1.2308 => 1.2461, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0035) MultiSource/Benchmarks/sim/sim: 1.15% (5.0168 => 5.0747, std. dev.: 0.0115) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.14% (1.9433 => 1.9654, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/flops: 1.13% (9.0760 => 9.1782, std. dev.: 0.0008) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -20.79% (0.4657 => 0.3689, std. dev.: 0.0212) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.02% (22.5627 => 20.9784, std. dev.: 0.0103) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.78% (0.2670 => 0.2489, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.98% (0.3511 => 0.3301, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.89% (0.8818 => 0.8475, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.48% (0.3650 => 0.3523, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -3.42% (0.3601 => 0.3478, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -3.38% (0.3578 => 0.3457, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -3.37% (0.3646 => 0.3523, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -3.36% (0.3663 => 0.3540, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -3.27% (0.3940 => 0.3811, std. dev.: 0.0030) SingleSource/UnitTests/ObjC/for-in: -3.04% (0.3789 => 0.3674, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -2.95% (0.4003 => 0.3885, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -2.94% (0.3914 => 0.3799, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.11% (0.6576 => 0.6437, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.69% (0.9108 => 0.8954, std. dev.: 0.0002) MultiSource/Applications/lua/lua: -1.35% (3.7467 => 3.6961, std. dev.: 0.0044) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.69% (0.3139 => 0.2929, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9624, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.52% (1.3780 => 1.3157, std. dev.: 0.0041) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.98% (2.5089 => 2.4090, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/bh/bh: -3.63% (1.9762 => 1.9045, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.61% (0.3458 => 0.3333, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -2.20% (6.3560 => 6.2161, std. dev.: 0.0075) SingleSource/Benchmarks/Misc/richards_benchmark: -2.15% (1.1560 => 1.1311, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.05% (20.3410 => 19.9234, std. dev.: 0.0776) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.96% (6.6320 => 6.5020, std. dev.: 0.0040) MultiSource/Applications/minisat/minisat: -1.94% (9.3358 => 9.1550, std. dev.: 0.0402) MultiSource/Benchmarks/mafft/pairlocalalign: -1.89% (28.2225 => 27.6905, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9959, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) MultiSource/Applications/lua/lua: -1.55% (26.5159 => 26.1062, std. dev.: 0.0662) SingleSource/Benchmarks/Shootout/heapsort: -1.46% (3.9173 => 3.8600, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.08% (3.8887 => 3.8467, std. dev.: 0.0071) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.52s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon May 21 19:40:47 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 21 May 2012 21:40:47 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120522024047.ACF182A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/746?compare_to=745&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 746, Order: 157231, Start Time: 2012-05-22 01:45:04, End Time: 2012-05-22 02:41:42 To: 745, Order: 157221, Start Time: 2012-05-22 00:22:03, End Time: 2012-05-22 01:18:33 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (53 on baseline) Performance Improvements: 0 (41 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (794 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.22% (2.0176 => 2.2641, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.10% (0.3130 => 0.3321, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.79% (0.2721 => 0.2824, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.90% (3.9660 => 4.0812, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.65% (0.9199 => 0.9443, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.64% (0.5265 => 0.5404, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.51% (0.6959 => 0.7134, std. dev.: 0.0058) MultiSource/Applications/SPASS/SPASS: 2.31% (13.8202 => 14.1401, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.24% (0.5637 => 0.5763, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 2.23% (0.8310 => 0.8495, std. dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 2.15% (1.0594 => 1.0822, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.07% (1.2193 => 1.2445, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.02% (1.1364 => 1.1594, std. dev.: 0.0034) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.91% (0.7710 => 0.7857, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.90% (1.3245 => 1.3496, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.85% (1.4563 => 1.4832, std. dev.: 0.0035) MultiSource/Benchmarks/MallocBench/gs/gs: 1.83% (3.8646 => 3.9355, std. dev.: 0.0059) MultiSource/Applications/kimwitu++/kc: 1.68% (16.6129 => 16.8912, std. dev.: 0.0196) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.63% (13.2842 => 13.5011, std. dev.: 0.0157) MultiSource/Applications/siod/siod: 1.60% (2.1791 => 2.2140, std. dev.: 0.0053) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.58% (0.7460 => 0.7578, std. dev.: 0.0006) MultiSource/Applications/Burg/burg: 1.55% (1.1061 => 1.1232, std. dev.: 0.0032) MultiSource/Applications/treecc/treecc: 1.46% (1.9270 => 1.9551, std. dev.: 0.0063) MultiSource/Applications/lambda-0_1_3/lambda: 1.42% (0.7038 => 0.7138, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.26% (1.3819 => 1.3993, std. dev.: 0.0021) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.25% (1.3813 => 1.3986, std. dev.: 0.0045) MultiSource/Applications/hbd/hbd: 1.10% (1.3693 => 1.3844, std. dev.: 0.0039) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.36% (1.8175 => 2.2603, std. dev.: 0.0056) SingleSource/Benchmarks/Misc/mandel-2: 8.06% (1.2998 => 1.4046, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.90% (1.5824 => 1.6758, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8147, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9881, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.71% (1.7688 => 1.8345, std. dev.: 0.0154) SingleSource/Benchmarks/Misc/salsa20: 3.60% (7.4271 => 7.6945, std. dev.: 0.0026) MultiSource/Benchmarks/nbench/nbench: 3.13% (11.2619 => 11.6142, std. dev.: 0.0034) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4550, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.98% (8.8259 => 9.0885, std. dev.: 0.0091) SingleSource/Benchmarks/Misc/flops-6: 2.89% (1.9199 => 1.9753, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9393, std. dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.48% (7.9275 => 8.1242, std. dev.: 0.0077) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.60% (0.8273 => 0.8405, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 1.46% (3.2729 => 3.3208, std. dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5129, std. dev.: 0.0067) MultiSource/Applications/lemon/lemon: 1.43% (1.4298 => 1.4502, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.27% (2.0200 => 2.0457, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 1.22% (5.0168 => 5.0779, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.16% (1.9433 => 1.9658, std. dev.: 0.0062) SingleSource/Benchmarks/Misc/flops: 1.11% (9.0760 => 9.1771, std. dev.: 0.0018) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -13.68% (0.4657 => 0.4020, std. dev.: 0.0171) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.28% (22.5627 => 20.9197, std. dev.: 0.0019) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.74% (0.2670 => 0.2490, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.18% (0.3511 => 0.3294, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.97% (0.8818 => 0.8468, std. dev.: 0.0042) SingleSource/UnitTests/ObjC/exceptions-3: -3.45% (0.3623 => 0.3498, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -3.36% (0.3601 => 0.3480, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -3.36% (0.3663 => 0.3540, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -3.26% (0.3646 => 0.3527, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.26% (0.3650 => 0.3531, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/trivial-interface: -3.21% (0.3578 => 0.3463, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -3.05% (0.3940 => 0.3820, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -2.85% (0.3789 => 0.3681, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: -2.76% (0.3914 => 0.3806, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -2.72% (0.4003 => 0.3894, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: -2.54% (0.6250 => 0.6091, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.33% (0.6576 => 0.6423, std. dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.83% (0.9108 => 0.8941, std. dev.: 0.0005) MultiSource/Applications/lua/lua: -1.32% (3.7467 => 3.6971, std. dev.: 0.0105) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.66% (0.3139 => 0.2930, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.21% (2.4152 => 2.2651, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.20% (1.3780 => 1.3063, std. dev.: 0.0032) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9624, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -4.04% (2.5089 => 2.4075, std. dev.: 0.0017) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.73% (0.3458 => 0.3329, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.66% (1.9762 => 1.9038, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: -2.16% (1.1560 => 1.1310, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -2.00% (6.3560 => 6.2288, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.95% (6.6320 => 6.5029, std. dev.: 0.0050) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.92% (20.3410 => 19.9502, std. dev.: 0.0623) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6910, std. dev.: 0.0018) MultiSource/Applications/minisat/minisat: -1.70% (9.3358 => 9.1774, std. dev.: 0.0156) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9954, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.50% (3.9173 => 3.8584, std. dev.: 0.0093) MultiSource/Applications/lua/lua: -1.35% (26.5159 => 26.1589, std. dev.: 0.0101) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.06% (3.8887 => 3.8476, std. dev.: 0.0083) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.55s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon May 21 21:03:16 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 21 May 2012 23:03:16 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120522040316.4A4F92A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/747?compare_to=746&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 747, Order: 157232, Start Time: 2012-05-22 03:07:35, End Time: 2012-05-22 04:04:10 To: 746, Order: 157231, Start Time: 2012-05-22 01:45:04, End Time: 2012-05-22 02:41:42 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (50 on baseline) Performance Improvements: 0 (41 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (797 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.15% (2.0176 => 2.2627, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.07% (0.3130 => 0.3320, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.82% (0.2721 => 0.2825, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.94% (3.9660 => 4.0827, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.66% (0.9199 => 0.9444, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.55% (0.5265 => 0.5399, std. dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 2.28% (13.8202 => 14.1350, std. dev.: 0.0158) MultiSource/Benchmarks/nbench/nbench: 2.21% (1.0594 => 1.0828, std. dev.: 0.0081) MultiSource/Benchmarks/Prolangs-C/football/football: 2.17% (0.8310 => 0.8490, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.14% (0.7710 => 0.7875, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.04% (0.5637 => 0.5752, std. dev.: 0.0019) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.94% (1.1364 => 1.1584, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.93% (1.2193 => 1.2428, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.92% (1.4563 => 1.4842, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.90% (0.5577 => 0.5683, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.90% (1.3245 => 1.3496, std. dev.: 0.0020) MultiSource/Applications/siod/siod: 1.89% (2.1791 => 2.2203, std. dev.: 0.0019) MultiSource/Applications/kimwitu++/kc: 1.71% (16.6129 => 16.8970, std. dev.: 0.0016) MultiSource/Benchmarks/MallocBench/gs/gs: 1.68% (3.8646 => 3.9297, std. dev.: 0.0042) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.64% (13.2842 => 13.5016, std. dev.: 0.0009) MultiSource/Applications/Burg/burg: 1.59% (1.1061 => 1.1237, std. dev.: 0.0023) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.58% (0.7460 => 0.7578, std. dev.: 0.0022) MultiSource/Applications/treecc/treecc: 1.43% (1.9270 => 1.9546, std. dev.: 0.0076) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.28% (1.3813 => 1.3990, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.25% (1.3819 => 1.3992, std. dev.: 0.0016) MultiSource/Applications/hbd/hbd: 1.13% (1.3693 => 1.3848, std. dev.: 0.0032) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.01% (1.8175 => 2.2539, std. dev.: 0.0546) SingleSource/Benchmarks/Misc/mandel-2: 7.07% (1.2998 => 1.3917, std. dev.: 0.0055) SingleSource/Benchmarks/Misc/flops-4: 6.52% (1.0640 => 1.1334, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6754, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8147, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9877, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.71% (1.7688 => 1.8345, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: 3.66% (7.4271 => 7.6992, std. dev.: 0.0055) MultiSource/Benchmarks/nbench/nbench: 3.16% (11.2619 => 11.6179, std. dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4539, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-6: 2.89% (1.9199 => 1.9754, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.83% (8.8259 => 9.0760, std. dev.: 0.0106) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.75% (7.9275 => 8.1456, std. dev.: 0.0097) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9392, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.57% (0.8273 => 0.8403, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.48% (1.4298 => 1.4510, std. dev.: 0.0037) MultiSource/Applications/siod/siod: 1.48% (3.2729 => 3.3213, std. dev.: 0.0021) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5097, std. dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.27% (2.0200 => 2.0457, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 1.14% (9.0760 => 9.1796, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -18.17% (0.4657 => 0.3811, std. dev.: 0.0117) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.27% (22.5627 => 20.9216, std. dev.: 0.0181) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.74% (0.2670 => 0.2490, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.12% (0.3511 => 0.3296, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.92% (0.8818 => 0.8472, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-3: -3.45% (0.3623 => 0.3498, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -3.39% (0.3601 => 0.3479, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.34% (0.3650 => 0.3528, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -3.33% (0.3663 => 0.3541, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: -3.30% (0.3578 => 0.3460, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-4: -3.21% (0.3646 => 0.3529, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: -3.02% (0.3940 => 0.3821, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/for-in: -2.90% (0.3789 => 0.3679, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/parameter-passing: -2.80% (0.4003 => 0.3891, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions: -2.78% (0.3914 => 0.3805, std. dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/bigfib: -2.38% (0.6250 => 0.6101, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.11% (0.6576 => 0.6437, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.88% (0.9108 => 0.8937, std. dev.: 0.0005) MultiSource/Applications/lua/lua: -1.31% (3.7467 => 3.6977, std. dev.: 0.0043) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0013) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.59% (0.3139 => 0.2932, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.21% (2.4152 => 2.2651, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9624, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.46% (1.3780 => 1.3165, std. dev.: 0.0077) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.99% (2.5089 => 2.4088, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.73% (0.3458 => 0.3329, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -3.67% (1.9762 => 1.9037, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: -2.13% (1.1560 => 1.1314, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: -2.11% (9.3358 => 9.1385, std. dev.: 0.0220) SingleSource/Benchmarks/Shootout/lists: -1.98% (6.3560 => 6.2303, std. dev.: 0.0055) MultiSource/Benchmarks/mafft/pairlocalalign: -1.89% (28.2225 => 27.6902, std. dev.: 0.0024) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.88% (6.6320 => 6.5074, std. dev.: 0.0044) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.85% (20.3410 => 19.9646, std. dev.: 0.0417) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3446, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9955, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.56% (0.9692 => 0.9541, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.33% (3.9173 => 3.8651, std. dev.: 0.0176) MultiSource/Applications/lua/lua: -1.28% (26.5159 => 26.1775, std. dev.: 0.0257) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.02% (3.8887 => 3.8492, std. dev.: 0.0077) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.31s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon May 21 22:25:44 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 22 May 2012 00:25:44 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120522052544.99BC32A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/748?compare_to=747&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 748, Order: 157234, Start Time: 2012-05-22 04:30:07, End Time: 2012-05-22 05:26:39 To: 747, Order: 157232, Start Time: 2012-05-22 03:07:35, End Time: 2012-05-22 04:04:10 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (50 on baseline) Performance Improvements: 0 (41 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (797 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.42% (2.0176 => 2.2681, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.13% (0.3130 => 0.3322, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.82% (0.2721 => 0.2825, std. dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.83% (3.9660 => 4.0781, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.55% (0.5265 => 0.5399, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.46% (0.6959 => 0.7130, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.44% (0.9199 => 0.9423, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 2.25% (0.8310 => 0.8497, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 2.19% (1.0594 => 1.0826, std. dev.: 0.0029) MultiSource/Applications/SPASS/SPASS: 2.14% (13.8202 => 14.1154, std. dev.: 0.0083) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.92% (0.5637 => 0.5745, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.91% (1.1364 => 1.1581, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.85% (1.3245 => 1.3490, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.83% (1.2193 => 1.2416, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.71% (0.7710 => 0.7842, std. dev.: 0.0023) MultiSource/Applications/kimwitu++/kc: 1.69% (16.6129 => 16.8929, std. dev.: 0.0097) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.59% (13.2842 => 13.4955, std. dev.: 0.0097) MultiSource/Benchmarks/MallocBench/gs/gs: 1.58% (3.8646 => 3.9255, std. dev.: 0.0075) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.57% (1.4563 => 1.4791, std. dev.: 0.0021) MultiSource/Applications/siod/siod: 1.53% (2.1791 => 2.2124, std. dev.: 0.0071) MultiSource/Applications/Burg/burg: 1.51% (1.1061 => 1.1228, std. dev.: 0.0048) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.38% (0.7460 => 0.7563, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 1.38% (1.9270 => 1.9536, std. dev.: 0.0008) MultiSource/Applications/hbd/hbd: 1.08% (1.3693 => 1.3841, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.01% (1.3819 => 1.3958, std. dev.: 0.0032) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 23.93% (1.8175 => 2.2525, std. dev.: 0.0071) SingleSource/Benchmarks/Misc/mandel-2: 7.52% (1.2998 => 1.3975, std. dev.: 0.0086) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6755, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9882, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.73% (1.7688 => 1.8347, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: 3.68% (7.4271 => 7.7001, std. dev.: 0.0027) MultiSource/Benchmarks/nbench/nbench: 3.12% (11.2619 => 11.6136, std. dev.: 0.0022) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4531, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.94% (8.8259 => 9.0858, std. dev.: 0.0093) SingleSource/Benchmarks/Misc/flops-6: 2.81% (1.9199 => 1.9739, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.77% (2.8606 => 2.9397, std. dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.30% (7.9275 => 8.1101, std. dev.: 0.0127) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.56% (0.8273 => 0.8402, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: 1.50% (1.9290 => 1.9580, std. dev.: 0.0010) MultiSource/Applications/siod/siod: 1.48% (3.2729 => 3.3215, std. dev.: 0.0012) MultiSource/Applications/lemon/lemon: 1.48% (1.4298 => 1.4510, std. dev.: 0.0012) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5094, std. dev.: 0.0102) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.28% (2.0200 => 2.0459, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.15% (1.9433 => 1.9657, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: 1.13% (9.0760 => 9.1782, std. dev.: 0.0020) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -19.58% (0.4657 => 0.3745, std. dev.: 0.0280) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.35% (22.5627 => 20.9038, std. dev.: 0.0075) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.74% (0.2670 => 0.2490, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.07% (0.3511 => 0.3298, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: -4.03% (0.3623 => 0.3477, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.97% (0.3650 => 0.3505, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.86% (0.8818 => 0.8478, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -3.81% (0.3646 => 0.3507, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-2: -3.80% (0.3601 => 0.3464, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/trivial-interface: -3.80% (0.3578 => 0.3442, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/synchronized: -3.69% (0.3663 => 0.3528, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/property: -3.55% (0.3940 => 0.3800, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -3.47% (0.3914 => 0.3778, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/for-in: -3.35% (0.3789 => 0.3662, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: -3.25% (0.4003 => 0.3873, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: -2.61% (0.6250 => 0.6087, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.25% (0.6576 => 0.6428, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.75% (0.9108 => 0.8949, std. dev.: 0.0003) MultiSource/Applications/lua/lua: -1.30% (3.7467 => 3.6980, std. dev.: 0.0073) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.59% (0.3139 => 0.2932, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.84% (1.3780 => 1.3113, std. dev.: 0.0101) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9624, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0010) SingleSource/Benchmarks/Dhrystone/dry: -4.01% (2.5089 => 2.4082, std. dev.: 0.0012) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.73% (0.3458 => 0.3329, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -3.65% (1.9762 => 1.9040, std. dev.: 0.0087) SingleSource/Benchmarks/Misc/richards_benchmark: -2.13% (1.1560 => 1.1314, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.06% (20.3410 => 19.9211, std. dev.: 0.0538) SingleSource/Benchmarks/Shootout/lists: -2.01% (6.3560 => 6.2283, std. dev.: 0.0032) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6911, std. dev.: 0.0016) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.87% (6.6320 => 6.5077, std. dev.: 0.0038) MultiSource/Applications/minisat/minisat: -1.85% (9.3358 => 9.1628, std. dev.: 0.0253) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9953, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/heapsort: -1.51% (3.9173 => 3.8581, std. dev.: 0.0062) MultiSource/Applications/lua/lua: -1.44% (26.5159 => 26.1343, std. dev.: 0.0248) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.08% (3.8887 => 3.8467, std. dev.: 0.0032) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.31s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue May 22 05:30:28 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 22 May 2012 07:30:28 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120522123028.332C02A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/749?compare_to=748&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 749, Order: 157247, Start Time: 2012-05-22 11:34:36, End Time: 2012-05-22 12:31:23 To: 748, Order: 157234, Start Time: 2012-05-22 04:30:07, End Time: 2012-05-22 05:26:39 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (50 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (799 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.37% (2.0176 => 2.2672, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.17% (0.3130 => 0.3323, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.82% (0.2721 => 0.2825, std. dev.: 0.0026) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.76% (3.9660 => 4.0755, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.43% (0.5265 => 0.5393, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.42% (0.9199 => 0.9422, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.37% (0.6959 => 0.7124, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 2.24% (1.0594 => 1.0831, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/football/football: 2.21% (0.8310 => 0.8494, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 2.10% (13.8202 => 14.1098, std. dev.: 0.0141) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.05% (0.7710 => 0.7868, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.99% (0.5637 => 0.5749, std. dev.: 0.0030) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.87% (1.1364 => 1.1576, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.86% (1.2193 => 1.2420, std. dev.: 0.0019) MultiSource/Applications/siod/siod: 1.78% (2.1791 => 2.2179, std. dev.: 0.0144) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.74% (1.3245 => 1.3475, std. dev.: 0.0013) MultiSource/Applications/kimwitu++/kc: 1.59% (16.6129 => 16.8770, std. dev.: 0.0056) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.57% (1.4563 => 1.4791, std. dev.: 0.0040) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.54% (0.7460 => 0.7575, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.52% (13.2842 => 13.4855, std. dev.: 0.0157) MultiSource/Benchmarks/MallocBench/gs/gs: 1.45% (3.8646 => 3.9206, std. dev.: 0.0073) MultiSource/Applications/Burg/burg: 1.44% (1.1061 => 1.1220, std. dev.: 0.0043) MultiSource/Applications/treecc/treecc: 1.29% (1.9270 => 1.9519, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.11% (1.3819 => 1.3973, std. dev.: 0.0024) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.15% (1.8175 => 2.2565, std. dev.: 0.0311) SingleSource/Benchmarks/Misc/mandel-2: 8.34% (1.2998 => 1.4082, std. dev.: 0.0087) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.86% (1.5824 => 1.6751, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8147, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 3.81% (1.9144 => 1.9873, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.65% (1.7688 => 1.8333, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/salsa20: 3.49% (7.4271 => 7.6862, std. dev.: 0.0064) MultiSource/Benchmarks/nbench/nbench: 3.11% (11.2619 => 11.6121, std. dev.: 0.0018) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4540, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-6: 2.91% (1.9199 => 1.9758, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9393, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.74% (8.8259 => 9.0678, std. dev.: 0.0186) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.50% (7.9275 => 8.1254, std. dev.: 0.0114) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Benchmarks/llubenchmark/llu: 1.81% (3.7731 => 3.8414, std. dev.: 0.0246) MultiSource/Applications/lemon/lemon: 1.66% (1.4298 => 1.4535, std. dev.: 0.0025) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.61% (0.8273 => 0.8406, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 1.48% (3.2729 => 3.3212, std. dev.: 0.0075) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5092, std. dev.: 0.0030) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.27% (2.0200 => 2.0457, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.23% (1.9433 => 1.9672, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 1.10% (9.0760 => 9.1760, std. dev.: 0.0023) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.38% (22.5627 => 20.8981, std. dev.: 0.0197) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.70% (0.2670 => 0.2491, std. dev.: 0.0029) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.10% (0.3511 => 0.3297, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-3: -4.00% (0.3623 => 0.3478, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.96% (0.8818 => 0.8469, std. dev.: 0.0021) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.95% (0.3650 => 0.3506, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/synchronized: -3.88% (0.3663 => 0.3521, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -3.86% (0.3601 => 0.3462, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -3.78% (0.3646 => 0.3508, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -3.75% (0.3578 => 0.3444, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -3.58% (0.3940 => 0.3799, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -3.38% (0.3789 => 0.3661, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -3.32% (0.3914 => 0.3784, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: -3.10% (0.4003 => 0.3879, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: -2.74% (0.6250 => 0.6079, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.99% (0.6576 => 0.6445, std. dev.: 0.0014) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.78% (0.9108 => 0.8946, std. dev.: 0.0004) MultiSource/Applications/lua/lua: -1.43% (3.7467 => 3.6931, std. dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.72% (0.3139 => 0.2928, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2642, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.96% (1.3780 => 1.3097, std. dev.: 0.0070) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9623, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -4.00% (2.5089 => 2.4085, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.67% (1.9762 => 1.9036, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/lists: -2.18% (6.3560 => 6.2175, std. dev.: 0.0076) SingleSource/Benchmarks/Misc/richards_benchmark: -2.17% (1.1560 => 1.1309, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: -1.93% (9.3358 => 9.1559, std. dev.: 0.0118) MultiSource/Benchmarks/mafft/pairlocalalign: -1.89% (28.2225 => 27.6886, std. dev.: 0.0020) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.87% (6.6320 => 6.5080, std. dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.74% (20.3410 => 19.9873, std. dev.: 0.0488) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3446, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9951, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.56% (0.9692 => 0.9541, std. dev.: 0.0000) MultiSource/Applications/lua/lua: -1.45% (26.5159 => 26.1320, std. dev.: 0.0205) SingleSource/Benchmarks/Shootout/heapsort: -1.29% (3.9173 => 3.8667, std. dev.: 0.0034) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.56s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue May 22 08:44:40 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 22 May 2012 10:44:40 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120522154440.F17152A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/750?compare_to=749&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 750, Order: 157251, Start Time: 2012-05-22 14:48:55, End Time: 2012-05-22 15:45:36 To: 749, Order: 157247, Start Time: 2012-05-22 11:34:36, End Time: 2012-05-22 12:31:23 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (49 on baseline) Performance Improvements: 0 (41 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (798 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.29% (2.0176 => 2.2655, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.17% (0.3130 => 0.3323, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.79% (0.2721 => 0.2824, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.86% (3.9660 => 4.0793, std. dev.: 0.0127) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.62% (0.5265 => 0.5403, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.56% (0.6959 => 0.7137, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.48% (0.9199 => 0.9427, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: 2.29% (0.8310 => 0.8500, std. dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: 2.19% (13.8202 => 14.1225, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.15% (0.5637 => 0.5758, std. dev.: 0.0034) MultiSource/Benchmarks/nbench/nbench: 2.12% (1.0594 => 1.0819, std. dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.91% (1.2193 => 1.2426, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.87% (1.4563 => 1.4836, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.86% (1.3245 => 1.3492, std. dev.: 0.0019) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.78% (1.1364 => 1.1566, std. dev.: 0.0010) MultiSource/Applications/kimwitu++/kc: 1.60% (16.6129 => 16.8782, std. dev.: 0.0228) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.56% (13.2842 => 13.4918, std. dev.: 0.0126) MultiSource/Benchmarks/MallocBench/gs/gs: 1.53% (3.8646 => 3.9239, std. dev.: 0.0073) MultiSource/Applications/siod/siod: 1.52% (2.1791 => 2.2123, std. dev.: 0.0064) MultiSource/Applications/Burg/burg: 1.46% (1.1061 => 1.1223, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.37% (0.7460 => 0.7562, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 1.29% (1.9270 => 1.9519, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.17% (1.3819 => 1.3981, std. dev.: 0.0048) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.05% (1.3813 => 1.3958, std. dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 23.95% (1.8175 => 2.2528, std. dev.: 0.0539) SingleSource/Benchmarks/Misc/mandel-2: 8.47% (1.2998 => 1.4099, std. dev.: 0.0054) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7298, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.86% (1.5824 => 1.6752, std. dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8146, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9878, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.77% (1.7688 => 1.8354, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/salsa20: 3.54% (7.4271 => 7.6898, std. dev.: 0.0105) MultiSource/Benchmarks/nbench/nbench: 3.12% (11.2619 => 11.6137, std. dev.: 0.0029) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4547, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.86% (8.8259 => 9.0785, std. dev.: 0.0074) SingleSource/Benchmarks/Misc/flops-6: 2.85% (1.9199 => 1.9746, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.76% (2.8606 => 2.9395, std. dev.: 0.0022) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.40% (7.9275 => 8.1176, std. dev.: 0.0047) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.61% (0.8273 => 0.8406, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 1.47% (3.2729 => 3.3209, std. dev.: 0.0007) MultiSource/Applications/lemon/lemon: 1.42% (1.4298 => 1.4501, std. dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5088, std. dev.: 0.0053) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.28% (2.0200 => 2.0459, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.21% (1.9433 => 1.9669, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 1.13% (9.0760 => 9.1789, std. dev.: 0.0010) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -17.84% (0.4657 => 0.3826, std. dev.: 0.0150) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.31% (22.5627 => 20.9134, std. dev.: 0.0044) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.74% (0.2670 => 0.2490, std. dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.10% (0.3511 => 0.3297, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-3: -3.97% (0.3623 => 0.3479, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.92% (0.3650 => 0.3507, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.90% (0.8818 => 0.8474, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions-2: -3.86% (0.3601 => 0.3462, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -3.79% (0.3663 => 0.3524, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -3.77% (0.3578 => 0.3443, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -3.76% (0.3646 => 0.3509, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -3.45% (0.3940 => 0.3804, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -3.42% (0.3914 => 0.3780, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -3.27% (0.3789 => 0.3665, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -3.20% (0.4003 => 0.3875, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: -2.59% (0.6250 => 0.6088, std. dev.: 0.0038) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.27% (0.6576 => 0.6427, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.71% (0.9108 => 0.8952, std. dev.: 0.0002) MultiSource/Applications/lua/lua: -1.41% (3.7467 => 3.6940, std. dev.: 0.0020) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.16% (1.0460 => 0.9502, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.59% (0.3139 => 0.2932, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.01% (1.3780 => 1.3089, std. dev.: 0.0080) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9622, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -4.03% (2.5089 => 2.4078, std. dev.: 0.0019) MultiSource/Benchmarks/Olden/bh/bh: -3.67% (1.9762 => 1.9037, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.59% (0.3458 => 0.3334, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -2.15% (1.1560 => 1.1312, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.99% (6.6320 => 6.5001, std. dev.: 0.0085) MultiSource/Benchmarks/mafft/pairlocalalign: -1.89% (28.2225 => 27.6905, std. dev.: 0.0017) MultiSource/Applications/minisat/minisat: -1.88% (9.3358 => 9.1604, std. dev.: 0.0313) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.86% (20.3410 => 19.9631, std. dev.: 0.0230) SingleSource/Benchmarks/Shootout/lists: -1.81% (6.3560 => 6.2411, std. dev.: 0.0067) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9954, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) MultiSource/Applications/lua/lua: -1.55% (26.5159 => 26.1057, std. dev.: 0.0287) SingleSource/Benchmarks/Shootout/heapsort: -1.47% (3.9173 => 3.8598, std. dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.08% (3.8887 => 3.8468, std. dev.: 0.0058) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.32s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue May 22 10:07:44 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 22 May 2012 12:07:44 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120522170744.400402A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/751?compare_to=750&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 751, Order: 157256, Start Time: 2012-05-22 16:11:36, End Time: 2012-05-22 17:08:39 To: 750, Order: 157251, Start Time: 2012-05-22 14:48:55, End Time: 2012-05-22 15:45:36 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (51 on baseline) Performance Improvements: 0 (38 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (799 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.47% (2.0176 => 2.2691, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.42% (0.3130 => 0.3331, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.68% (0.2721 => 0.2821, std. dev.: 0.0025) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.82% (3.9660 => 4.0780, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.70% (0.6959 => 0.7147, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.53% (0.9199 => 0.9432, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.43% (0.5265 => 0.5393, std. dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/football/football: 2.26% (0.8310 => 0.8498, std. dev.: 0.0016) MultiSource/Benchmarks/nbench/nbench: 2.24% (1.0594 => 1.0831, std. dev.: 0.0022) MultiSource/Applications/SPASS/SPASS: 2.16% (13.8202 => 14.1190, std. dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.97% (0.5637 => 0.5748, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.96% (1.3245 => 1.3505, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.91% (1.2193 => 1.2426, std. dev.: 0.0058) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.87% (1.1364 => 1.1576, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.84% (1.4563 => 1.4831, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/gs/gs: 1.74% (3.8646 => 3.9320, std. dev.: 0.0007) MultiSource/Applications/kimwitu++/kc: 1.72% (16.6129 => 16.8987, std. dev.: 0.0053) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.71% (1.3819 => 1.4055, std. dev.: 0.0018) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.66% (0.7710 => 0.7838, std. dev.: 0.0022) MultiSource/Applications/lambda-0_1_3/lambda: 1.53% (0.7038 => 0.7146, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.48% (13.2842 => 13.4808, std. dev.: 0.0172) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.47% (1.3813 => 1.4016, std. dev.: 0.0021) MultiSource/Applications/Burg/burg: 1.44% (1.1061 => 1.1220, std. dev.: 0.0028) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.34% (0.7460 => 0.7560, std. dev.: 0.0027) MultiSource/Applications/treecc/treecc: 1.27% (1.9270 => 1.9515, std. dev.: 0.0016) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.28% (1.8175 => 2.2587, std. dev.: 0.0120) SingleSource/Benchmarks/Misc/mandel-2: 7.14% (1.2998 => 1.3926, std. dev.: 0.0139) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.91% (1.5824 => 1.6759, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9875, std. dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.67% (1.7688 => 1.8338, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: 3.56% (7.4271 => 7.6915, std. dev.: 0.0045) MultiSource/Benchmarks/nbench/nbench: 3.13% (11.2619 => 11.6142, std. dev.: 0.0019) MultiSource/Applications/hexxagon/hexxagon: 2.98% (12.0921 => 12.4527, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: 2.92% (1.9199 => 1.9760, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.82% (8.8259 => 9.0750, std. dev.: 0.0115) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9393, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.26% (7.9275 => 8.1067, std. dev.: 0.0084) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0009) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.56% (0.8273 => 0.8402, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 1.45% (3.2729 => 3.3205, std. dev.: 0.0075) MultiSource/Applications/lemon/lemon: 1.43% (1.4298 => 1.4503, std. dev.: 0.0010) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5088, std. dev.: 0.0011) MultiSource/Benchmarks/sim/sim: 1.31% (5.0168 => 5.0825, std. dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.25% (2.0200 => 2.0453, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.18% (1.9433 => 1.9662, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1780, std. dev.: 0.0012) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.24% (22.5627 => 20.9298, std. dev.: 0.0093) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.89% (0.2670 => 0.2486, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.24% (0.3511 => 0.3327, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: -4.39% (0.3623 => 0.3464, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.36% (0.3650 => 0.3491, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-2: -4.28% (0.3601 => 0.3447, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -4.22% (0.3646 => 0.3492, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -4.22% (0.3578 => 0.3427, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -4.20% (0.3663 => 0.3509, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -3.91% (0.3940 => 0.3786, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -3.80% (0.3789 => 0.3645, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -3.68% (0.3914 => 0.3770, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -3.55% (0.4003 => 0.3861, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.39% (0.8818 => 0.8519, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/bigfib: -2.48% (0.6250 => 0.6095, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.57% (0.9108 => 0.8965, std. dev.: 0.0003) MultiSource/Applications/lua/lua: -1.33% (3.7467 => 3.6970, std. dev.: 0.0048) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.16% (1.0460 => 0.9502, std. dev.: 0.0014) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.56% (0.3139 => 0.2933, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.10% (1.3780 => 1.3077, std. dev.: 0.0065) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9622, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.99% (2.5089 => 2.4089, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.67% (0.3458 => 0.3331, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.61% (1.9762 => 1.9048, std. dev.: 0.0057) SingleSource/Benchmarks/Shootout/lists: -2.33% (6.3560 => 6.2082, std. dev.: 0.0099) SingleSource/Benchmarks/Misc/richards_benchmark: -2.11% (1.1560 => 1.1316, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.93% (20.3410 => 19.9479, std. dev.: 0.0187) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.90% (6.6320 => 6.5062, std. dev.: 0.0029) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6906, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: -1.77% (9.3358 => 9.1706, std. dev.: 0.0114) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3446, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9951, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.56% (0.9692 => 0.9541, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.41% (3.9173 => 3.8620, std. dev.: 0.0035) MultiSource/Applications/lua/lua: -1.41% (26.5159 => 26.1426, std. dev.: 0.0209) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.39s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue May 22 12:19:14 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 22 May 2012 14:19:14 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120522191914.79CEB2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/752?compare_to=751&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 752, Order: 157266, Start Time: 2012-05-22 18:23:33, End Time: 2012-05-22 19:20:10 To: 751, Order: 157256, Start Time: 2012-05-22 16:11:36, End Time: 2012-05-22 17:08:39 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (50 on baseline) Performance Improvements: 1 (38 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 890 (800 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 1.18% (1.3926 => 1.4090, std. dev.: 0.0023) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -11.32% (0.4268 => 0.3785, std. dev.: 0.0132) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.07% (2.0176 => 2.2812, std. dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.39% (0.3130 => 0.3330, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.08% (0.2721 => 0.2832, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.16% (3.9660 => 4.0915, std. dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.76% (0.6959 => 0.7151, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.64% (0.9199 => 0.9442, std. dev.: 0.0022) MultiSource/Benchmarks/nbench/nbench: 2.43% (1.0594 => 1.0851, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/football/football: 2.36% (0.8310 => 0.8506, std. dev.: 0.0016) MultiSource/Applications/SPASS/SPASS: 2.32% (13.8202 => 14.1414, std. dev.: 0.0123) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.22% (0.5637 => 0.5762, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.12% (1.2193 => 1.2451, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.01% (1.3245 => 1.3511, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.99% (1.1364 => 1.1590, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.88% (0.7710 => 0.7855, std. dev.: 0.0021) MultiSource/Applications/siod/siod: 1.82% (2.1791 => 2.2187, std. dev.: 0.0062) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.75% (1.4563 => 1.4818, std. dev.: 0.0025) MultiSource/Applications/kimwitu++/kc: 1.73% (16.6129 => 16.8995, std. dev.: 0.0110) MultiSource/Benchmarks/MallocBench/gs/gs: 1.69% (3.8646 => 3.9301, std. dev.: 0.0049) MultiSource/Applications/treecc/treecc: 1.61% (1.9270 => 1.9580, std. dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: 1.59% (0.7038 => 0.7150, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.58% (0.7460 => 0.7578, std. dev.: 0.0009) MultiSource/Applications/Burg/burg: 1.56% (1.1061 => 1.1233, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.50% (13.2842 => 13.4832, std. dev.: 0.0060) MultiSource/Applications/hbd/hbd: 1.50% (1.3693 => 1.3898, std. dev.: 0.0042) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.01% (1.3819 => 1.3959, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.00% (3.6692 => 3.7059, std. dev.: 0.0062) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 23.94% (1.8175 => 2.2526, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel-2: 8.40% (1.2998 => 1.4090, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.90% (1.5824 => 1.6758, std. dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9876, std. dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.74% (1.7688 => 1.8349, std. dev.: 0.0059) SingleSource/Benchmarks/Misc/salsa20: 3.66% (7.4271 => 7.6987, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 3.17% (11.2619 => 11.6191, std. dev.: 0.0025) MultiSource/Applications/hexxagon/hexxagon: 2.98% (12.0921 => 12.4529, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/flops-6: 2.91% (1.9199 => 1.9758, std. dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.89% (8.8259 => 9.0807, std. dev.: 0.0188) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9394, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.51% (7.9275 => 8.1265, std. dev.: 0.0040) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.60% (0.8273 => 0.8405, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 1.48% (3.2729 => 3.3212, std. dev.: 0.0011) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5086, std. dev.: 0.0027) MultiSource/Applications/lemon/lemon: 1.40% (1.4298 => 1.4498, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.30% (2.0200 => 2.0462, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1776, std. dev.: 0.0007) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -18.72% (0.4657 => 0.3785, std. dev.: 0.0132) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.25% (22.5627 => 20.9270, std. dev.: 0.0165) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.97% (0.2670 => 0.2484, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.12% (0.3511 => 0.3296, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-2: -4.22% (0.3601 => 0.3449, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -4.20% (0.3623 => 0.3471, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.08% (0.3650 => 0.3501, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/trivial-interface: -4.05% (0.3578 => 0.3433, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -4.03% (0.3646 => 0.3499, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -4.01% (0.3663 => 0.3516, std. dev.: 0.0024) SingleSource/UnitTests/ObjC/property: -3.71% (0.3940 => 0.3794, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -3.59% (0.3789 => 0.3653, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -3.53% (0.3914 => 0.3776, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -3.40% (0.4003 => 0.3867, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.13% (0.8818 => 0.8542, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: -2.64% (0.6250 => 0.6085, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.50% (0.9108 => 0.8971, std. dev.: 0.0003) MultiSource/Applications/lua/lua: -1.19% (3.7467 => 3.7021, std. dev.: 0.0025) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.14% (1.0460 => 0.9504, std. dev.: 0.0011) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.56% (0.3139 => 0.2933, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2640, std. dev.: 0.0005) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.66% (1.3780 => 1.3138, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9622, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.99% (2.5089 => 2.4088, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.73% (0.3458 => 0.3329, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.62% (1.9762 => 1.9047, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/richards_benchmark: -2.17% (1.1560 => 1.1309, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -2.02% (6.3560 => 6.2273, std. dev.: 0.0027) MultiSource/Applications/minisat/minisat: -1.92% (9.3358 => 9.1563, std. dev.: 0.0114) MultiSource/Benchmarks/mafft/pairlocalalign: -1.89% (28.2225 => 27.6903, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.85% (6.6320 => 6.5093, std. dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.82% (20.3410 => 19.9708, std. dev.: 0.0242) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9955, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0006) MultiSource/Applications/lua/lua: -1.37% (26.5159 => 26.1526, std. dev.: 0.0291) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.49s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue May 22 13:42:10 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 22 May 2012 15:42:10 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120522204210.C20A02A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/753?compare_to=752&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 753, Order: 157274, Start Time: 2012-05-22 19:46:24, End Time: 2012-05-22 20:43:06 To: 752, Order: 157266, Start Time: 2012-05-22 18:23:33, End Time: 2012-05-22 19:20:10 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (47 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 891 (801 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/McGill/chomp: 1.02% (1.2344 => 1.2470, std. dev.: 0.0015) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.51% (2.0176 => 2.2700, std. dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.07% (0.3130 => 0.3320, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.75% (0.2721 => 0.2823, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.97% (3.9660 => 4.0839, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.74% (0.6959 => 0.7150, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.58% (0.9199 => 0.9436, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.53% (0.5265 => 0.5398, std. dev.: 0.0022) MultiSource/Benchmarks/nbench/nbench: 2.30% (1.0594 => 1.0838, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/football/football: 2.14% (0.8310 => 0.8488, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 2.09% (13.8202 => 14.1096, std. dev.: 0.0162) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.08% (0.5637 => 0.5754, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.93% (1.2193 => 1.2428, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.93% (1.1364 => 1.1583, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.92% (0.5577 => 0.5684, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.89% (1.3245 => 1.3495, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.79% (0.7710 => 0.7848, std. dev.: 0.0028) MultiSource/Applications/kimwitu++/kc: 1.63% (16.6129 => 16.8833, std. dev.: 0.0112) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.57% (1.4563 => 1.4791, std. dev.: 0.0027) MultiSource/Applications/siod/siod: 1.56% (2.1791 => 2.2130, std. dev.: 0.0047) MultiSource/Applications/lambda-0_1_3/lambda: 1.49% (0.7038 => 0.7143, std. dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: 1.47% (3.8646 => 3.9213, std. dev.: 0.0029) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.42% (0.7460 => 0.7566, std. dev.: 0.0028) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.40% (13.2842 => 13.4703, std. dev.: 0.0119) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.00% (1.8175 => 2.2537, std. dev.: 0.0516) SingleSource/Benchmarks/Misc/mandel-2: 7.15% (1.2998 => 1.3928, std. dev.: 0.0180) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.86% (1.5824 => 1.6752, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8146, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.79% (1.9144 => 1.9870, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.64% (1.7688 => 1.8332, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: 3.61% (7.4271 => 7.6953, std. dev.: 0.0098) MultiSource/Benchmarks/nbench/nbench: 3.16% (11.2619 => 11.6177, std. dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4537, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-6: 2.94% (1.9199 => 1.9764, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9393, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.70% (8.8259 => 9.0638, std. dev.: 0.0065) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.45% (7.9275 => 8.1221, std. dev.: 0.0113) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.61% (0.8273 => 0.8406, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.49% (1.4298 => 1.4511, std. dev.: 0.0068) MultiSource/Applications/siod/siod: 1.46% (3.2729 => 3.3206, std. dev.: 0.0023) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5088, std. dev.: 0.0009) SingleSource/Benchmarks/McGill/chomp: 1.32% (1.2308 => 1.2470, std. dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.28% (2.0200 => 2.0459, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 1.11% (9.0760 => 9.1763, std. dev.: 0.0026) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.21% (22.5627 => 20.9361, std. dev.: 0.0104) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.93% (0.2670 => 0.2485, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.41% (0.3511 => 0.3286, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: -4.33% (0.3623 => 0.3466, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -4.25% (0.3601 => 0.3448, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.22% (0.3650 => 0.3496, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/synchronized: -4.15% (0.3663 => 0.3511, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -4.11% (0.3646 => 0.3496, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -4.02% (0.3578 => 0.3434, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -3.73% (0.3940 => 0.3793, std. dev.: 0.0034) SingleSource/UnitTests/ObjC/for-in: -3.69% (0.3789 => 0.3649, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -3.58% (0.3914 => 0.3774, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -3.50% (0.4003 => 0.3863, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.27% (0.8818 => 0.8530, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.65% (0.6576 => 0.6402, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: -2.61% (0.6250 => 0.6087, std. dev.: 0.0014) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.75% (0.9108 => 0.8949, std. dev.: 0.0002) MultiSource/Applications/lua/lua: -1.44% (3.7467 => 3.6926, std. dev.: 0.0086) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.05% (4.9865 => 4.9340, std. dev.: 0.0035) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.16% (1.0460 => 0.9502, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.63% (0.3139 => 0.2931, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2640, std. dev.: 0.0006) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9625, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.35% (1.3780 => 1.3181, std. dev.: 0.0034) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -3.99% (2.5089 => 2.4089, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: -3.62% (1.9762 => 1.9046, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout/lists: -2.22% (6.3560 => 6.2147, std. dev.: 0.0114) SingleSource/Benchmarks/Misc/richards_benchmark: -2.16% (1.1560 => 1.1310, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: -1.99% (9.3358 => 9.1502, std. dev.: 0.0029) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.92% (6.6320 => 6.5044, std. dev.: 0.0035) MultiSource/Benchmarks/mafft/pairlocalalign: -1.89% (28.2225 => 27.6902, std. dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.88% (20.3410 => 19.9583, std. dev.: 0.0861) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9960, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.46% (3.9173 => 3.8603, std. dev.: 0.0047) MultiSource/Applications/lua/lua: -1.41% (26.5159 => 26.1421, std. dev.: 0.0264) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.22s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue May 22 15:54:09 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 22 May 2012 17:54:09 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120522225409.8F2842A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/754?compare_to=753&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 754, Order: 157288, Start Time: 2012-05-22 21:58:33, End Time: 2012-05-22 22:55:04 To: 753, Order: 157274, Start Time: 2012-05-22 19:46:24, End Time: 2012-05-22 20:43:06 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (45 on baseline) Performance Improvements: 0 (41 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (802 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.07% (2.0176 => 2.2612, std. dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.78% (0.3130 => 0.3311, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.63% (3.9660 => 4.0705, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.11% (0.9199 => 0.9393, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 2.02% (1.0594 => 1.0808, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.95% (0.6959 => 0.7095, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/football/football: 1.93% (0.8310 => 0.8470, std. dev.: 0.0037) MultiSource/Applications/SPASS/SPASS: 1.87% (13.8202 => 14.0789, std. dev.: 0.0144) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.79% (0.5637 => 0.5738, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.63% (1.3245 => 1.3461, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.58% (1.2193 => 1.2386, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.58% (1.1364 => 1.1543, std. dev.: 0.0014) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.57% (0.7710 => 0.7831, std. dev.: 0.0018) MultiSource/Applications/kimwitu++/kc: 1.29% (16.6129 => 16.8272, std. dev.: 0.0112) MultiSource/Applications/siod/siod: 1.25% (2.1791 => 2.2063, std. dev.: 0.0054) MultiSource/Applications/Burg/burg: 1.24% (1.1061 => 1.1198, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.17% (13.2842 => 13.4401, std. dev.: 0.0115) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.12% (1.4563 => 1.4726, std. dev.: 0.0036) MultiSource/Benchmarks/MallocBench/gs/gs: 1.04% (3.8646 => 3.9046, std. dev.: 0.0034) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.20% (1.8175 => 2.2574, std. dev.: 0.0116) SingleSource/Benchmarks/Misc/mandel-2: 7.28% (1.2998 => 1.3944, std. dev.: 0.0121) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.52% (2.5629 => 2.7299, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.86% (1.5824 => 1.6752, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8146, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 3.79% (1.9144 => 1.9869, std. dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.70% (1.7688 => 1.8343, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 3.63% (7.4271 => 7.6964, std. dev.: 0.0066) MultiSource/Benchmarks/nbench/nbench: 3.13% (11.2619 => 11.6145, std. dev.: 0.0015) MultiSource/Applications/hexxagon/hexxagon: 2.98% (12.0921 => 12.4527, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-6: 2.85% (1.9199 => 1.9747, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.85% (8.8259 => 9.0776, std. dev.: 0.0122) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.76% (2.8606 => 2.9395, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.40% (7.9275 => 8.1179, std. dev.: 0.0145) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.61% (0.8273 => 0.8406, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: 1.60% (1.9290 => 1.9599, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 1.47% (3.2729 => 3.3211, std. dev.: 0.0007) MultiSource/Applications/lemon/lemon: 1.45% (1.4298 => 1.4505, std. dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5086, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.26% (1.9433 => 1.9678, std. dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.25% (2.0200 => 2.0452, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 1.11% (9.0760 => 9.1766, std. dev.: 0.0014) SingleSource/Benchmarks/McGill/chomp: 1.10% (1.2308 => 1.2444, std. dev.: 0.0025) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -18.68% (0.4657 => 0.3787, std. dev.: 0.0262) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.54% (22.5627 => 20.8619, std. dev.: 0.0205) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.23% (0.2670 => 0.2477, std. dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.52% (0.3511 => 0.3282, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-3: -4.64% (0.3623 => 0.3455, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.58% (0.3650 => 0.3483, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-2: -4.50% (0.3601 => 0.3439, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -4.50% (0.3646 => 0.3482, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: -4.44% (0.3578 => 0.3419, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: -4.40% (0.3663 => 0.3502, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -4.24% (0.3940 => 0.3773, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -4.04% (0.8818 => 0.8462, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/for-in: -3.99% (0.3789 => 0.3638, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: -3.92% (0.4003 => 0.3846, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -3.91% (0.3914 => 0.3761, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.00% (0.6576 => 0.6379, std. dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/bigfib: -2.94% (0.6250 => 0.6066, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: -2.08% (0.9108 => 0.8919, std. dev.: 0.0004) MultiSource/Applications/lua/lua: -1.68% (3.7467 => 3.6839, std. dev.: 0.0094) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.30% (6.2785 => 6.1966, std. dev.: 0.0072) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.18% (4.9865 => 4.9277, std. dev.: 0.0006) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.47% (0.3139 => 0.2936, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.80% (1.3780 => 1.3118, std. dev.: 0.0017) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9621, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -4.05% (2.5089 => 2.4074, std. dev.: 0.0018) MultiSource/Benchmarks/Olden/bh/bh: -3.63% (1.9762 => 1.9045, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.59% (0.3458 => 0.3334, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: -2.15% (1.1560 => 1.1311, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: -2.07% (9.3358 => 9.1425, std. dev.: 0.0067) SingleSource/Benchmarks/Shootout/lists: -2.03% (6.3560 => 6.2270, std. dev.: 0.0066) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.97% (6.6320 => 6.5012, std. dev.: 0.0065) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.93% (20.3410 => 19.9475, std. dev.: 0.0387) MultiSource/Benchmarks/mafft/pairlocalalign: -1.89% (28.2225 => 27.6889, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9957, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.56% (0.9692 => 0.9541, std. dev.: 0.0000) MultiSource/Applications/lua/lua: -1.41% (26.5159 => 26.1422, std. dev.: 0.0545) SingleSource/Benchmarks/Shootout/heapsort: -1.36% (3.9173 => 3.8640, std. dev.: 0.0199) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.48s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue May 22 17:16:45 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 22 May 2012 19:16:45 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120523001645.B5BF82A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/755?compare_to=754&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 755, Order: 157298, Start Time: 2012-05-22 23:21:05, End Time: 2012-05-23 00:17:41 To: 754, Order: 157288, Start Time: 2012-05-22 21:58:33, End Time: 2012-05-22 22:55:04 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (40 on baseline) Performance Improvements: 0 (43 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (805 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.02% (2.0176 => 2.2601, std. dev.: 0.0142) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.69% (0.3130 => 0.3308, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.42% (3.9660 => 4.0620, std. dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.09% (0.5265 => 0.5375, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.04% (0.9199 => 0.9387, std. dev.: 0.0024) MultiSource/Benchmarks/nbench/nbench: 1.96% (1.0594 => 1.0802, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/football/football: 1.94% (0.8310 => 0.8471, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 1.72% (13.8202 => 14.0578, std. dev.: 0.0202) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.59% (1.1364 => 1.1545, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.53% (1.2193 => 1.2379, std. dev.: 0.0042) MultiSource/Applications/siod/siod: 1.45% (2.1791 => 2.2108, std. dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.42% (1.3245 => 1.3433, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.20% (13.2842 => 13.4436, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.12% (1.4563 => 1.4726, std. dev.: 0.0027) MultiSource/Applications/kimwitu++/kc: 1.11% (16.6129 => 16.7975, std. dev.: 0.0123) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.32% (1.8175 => 2.2596, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/mandel-2: 7.66% (1.2998 => 1.3993, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.86% (1.5824 => 1.6752, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9880, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 3.69% (7.4271 => 7.7010, std. dev.: 0.0028) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.63% (1.7688 => 1.8330, std. dev.: 0.0020) MultiSource/Benchmarks/nbench/nbench: 3.15% (11.2619 => 11.6166, std. dev.: 0.0029) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4550, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-6: 2.88% (1.9199 => 1.9751, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9393, std. dev.: 0.0035) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.73% (8.8259 => 9.0671, std. dev.: 0.0107) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.51% (7.9275 => 8.1263, std. dev.: 0.0046) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.61% (0.8273 => 0.8406, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.45% (1.4298 => 1.4505, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 1.44% (3.2729 => 3.3200, std. dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5089, std. dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.26% (2.0200 => 2.0454, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bisort/bisort: 1.24% (0.8239 => 0.8341, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/flops: 1.11% (9.0760 => 9.1764, std. dev.: 0.0025) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.56% (22.5627 => 20.8560, std. dev.: 0.0092) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.23% (0.2670 => 0.2477, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.18% (0.3511 => 0.3294, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-3: -5.05% (0.3623 => 0.3440, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -4.81% (0.3578 => 0.3406, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -4.78% (0.3601 => 0.3429, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -4.70% (0.3663 => 0.3491, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -4.64% (0.3646 => 0.3477, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.63% (0.3650 => 0.3481, std. dev.: 0.0025) SingleSource/UnitTests/ObjC/property: -4.44% (0.3940 => 0.3765, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -4.27% (0.3914 => 0.3747, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: -4.22% (0.3789 => 0.3629, std. dev.: 0.0037) SingleSource/UnitTests/ObjC/parameter-passing: -4.22% (0.4003 => 0.3834, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.78% (0.8818 => 0.8485, std. dev.: 0.0116) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.03% (0.6576 => 0.6377, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: -2.93% (0.6250 => 0.6067, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: -2.12% (0.5748 => 0.5626, std. dev.: 0.0010) MultiSource/Applications/lua/lua: -1.85% (3.7467 => 3.6774, std. dev.: 0.0042) SingleSource/UnitTests/ObjC++/property-reference-object: -1.84% (0.5818 => 0.5711, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: -1.53% (0.7061 => 0.6953, std. dev.: 0.0018) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.40% (6.2785 => 6.1909, std. dev.: 0.0020) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.28% (4.9865 => 4.9226, std. dev.: 0.0031) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.53% (0.3139 => 0.2934, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.25% (1.3780 => 1.3057, std. dev.: 0.0062) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9624, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0008) SingleSource/Benchmarks/Dhrystone/dry: -3.96% (2.5089 => 2.4096, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: -3.69% (1.9762 => 1.9032, std. dev.: 0.0048) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.67% (0.3458 => 0.3331, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -2.45% (6.3560 => 6.2004, std. dev.: 0.0144) SingleSource/Benchmarks/Misc/richards_benchmark: -2.16% (1.1560 => 1.1310, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: -1.93% (9.3358 => 9.1558, std. dev.: 0.0292) MultiSource/Benchmarks/mafft/pairlocalalign: -1.87% (28.2225 => 27.6941, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.84% (6.6320 => 6.5097, std. dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.73% (20.3410 => 19.9886, std. dev.: 0.0376) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9955, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0011) MultiSource/Applications/lua/lua: -1.45% (26.5159 => 26.1311, std. dev.: 0.0261) SingleSource/Benchmarks/Shootout/heapsort: -1.09% (3.9173 => 3.8745, std. dev.: 0.0013) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.49s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue May 22 18:40:27 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 22 May 2012 20:40:27 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120523014027.3FAB22A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/756?compare_to=755&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 756, Order: 157304, Start Time: 2012-05-23 00:44:55, End Time: 2012-05-23 01:41:23 To: 755, Order: 157298, Start Time: 2012-05-22 23:21:05, End Time: 2012-05-23 00:17:41 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (46 on baseline) Performance Improvements: 0 (44 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (798 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 11.97% (2.0176 => 2.2592, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.85% (0.3130 => 0.3313, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.61% (3.9660 => 4.0695, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.28% (0.6959 => 0.7118, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.27% (0.9199 => 0.9408, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.20% (0.5265 => 0.5381, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 2.09% (0.8310 => 0.8484, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 2.07% (1.0594 => 1.0813, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 1.91% (13.8202 => 14.0840, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.79% (0.5637 => 0.5738, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.75% (1.2193 => 1.2406, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.68% (1.3245 => 1.3468, std. dev.: 0.0027) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.65% (1.1364 => 1.1551, std. dev.: 0.0013) MultiSource/Applications/siod/siod: 1.48% (2.1791 => 2.2113, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.41% (1.4563 => 1.4768, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 1.32% (3.8646 => 3.9156, std. dev.: 0.0083) MultiSource/Applications/kimwitu++/kc: 1.22% (16.6129 => 16.8154, std. dev.: 0.0038) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.20% (13.2842 => 13.4430, std. dev.: 0.0131) MultiSource/Applications/Burg/burg: 1.18% (1.1061 => 1.1192, std. dev.: 0.0025) MultiSource/Applications/treecc/treecc: 1.06% (1.9270 => 1.9475, std. dev.: 0.0013) MultiSource/Applications/hbd/hbd: 1.00% (1.3693 => 1.3830, std. dev.: 0.0038) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.29% (1.8175 => 2.2589, std. dev.: 0.0457) SingleSource/Benchmarks/Misc/mandel-2: 7.69% (1.2998 => 1.3997, std. dev.: 0.0056) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7298, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6755, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9881, std. dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.66% (1.7688 => 1.8335, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/salsa20: 3.64% (7.4271 => 7.6974, std. dev.: 0.0022) MultiSource/Benchmarks/nbench/nbench: 3.15% (11.2619 => 11.6161, std. dev.: 0.0055) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4543, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-6: 2.94% (1.9199 => 1.9763, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.90% (8.8259 => 9.0822, std. dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9393, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.31% (7.9275 => 8.1103, std. dev.: 0.0223) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/ffbench: 1.56% (0.8273 => 0.8402, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 1.49% (3.2729 => 3.3216, std. dev.: 0.0020) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5102, std. dev.: 0.0111) MultiSource/Applications/lemon/lemon: 1.40% (1.4298 => 1.4498, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.28% (2.0200 => 2.0458, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.11% (1.9433 => 1.9649, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 1.10% (9.0760 => 9.1759, std. dev.: 0.0010) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -21.73% (0.4657 => 0.3645, std. dev.: 0.0352) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.43% (22.5627 => 20.8857, std. dev.: 0.0110) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.38% (0.2670 => 0.2473, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.78% (0.3511 => 0.3273, std. dev.: 0.0062) SingleSource/UnitTests/ObjC/exceptions-3: -4.94% (0.3623 => 0.3444, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.90% (0.3650 => 0.3471, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -4.78% (0.3601 => 0.3429, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -4.72% (0.3578 => 0.3409, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -4.72% (0.3663 => 0.3490, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -4.72% (0.3646 => 0.3474, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -4.42% (0.3940 => 0.3766, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -4.24% (0.3914 => 0.3748, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -4.20% (0.3789 => 0.3630, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -4.05% (0.4003 => 0.3841, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.39% (0.8818 => 0.8519, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.09% (0.6576 => 0.6373, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: -2.75% (0.6250 => 0.6078, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: -1.88% (0.5748 => 0.5640, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.58% (0.9108 => 0.8964, std. dev.: 0.0002) MultiSource/Applications/lua/lua: -1.50% (3.7467 => 3.6904, std. dev.: 0.0105) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.17% (6.2785 => 6.2052, std. dev.: 0.0018) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.02% (4.9865 => 4.9356, std. dev.: 0.0063) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.16% (1.0460 => 0.9502, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.66% (0.3139 => 0.2930, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2650, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9624, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.50% (1.3780 => 1.3160, std. dev.: 0.0103) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -4.05% (2.5089 => 2.4072, std. dev.: 0.0020) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -3.67% (1.9762 => 1.9036, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: -2.13% (1.1560 => 1.1314, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -2.09% (6.3560 => 6.2232, std. dev.: 0.0033) MultiSource/Applications/minisat/minisat: -1.96% (9.3358 => 9.1532, std. dev.: 0.0304) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.91% (20.3410 => 19.9524, std. dev.: 0.0314) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.91% (6.6320 => 6.5054, std. dev.: 0.0016) MultiSource/Benchmarks/mafft/pairlocalalign: -1.89% (28.2225 => 27.6894, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9958, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.54% (3.9173 => 3.8571, std. dev.: 0.0040) MultiSource/Applications/lua/lua: -1.47% (26.5159 => 26.1265, std. dev.: 0.0106) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.07% (3.8887 => 3.8472, std. dev.: 0.0028) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.28s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue May 22 20:03:00 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 22 May 2012 22:03:00 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120523030300.A2B9B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/757?compare_to=756&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 757, Order: 157306, Start Time: 2012-05-23 02:07:24, End Time: 2012-05-23 03:03:56 To: 756, Order: 157304, Start Time: 2012-05-23 00:44:55, End Time: 2012-05-23 01:41:23 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (47 on baseline) Performance Improvements: 0 (43 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (798 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 11.92% (2.0176 => 2.2581, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.81% (0.3130 => 0.3312, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.63% (3.9660 => 4.0702, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.28% (0.5265 => 0.5385, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.19% (0.9199 => 0.9400, std. dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.18% (0.6959 => 0.7111, std. dev.: 0.0022) MultiSource/Benchmarks/nbench/nbench: 2.09% (1.0594 => 1.0815, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/football/football: 1.99% (0.8310 => 0.8475, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 1.94% (13.8202 => 14.0884, std. dev.: 0.0042) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.83% (0.7710 => 0.7851, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.81% (0.5637 => 0.5739, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.78% (1.2193 => 1.2410, std. dev.: 0.0024) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.70% (1.1364 => 1.1557, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.58% (1.3245 => 1.3454, std. dev.: 0.0014) MultiSource/Applications/siod/siod: 1.38% (2.1791 => 2.2092, std. dev.: 0.0058) MultiSource/Applications/Burg/burg: 1.29% (1.1061 => 1.1204, std. dev.: 0.0043) MultiSource/Benchmarks/MallocBench/gs/gs: 1.24% (3.8646 => 3.9125, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.24% (1.4563 => 1.4743, std. dev.: 0.0014) MultiSource/Applications/kimwitu++/kc: 1.13% (16.6129 => 16.8014, std. dev.: 0.0188) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.11% (13.2842 => 13.4317, std. dev.: 0.0091) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.60% (1.8175 => 2.2646, std. dev.: 0.0374) SingleSource/Benchmarks/Misc/mandel-2: 7.15% (1.2998 => 1.3928, std. dev.: 0.0104) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.52% (2.5629 => 2.7299, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.92% (1.5824 => 1.6761, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8146, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9880, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 3.65% (7.4271 => 7.6983, std. dev.: 0.0039) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.61% (1.7688 => 1.8327, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 3.13% (11.2619 => 11.6144, std. dev.: 0.0036) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4549, std. dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.84% (8.8259 => 9.0767, std. dev.: 0.0145) SingleSource/Benchmarks/Misc/flops-6: 2.83% (1.9199 => 1.9742, std. dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9393, std. dev.: 0.0022) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.40% (7.9275 => 8.1174, std. dev.: 0.0147) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0085) SingleSource/Benchmarks/Misc/ffbench: 1.55% (0.8273 => 0.8401, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 1.48% (3.2729 => 3.3213, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.47% (1.4298 => 1.4508, std. dev.: 0.0010) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5094, std. dev.: 0.0016) MultiSource/Benchmarks/sim/sim: 1.31% (5.0168 => 5.0827, std. dev.: 0.0062) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.25% (2.0200 => 2.0453, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.20% (1.9433 => 1.9667, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1772, std. dev.: 0.0008) SingleSource/Benchmarks/McGill/chomp: 1.08% (1.2308 => 1.2441, std. dev.: 0.0012) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -22.72% (0.4657 => 0.3599, std. dev.: 0.0103) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.51% (22.5627 => 20.8682, std. dev.: 0.0206) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.38% (0.2670 => 0.2473, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.78% (0.3511 => 0.3273, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -5.02% (0.3623 => 0.3441, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.85% (0.3650 => 0.3473, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-2: -4.83% (0.3601 => 0.3427, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -4.78% (0.3578 => 0.3407, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -4.78% (0.3663 => 0.3488, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -4.74% (0.3646 => 0.3473, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -4.39% (0.3940 => 0.3767, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions: -4.29% (0.3914 => 0.3746, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: -4.20% (0.3789 => 0.3630, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/parameter-passing: -4.10% (0.4003 => 0.3839, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.39% (0.8818 => 0.8519, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.03% (0.6576 => 0.6377, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: -2.72% (0.6250 => 0.6080, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: -1.95% (0.5748 => 0.5636, std. dev.: 0.0029) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.62% (0.9108 => 0.8960, std. dev.: 0.0005) MultiSource/Applications/lua/lua: -1.56% (3.7467 => 3.6884, std. dev.: 0.0037) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.18% (6.2785 => 6.2046, std. dev.: 0.0089) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.59% (0.3139 => 0.2932, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.07% (1.3780 => 1.3082, std. dev.: 0.0034) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9624, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -3.99% (2.5089 => 2.4088, std. dev.: 0.0012) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.64% (1.9762 => 1.9043, std. dev.: 0.0043) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.20% (20.3410 => 19.8938, std. dev.: 0.0567) SingleSource/Benchmarks/Misc/richards_benchmark: -2.15% (1.1560 => 1.1311, std. dev.: 0.0012) MultiSource/Applications/minisat/minisat: -1.99% (9.3358 => 9.1504, std. dev.: 0.0065) SingleSource/Benchmarks/Shootout/lists: -1.98% (6.3560 => 6.2303, std. dev.: 0.0032) MultiSource/Benchmarks/mafft/pairlocalalign: -1.89% (28.2225 => 27.6891, std. dev.: 0.0021) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.82% (6.6320 => 6.5112, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9953, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.47% (3.9173 => 3.8599, std. dev.: 0.0063) MultiSource/Applications/lua/lua: -1.44% (26.5159 => 26.1332, std. dev.: 0.0367) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.21% (3.8887 => 3.8415, std. dev.: 0.0080) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.27s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue May 22 21:25:30 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 22 May 2012 23:25:30 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120523042530.826BA2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/758?compare_to=757&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 758, Order: 157308, Start Time: 2012-05-23 03:29:55, End Time: 2012-05-23 04:26:26 To: 757, Order: 157306, Start Time: 2012-05-23 02:07:24, End Time: 2012-05-23 03:03:56 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (47 on baseline) Performance Improvements: 0 (43 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (798 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 11.98% (2.0176 => 2.2593, std. dev.: 0.0133) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.01% (0.3130 => 0.3318, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.71% (0.2721 => 0.2822, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.64% (3.9660 => 4.0707, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.30% (0.9199 => 0.9411, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.26% (0.6959 => 0.7116, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.17% (0.5265 => 0.5379, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 2.08% (1.0594 => 1.0814, std. dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/football/football: 2.05% (0.8310 => 0.8480, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 1.90% (13.8202 => 14.0825, std. dev.: 0.0063) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.81% (1.1364 => 1.1570, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.80% (1.2193 => 1.2412, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.69% (1.3245 => 1.3469, std. dev.: 0.0062) MultiSource/Applications/siod/siod: 1.53% (2.1791 => 2.2125, std. dev.: 0.0072) MultiSource/Benchmarks/MallocBench/gs/gs: 1.32% (3.8646 => 3.9156, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.31% (1.4563 => 1.4754, std. dev.: 0.0028) MultiSource/Applications/kimwitu++/kc: 1.26% (16.6129 => 16.8225, std. dev.: 0.0195) MultiSource/Applications/Burg/burg: 1.16% (1.1061 => 1.1189, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.14% (13.2842 => 13.4355, std. dev.: 0.0116) MultiSource/Applications/treecc/treecc: 1.05% (1.9270 => 1.9473, std. dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.37% (1.8175 => 2.2604, std. dev.: 0.0205) SingleSource/Benchmarks/Misc/mandel-2: 7.78% (1.2998 => 1.4009, std. dev.: 0.0084) SingleSource/Benchmarks/Misc/flops-4: 6.52% (1.0640 => 1.1334, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.86% (1.5824 => 1.6752, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.86% (1.9144 => 1.9883, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: 3.60% (7.4271 => 7.6946, std. dev.: 0.0066) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.57% (1.7688 => 1.8320, std. dev.: 0.0020) MultiSource/Benchmarks/nbench/nbench: 3.15% (11.2619 => 11.6169, std. dev.: 0.0056) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 3.03% (8.8259 => 9.0937, std. dev.: 0.0035) MultiSource/Applications/hexxagon/hexxagon: 2.98% (12.0921 => 12.4526, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-6: 2.94% (1.9199 => 1.9763, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9392, std. dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.47% (7.9275 => 8.1233, std. dev.: 0.0106) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.60% (0.8273 => 0.8405, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 1.46% (3.2729 => 3.3208, std. dev.: 0.0078) MultiSource/Applications/lemon/lemon: 1.41% (1.4298 => 1.4499, std. dev.: 0.0008) MultiSource/Benchmarks/NPB-serial/is/is: 1.39% (8.3908 => 8.5074, std. dev.: 0.0029) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.29% (2.0200 => 2.0461, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bisort/bisort: 1.26% (0.8239 => 0.8343, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.19% (1.9433 => 1.9665, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/flops: 1.13% (9.0760 => 9.1783, std. dev.: 0.0006) SingleSource/Benchmarks/McGill/chomp: 1.05% (1.2308 => 1.2437, std. dev.: 0.0012) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -21.30% (0.4657 => 0.3665, std. dev.: 0.0362) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.44% (22.5627 => 20.8843, std. dev.: 0.0078) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.30% (0.2670 => 0.2475, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.69% (0.3511 => 0.3276, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -5.00% (0.3623 => 0.3442, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.85% (0.3650 => 0.3473, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: -4.75% (0.3578 => 0.3408, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -4.75% (0.3663 => 0.3489, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -4.69% (0.3601 => 0.3432, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: -4.58% (0.3646 => 0.3479, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -4.34% (0.3940 => 0.3769, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -4.27% (0.3914 => 0.3747, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -4.12% (0.3789 => 0.3633, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.37% (0.8818 => 0.8521, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.01% (0.6576 => 0.6378, std. dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/bigfib: -2.75% (0.6250 => 0.6078, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: -1.86% (0.5748 => 0.5641, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.56% (0.9108 => 0.8966, std. dev.: 0.0008) MultiSource/Applications/lua/lua: -1.47% (3.7467 => 3.6916, std. dev.: 0.0108) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.17% (6.2785 => 6.2050, std. dev.: 0.0038) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.01% (4.9865 => 4.9363, std. dev.: 0.0058) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.16% (1.0460 => 0.9502, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.63% (0.3139 => 0.2931, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2639, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.36% (1.3780 => 1.3041, std. dev.: 0.0079) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9624, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0011) SingleSource/Benchmarks/Dhrystone/dry: -4.08% (2.5089 => 2.4065, std. dev.: 0.0012) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.62% (1.9762 => 1.9047, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -2.15% (6.3560 => 6.2193, std. dev.: 0.0095) SingleSource/Benchmarks/Misc/richards_benchmark: -2.15% (1.1560 => 1.1312, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.00% (20.3410 => 19.9350, std. dev.: 0.0120) MultiSource/Applications/minisat/minisat: -1.90% (9.3358 => 9.1581, std. dev.: 0.0100) MultiSource/Benchmarks/mafft/pairlocalalign: -1.89% (28.2225 => 27.6880, std. dev.: 0.0025) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.82% (6.6320 => 6.5113, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9952, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) MultiSource/Applications/lua/lua: -1.42% (26.5159 => 26.1389, std. dev.: 0.0361) SingleSource/Benchmarks/Shootout/heapsort: -1.29% (3.9173 => 3.8669, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.04% (3.8887 => 3.8484, std. dev.: 0.0050) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.43s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue May 22 22:47:50 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 23 May 2012 00:47:50 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120523054750.B2B5A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/759?compare_to=758&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 759, Order: 157310, Start Time: 2012-05-23 04:52:21, End Time: 2012-05-23 05:48:46 To: 758, Order: 157308, Start Time: 2012-05-23 03:29:55, End Time: 2012-05-23 04:26:26 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (47 on baseline) Performance Improvements: 0 (41 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 890 (800 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 1.10% (1.9691 => 1.9908, std. dev.: 0.0046) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 1.18% (1.4009 => 1.4174, std. dev.: 0.0048) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 11.78% (2.0176 => 2.2552, std. dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.65% (0.3130 => 0.3307, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.54% (3.9660 => 4.0667, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.32% (0.5265 => 0.5387, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.22% (0.9199 => 0.9403, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.98% (0.6959 => 0.7097, std. dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 1.92% (1.0594 => 1.0797, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.84% (0.5637 => 0.5741, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 1.84% (13.8202 => 14.0745, std. dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/football/football: 1.78% (0.8310 => 0.8458, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.66% (1.2193 => 1.2395, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.51% (1.3245 => 1.3445, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.45% (1.1364 => 1.1529, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.43% (0.7710 => 0.7820, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.28% (1.4563 => 1.4749, std. dev.: 0.0007) MultiSource/Applications/kimwitu++/kc: 1.23% (16.6129 => 16.8167, std. dev.: 0.0190) MultiSource/Applications/hbd/hbd: 1.22% (1.3693 => 1.3860, std. dev.: 0.0006) MultiSource/Applications/Burg/burg: 1.15% (1.1061 => 1.1188, std. dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.14% (13.2842 => 13.4353, std. dev.: 0.0170) MultiSource/Applications/siod/siod: 1.13% (2.1791 => 2.2037, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 1.05% (3.8646 => 3.9050, std. dev.: 0.0093) MultiSource/Applications/treecc/treecc: 1.00% (1.9270 => 1.9463, std. dev.: 0.0042) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.01% (1.8175 => 2.2539, std. dev.: 0.0487) SingleSource/Benchmarks/Misc/mandel-2: 9.05% (1.2998 => 1.4174, std. dev.: 0.0048) SingleSource/Benchmarks/Misc/flops-4: 6.52% (1.0640 => 1.1334, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.85% (1.5824 => 1.6750, std. dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9878, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.70% (1.7688 => 1.8342, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 3.58% (7.4271 => 7.6933, std. dev.: 0.0035) MultiSource/Benchmarks/nbench/nbench: 3.15% (11.2619 => 11.6164, std. dev.: 0.0018) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4533, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-6: 2.88% (1.9199 => 1.9751, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.83% (8.8259 => 9.0761, std. dev.: 0.0143) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9394, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.32% (7.9275 => 8.1115, std. dev.: 0.0198) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/ffbench: 1.61% (0.8273 => 0.8406, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 1.47% (3.2729 => 3.3211, std. dev.: 0.0004) MultiSource/Applications/lemon/lemon: 1.43% (1.4298 => 1.4503, std. dev.: 0.0012) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5086, std. dev.: 0.0071) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.28% (2.0200 => 2.0459, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: 1.15% (5.0168 => 5.0744, std. dev.: 0.0106) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1778, std. dev.: 0.0011) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -21.37% (0.4657 => 0.3662, std. dev.: 0.0077) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.63% (22.5627 => 20.8402, std. dev.: 0.0118) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.42% (0.2670 => 0.2472, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.92% (0.3511 => 0.3268, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.67% (0.8818 => 0.8494, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-3: -3.67% (0.3623 => 0.3490, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.64% (0.3650 => 0.3517, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -3.58% (0.3601 => 0.3472, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: -3.55% (0.3578 => 0.3451, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -3.54% (0.3646 => 0.3517, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -3.49% (0.3663 => 0.3535, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/property: -3.27% (0.3940 => 0.3811, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -3.15% (0.4003 => 0.3877, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: -3.09% (0.3914 => 0.3793, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -3.06% (0.3789 => 0.3673, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.60% (0.6576 => 0.6405, std. dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/bigfib: -2.45% (0.6250 => 0.6097, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.92% (0.9108 => 0.8933, std. dev.: 0.0002) MultiSource/Applications/lua/lua: -1.73% (3.7467 => 3.6819, std. dev.: 0.0010) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.12% (6.2785 => 6.2080, std. dev.: 0.0143) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.04% (4.9865 => 4.9347, std. dev.: 0.0009) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.16% (1.0460 => 0.9502, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.53% (0.3139 => 0.2934, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std. dev.: 0.0005) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9624, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -3.99% (2.5089 => 2.4087, std. dev.: 0.0018) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.62% (1.9762 => 1.9047, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: -2.14% (1.1560 => 1.1313, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.96% (20.3410 => 19.9424, std. dev.: 0.0417) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.92% (6.6320 => 6.5049, std. dev.: 0.0044) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6930, std. dev.: 0.0009) MultiSource/Applications/minisat/minisat: -1.80% (9.3358 => 9.1682, std. dev.: 0.0247) SingleSource/Benchmarks/Shootout/lists: -1.79% (6.3560 => 6.2425, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9955, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) MultiSource/Applications/lua/lua: -1.43% (26.5159 => 26.1365, std. dev.: 0.0144) SingleSource/Benchmarks/Shootout/heapsort: -1.37% (3.9173 => 3.8636, std. dev.: 0.0079) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.41s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed May 23 01:34:29 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 23 May 2012 03:34:29 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120523083429.25E822A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/760?compare_to=759&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 760, Order: 157313, Start Time: 2012-05-23 07:38:35, End Time: 2012-05-23 08:35:25 To: 759, Order: 157310, Start Time: 2012-05-23 04:52:21, End Time: 2012-05-23 05:48:46 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (48 on baseline) Performance Improvements: 0 (42 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (798 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 11.80% (2.0176 => 2.2556, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.91% (0.3130 => 0.3315, std. dev.: 0.0049) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.56% (3.9660 => 4.0677, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.24% (0.5265 => 0.5383, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.20% (0.9199 => 0.9401, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.08% (0.6959 => 0.7104, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.06% (0.7710 => 0.7869, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.97% (0.5637 => 0.5748, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 1.94% (0.8310 => 0.8471, std. dev.: 0.0016) MultiSource/Benchmarks/nbench/nbench: 1.93% (1.0594 => 1.0798, std. dev.: 0.0029) MultiSource/Applications/SPASS/SPASS: 1.91% (13.8202 => 14.0844, std. dev.: 0.0092) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.66% (1.2193 => 1.2396, std. dev.: 0.0029) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.63% (1.1364 => 1.1549, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.58% (1.3245 => 1.3454, std. dev.: 0.0024) MultiSource/Applications/siod/siod: 1.38% (2.1791 => 2.2091, std. dev.: 0.0037) MultiSource/Applications/hbd/hbd: 1.34% (1.3693 => 1.3876, std. dev.: 0.0070) MultiSource/Benchmarks/MallocBench/gs/gs: 1.23% (3.8646 => 3.9122, std. dev.: 0.0083) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.22% (1.4563 => 1.4740, std. dev.: 0.0026) MultiSource/Applications/kimwitu++/kc: 1.20% (16.6129 => 16.8119, std. dev.: 0.0036) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.17% (13.2842 => 13.4402, std. dev.: 0.0239) MultiSource/Applications/treecc/treecc: 1.01% (1.9270 => 1.9464, std. dev.: 0.0025) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 23.73% (1.8175 => 2.2488, std. dev.: 0.0253) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.13% (1.2998 => 1.3795, std. dev.: 0.0198) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.86% (1.5824 => 1.6752, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.86% (1.9144 => 1.9883, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.65% (1.7688 => 1.8334, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/salsa20: 3.63% (7.4271 => 7.6968, std. dev.: 0.0045) MultiSource/Benchmarks/nbench/nbench: 3.13% (11.2619 => 11.6147, std. dev.: 0.0013) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4531, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-6: 2.88% (1.9199 => 1.9751, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9392, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.74% (8.8259 => 9.0681, std. dev.: 0.0125) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.15% (7.9275 => 8.0981, std. dev.: 0.0210) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.60% (0.8273 => 0.8405, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 1.47% (3.2729 => 3.3211, std. dev.: 0.0005) MultiSource/Applications/lemon/lemon: 1.45% (1.4298 => 1.4506, std. dev.: 0.0025) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5100, std. dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.28% (2.0200 => 2.0459, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.16% (1.9433 => 1.9659, std. dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 1.14% (5.0168 => 5.0742, std. dev.: 0.0070) SingleSource/Benchmarks/Misc/flops: 1.13% (9.0760 => 9.1784, std. dev.: 0.0013) SingleSource/Benchmarks/McGill/chomp: 1.11% (1.2308 => 1.2445, std. dev.: 0.0015) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.63% (22.5627 => 20.8411, std. dev.: 0.0089) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.38% (0.2670 => 0.2473, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.89% (0.3511 => 0.3269, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.97% (0.3650 => 0.3505, std. dev.: 0.0017) SingleSource/UnitTests/ObjC/exceptions-3: -3.95% (0.3623 => 0.3480, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -3.83% (0.3601 => 0.3463, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -3.79% (0.3663 => 0.3524, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -3.75% (0.3578 => 0.3444, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -3.73% (0.3646 => 0.3510, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.61% (0.8818 => 0.8500, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/property: -3.55% (0.3940 => 0.3800, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -3.35% (0.3914 => 0.3783, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -3.30% (0.3789 => 0.3664, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -3.10% (0.4003 => 0.3879, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.90% (0.6576 => 0.6385, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: -2.56% (0.6250 => 0.6090, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.89% (0.9108 => 0.8936, std. dev.: 0.0043) MultiSource/Applications/lua/lua: -1.62% (3.7467 => 3.6860, std. dev.: 0.0008) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.09% (6.2785 => 6.2098, std. dev.: 0.0091) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.06% (4.9865 => 4.9337, std. dev.: 0.0103) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.16% (1.0460 => 0.9502, std. dev.: 0.0025) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.50% (0.3139 => 0.2935, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2650, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.92% (1.3780 => 1.3102, std. dev.: 0.0087) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9623, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -4.01% (2.5089 => 2.4082, std. dev.: 0.0009) MultiSource/Benchmarks/Olden/bh/bh: -3.74% (1.9762 => 1.9023, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -2.12% (6.3560 => 6.2214, std. dev.: 0.0148) SingleSource/Benchmarks/Misc/richards_benchmark: -2.11% (1.1560 => 1.1316, std. dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: -1.89% (28.2225 => 27.6890, std. dev.: 0.0024) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.87% (6.6320 => 6.5078, std. dev.: 0.0036) MultiSource/Applications/minisat/minisat: -1.83% (9.3358 => 9.1652, std. dev.: 0.0063) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.81% (20.3410 => 19.9731, std. dev.: 0.0076) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9951, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.56% (3.9173 => 3.8560, std. dev.: 0.0094) MultiSource/Applications/lua/lua: -1.53% (26.5159 => 26.1105, std. dev.: 0.0312) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.05% (3.8887 => 3.8477, std. dev.: 0.0078) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.41s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed May 23 02:57:18 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 23 May 2012 04:57:18 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120523095718.A99532A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/761?compare_to=760&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 761, Order: 157315, Start Time: 2012-05-23 09:01:33, End Time: 2012-05-23 09:58:14 To: 760, Order: 157313, Start Time: 2012-05-23 07:38:35, End Time: 2012-05-23 08:35:25 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (45 on baseline) Performance Improvements: 0 (41 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (802 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.06% (2.0176 => 2.2609, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.75% (0.3130 => 0.3310, std. dev.: 0.0033) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.68% (3.9660 => 4.0723, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.28% (0.9199 => 0.9409, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.22% (0.5265 => 0.5382, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.10% (0.6959 => 0.7105, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.86% (0.5637 => 0.5742, std. dev.: 0.0017) MultiSource/Applications/SPASS/SPASS: 1.85% (13.8202 => 14.0762, std. dev.: 0.0205) MultiSource/Benchmarks/Prolangs-C/football/football: 1.82% (0.8310 => 0.8461, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.76% (1.3245 => 1.3478, std. dev.: 0.0031) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.71% (1.1364 => 1.1558, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 1.32% (2.1791 => 2.2079, std. dev.: 0.0049) MultiSource/Applications/hbd/hbd: 1.29% (1.3693 => 1.3870, std. dev.: 0.0042) MultiSource/Applications/kimwitu++/kc: 1.19% (16.6129 => 16.8103, std. dev.: 0.0095) MultiSource/Benchmarks/MallocBench/gs/gs: 1.14% (3.8646 => 3.9085, std. dev.: 0.0028) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.09% (13.2842 => 13.4287, std. dev.: 0.0058) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.03% (1.3819 => 1.3962, std. dev.: 0.0054) MultiSource/Applications/Burg/burg: 1.02% (1.1061 => 1.1174, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 1.01% (1.9270 => 1.9465, std. dev.: 0.0017) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.42% (1.8175 => 2.2614, std. dev.: 0.0471) SingleSource/Benchmarks/Misc/mandel-2: 8.08% (1.2998 => 1.4048, std. dev.: 0.0107) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7298, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6754, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.80% (1.9144 => 1.9872, std. dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.67% (1.7688 => 1.8338, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/salsa20: 3.62% (7.4271 => 7.6960, std. dev.: 0.0057) MultiSource/Benchmarks/nbench/nbench: 3.17% (11.2619 => 11.6191, std. dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4542, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-6: 2.93% (1.9199 => 1.9761, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9394, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.68% (8.8259 => 9.0625, std. dev.: 0.0200) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.22% (7.9275 => 8.1036, std. dev.: 0.0164) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.57% (0.8273 => 0.8403, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.56% (1.4298 => 1.4521, std. dev.: 0.0012) MultiSource/Applications/siod/siod: 1.47% (3.2729 => 3.3211, std. dev.: 0.0023) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5091, std. dev.: 0.0031) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.27% (2.0200 => 2.0456, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.26% (1.9433 => 1.9678, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.09% (9.0760 => 9.1751, std. dev.: 0.0032) MultiSource/Benchmarks/sim/sim: 1.08% (5.0168 => 5.0712, std. dev.: 0.0090) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.56% (22.5627 => 20.8567, std. dev.: 0.0161) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.34% (0.2670 => 0.2474, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.95% (0.3511 => 0.3267, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -4.06% (0.3623 => 0.3476, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -3.97% (0.3601 => 0.3458, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.95% (0.3650 => 0.3506, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/trivial-interface: -3.91% (0.3578 => 0.3438, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -3.90% (0.3663 => 0.3520, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -3.87% (0.3646 => 0.3505, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -3.65% (0.3940 => 0.3796, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -3.45% (0.3914 => 0.3779, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.42% (0.8818 => 0.8516, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/for-in: -3.40% (0.3789 => 0.3660, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -3.37% (0.4003 => 0.3868, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: -2.56% (0.6250 => 0.6090, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.48% (0.6576 => 0.6413, std. dev.: 0.0015) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.84% (0.9108 => 0.8940, std. dev.: 0.0002) MultiSource/Applications/lua/lua: -1.69% (3.7467 => 3.6832, std. dev.: 0.0038) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.14% (4.9865 => 4.9295, std. dev.: 0.0021) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.53% (0.3139 => 0.2934, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.67% (1.3780 => 1.3137, std. dev.: 0.0007) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9625, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -4.07% (2.5089 => 2.4068, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.67% (1.9762 => 1.9037, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout/lists: -2.17% (6.3560 => 6.2180, std. dev.: 0.0089) SingleSource/Benchmarks/Misc/richards_benchmark: -2.14% (1.1560 => 1.1313, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: -2.01% (9.3358 => 9.1484, std. dev.: 0.0297) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.93% (20.3410 => 19.9489, std. dev.: 0.1093) MultiSource/Benchmarks/mafft/pairlocalalign: -1.89% (28.2225 => 27.6904, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.80% (6.6320 => 6.5129, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9955, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout/heapsort: -1.52% (3.9173 => 3.8576, std. dev.: 0.0044) MultiSource/Applications/lua/lua: -1.29% (26.5159 => 26.1726, std. dev.: 0.0310) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.04% (3.8887 => 3.8483, std. dev.: 0.0063) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.53s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed May 23 06:20:46 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 23 May 2012 08:20:46 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120523132046.D49232A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/762?compare_to=761&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 762, Order: 157317, Start Time: 2012-05-23 12:25:09, End Time: 2012-05-23 13:21:42 To: 761, Order: 157315, Start Time: 2012-05-23 09:01:33, End Time: 2012-05-23 09:58:14 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (49 on baseline) Performance Improvements: 0 (41 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (798 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.21% (2.0176 => 2.2640, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.78% (0.3130 => 0.3311, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.68% (3.9660 => 4.0723, std. dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.32% (0.5265 => 0.5387, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/hash2: 2.31% (0.4328 => 0.4428, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.17% (0.9199 => 0.9399, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 2.15% (1.0594 => 1.0822, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.08% (0.6959 => 0.7104, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/football/football: 2.03% (0.8310 => 0.8479, std. dev.: 0.0015) MultiSource/Applications/SPASS/SPASS: 1.96% (13.8202 => 14.0904, std. dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.92% (0.5637 => 0.5745, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.82% (0.7710 => 0.7850, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.78% (1.2193 => 1.2410, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.70% (1.1364 => 1.1557, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.69% (1.3245 => 1.3469, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.35% (1.4563 => 1.4759, std. dev.: 0.0024) MultiSource/Applications/kimwitu++/kc: 1.28% (16.6129 => 16.8253, std. dev.: 0.0253) MultiSource/Benchmarks/MallocBench/gs/gs: 1.25% (3.8646 => 3.9128, std. dev.: 0.0087) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.24% (1.3819 => 1.3990, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 1.23% (2.1791 => 2.2059, std. dev.: 0.0039) MultiSource/Applications/hbd/hbd: 1.21% (1.3693 => 1.3859, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.13% (13.2842 => 13.4338, std. dev.: 0.0138) MultiSource/Applications/treecc/treecc: 1.11% (1.9270 => 1.9483, std. dev.: 0.0071) MultiSource/Applications/Burg/burg: 1.10% (1.1061 => 1.1183, std. dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 23.94% (1.8175 => 2.2527, std. dev.: 0.0405) SingleSource/Benchmarks/Misc/mandel-2: 8.06% (1.2998 => 1.4045, std. dev.: 0.0110) SingleSource/Benchmarks/Misc/flops-4: 6.52% (1.0640 => 1.1334, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7298, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6754, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9881, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.70% (1.7688 => 1.8343, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/salsa20: 3.58% (7.4271 => 7.6930, std. dev.: 0.0072) MultiSource/Benchmarks/nbench/nbench: 3.14% (11.2619 => 11.6157, std. dev.: 0.0021) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4538, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-6: 2.95% (1.9199 => 1.9766, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.89% (8.8259 => 9.0813, std. dev.: 0.0075) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.74% (2.8606 => 2.9391, std. dev.: 0.0024) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.67% (7.9275 => 8.1388, std. dev.: 0.0063) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.61% (0.8273 => 0.8406, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: 1.60% (1.9290 => 1.9598, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 1.50% (3.2729 => 3.3219, std. dev.: 0.0005) MultiSource/Applications/lemon/lemon: 1.43% (1.4298 => 1.4503, std. dev.: 0.0006) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5100, std. dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.30% (2.0200 => 2.0462, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.26% (1.9433 => 1.9678, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1776, std. dev.: 0.0008) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.48% (22.5627 => 20.8750, std. dev.: 0.0054) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.99% (0.2670 => 0.2510, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.13% (0.3511 => 0.3331, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: -4.28% (0.3623 => 0.3468, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -4.11% (0.3601 => 0.3453, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: -4.07% (0.3663 => 0.3514, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -4.05% (0.3578 => 0.3433, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.03% (0.3650 => 0.3503, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/property: -3.81% (0.3940 => 0.3790, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -3.64% (0.3789 => 0.3651, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: -3.50% (0.4003 => 0.3863, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -3.45% (0.3914 => 0.3779, std. dev.: 0.0032) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.38% (0.8818 => 0.8520, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/bigfib: -2.32% (0.6250 => 0.6105, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.25% (0.6576 => 0.6428, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.84% (0.9108 => 0.8940, std. dev.: 0.0004) MultiSource/Applications/lua/lua: -1.60% (3.7467 => 3.6866, std. dev.: 0.0026) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.11% (4.9865 => 4.9310, std. dev.: 0.0086) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.01% (6.2785 => 6.2152, std. dev.: 0.0089) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.56% (0.3139 => 0.2933, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.95% (1.3780 => 1.3098, std. dev.: 0.0089) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9624, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0010) SingleSource/Benchmarks/Dhrystone/dry: -3.95% (2.5089 => 2.4099, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.73% (0.3458 => 0.3329, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.64% (1.9762 => 1.9042, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: -2.12% (1.1560 => 1.1315, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.98% (6.6320 => 6.5008, std. dev.: 0.0083) SingleSource/Benchmarks/Shootout/lists: -1.97% (6.3560 => 6.2309, std. dev.: 0.0071) MultiSource/Applications/minisat/minisat: -1.95% (9.3358 => 9.1540, std. dev.: 0.0448) MultiSource/Benchmarks/mafft/pairlocalalign: -1.87% (28.2225 => 27.6949, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3446, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9957, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.52% (20.3410 => 20.0314, std. dev.: 0.0221) MultiSource/Applications/lua/lua: -1.45% (26.5159 => 26.1311, std. dev.: 0.0232) SingleSource/Benchmarks/Shootout/heapsort: -1.35% (3.9173 => 3.8643, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.03% (3.8887 => 3.8485, std. dev.: 0.0107) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.25s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed May 23 07:43:19 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 23 May 2012 09:43:19 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120523144319.003B02A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/763?compare_to=762&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 763, Order: 157320, Start Time: 2012-05-23 13:47:43, End Time: 2012-05-23 14:44:15 To: 762, Order: 157317, Start Time: 2012-05-23 12:25:09, End Time: 2012-05-23 13:21:42 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (46 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (802 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.26% (2.0176 => 2.2649, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.81% (0.3130 => 0.3312, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.67% (3.9660 => 4.0718, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.34% (0.5265 => 0.5388, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 2.33% (0.4328 => 0.4429, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.25% (0.9199 => 0.9406, std. dev.: 0.0064) MultiSource/Benchmarks/nbench/nbench: 2.12% (1.0594 => 1.0819, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.11% (0.6959 => 0.7106, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/football/football: 2.08% (0.8310 => 0.8483, std. dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.00% (0.5637 => 0.5750, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 1.88% (13.8202 => 14.0794, std. dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.73% (1.3245 => 1.3474, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.66% (1.1364 => 1.1553, std. dev.: 0.0030) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.65% (0.7710 => 0.7837, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.36% (1.4563 => 1.4761, std. dev.: 0.0034) MultiSource/Applications/kimwitu++/kc: 1.33% (16.6129 => 16.8331, std. dev.: 0.0079) MultiSource/Benchmarks/MallocBench/gs/gs: 1.23% (3.8646 => 3.9123, std. dev.: 0.0026) MultiSource/Applications/hbd/hbd: 1.23% (1.3693 => 1.3862, std. dev.: 0.0024) MultiSource/Applications/Burg/burg: 1.15% (1.1061 => 1.1188, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.14% (13.2842 => 13.4360, std. dev.: 0.0116) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.33% (1.8175 => 2.2597, std. dev.: 0.0482) SingleSource/Benchmarks/Misc/mandel-2: 7.70% (1.2998 => 1.3999, std. dev.: 0.0083) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6755, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8146, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 3.87% (1.9144 => 1.9884, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 3.61% (7.4271 => 7.6950, std. dev.: 0.0048) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.59% (1.7688 => 1.8323, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 3.13% (11.2619 => 11.6147, std. dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 3.09% (8.8259 => 9.0989, std. dev.: 0.0041) MultiSource/Applications/hexxagon/hexxagon: 2.98% (12.0921 => 12.4530, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/flops-6: 2.94% (1.9199 => 1.9763, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9392, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.33% (7.9275 => 8.1126, std. dev.: 0.0158) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.61% (0.8273 => 0.8406, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.51% (1.4298 => 1.4514, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 1.49% (3.2729 => 3.3216, std. dev.: 0.0009) MultiSource/Benchmarks/NPB-serial/is/is: 1.43% (8.3908 => 8.5107, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.28% (2.0200 => 2.0459, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 1.15% (9.0760 => 9.1807, std. dev.: 0.0007) SingleSource/Benchmarks/McGill/chomp: 1.14% (1.2308 => 1.2448, std. dev.: 0.0010) MultiSource/Benchmarks/sim/sim: 1.12% (5.0168 => 5.0728, std. dev.: 0.0104) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -20.68% (0.4657 => 0.3694, std. dev.: 0.0368) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.44% (22.5627 => 20.8834, std. dev.: 0.0092) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.03% (0.2670 => 0.2509, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.04% (0.3511 => 0.3334, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -4.22% (0.3623 => 0.3470, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.19% (0.3650 => 0.3497, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/synchronized: -4.10% (0.3663 => 0.3513, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -4.09% (0.3646 => 0.3497, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-2: -4.08% (0.3601 => 0.3454, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -4.00% (0.3578 => 0.3435, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -3.78% (0.3940 => 0.3791, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: -3.62% (0.3789 => 0.3652, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -3.53% (0.3914 => 0.3776, std. dev.: 0.0028) SingleSource/UnitTests/ObjC/parameter-passing: -3.52% (0.4003 => 0.3862, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.36% (0.8818 => 0.8522, std. dev.: 0.0043) SingleSource/Benchmarks/Misc-C++/bigfib: -2.35% (0.6250 => 0.6103, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.82% (0.9108 => 0.8942, std. dev.: 0.0004) MultiSource/Applications/lua/lua: -1.64% (3.7467 => 3.6852, std. dev.: 0.0075) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.06% (4.9865 => 4.9338, std. dev.: 0.0164) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.53% (0.3139 => 0.2934, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.96% (1.3780 => 1.3097, std. dev.: 0.0131) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9624, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -4.02% (2.5089 => 2.4081, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.73% (0.3458 => 0.3329, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.63% (1.9762 => 1.9044, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/richards_benchmark: -2.12% (1.1560 => 1.1315, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.11% (20.3410 => 19.9113, std. dev.: 0.0614) SingleSource/Benchmarks/Shootout/lists: -1.92% (6.3560 => 6.2338, std. dev.: 0.0076) MultiSource/Applications/minisat/minisat: -1.91% (9.3358 => 9.1578, std. dev.: 0.0197) MultiSource/Benchmarks/mafft/pairlocalalign: -1.89% (28.2225 => 27.6901, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.85% (6.6320 => 6.5096, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9955, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) MultiSource/Applications/lua/lua: -1.39% (26.5159 => 26.1486, std. dev.: 0.0080) SingleSource/Benchmarks/Shootout/heapsort: -1.33% (3.9173 => 3.8653, std. dev.: 0.0064) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.22s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed May 23 09:05:55 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 23 May 2012 11:05:55 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120523160555.CEADE2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/764?compare_to=763&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 764, Order: 157323, Start Time: 2012-05-23 15:10:15, End Time: 2012-05-23 16:06:51 To: 763, Order: 157320, Start Time: 2012-05-23 13:47:43, End Time: 2012-05-23 14:44:15 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (47 on baseline) Performance Improvements: 0 (42 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (799 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.19% (2.0176 => 2.2636, std. dev.: 0.0123) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.94% (0.3130 => 0.3316, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.72% (3.9660 => 4.0737, std. dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.34% (0.5265 => 0.5388, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash2: 2.33% (0.4328 => 0.4429, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.22% (0.9199 => 0.9403, std. dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 2.10% (1.0594 => 1.0817, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.10% (0.6959 => 0.7105, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 1.94% (0.8310 => 0.8471, std. dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 1.92% (13.8202 => 14.0855, std. dev.: 0.0126) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.86% (0.5637 => 0.5742, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.75% (1.1364 => 1.1563, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.71% (1.2193 => 1.2402, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.62% (1.3245 => 1.3460, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 1.35% (2.1791 => 2.2085, std. dev.: 0.0030) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.34% (1.4563 => 1.4758, std. dev.: 0.0020) MultiSource/Applications/kimwitu++/kc: 1.31% (16.6129 => 16.8311, std. dev.: 0.0139) MultiSource/Applications/hbd/hbd: 1.29% (1.3693 => 1.3869, std. dev.: 0.0048) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.14% (13.2842 => 13.4359, std. dev.: 0.0057) MultiSource/Benchmarks/MallocBench/gs/gs: 1.13% (3.8646 => 3.9083, std. dev.: 0.0024) MultiSource/Applications/treecc/treecc: 1.12% (1.9270 => 1.9486, std. dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.35% (1.8175 => 2.2601, std. dev.: 0.0089) SingleSource/Benchmarks/Misc/mandel-2: 8.01% (1.2998 => 1.4039, std. dev.: 0.0086) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.90% (1.5824 => 1.6757, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8146, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.81% (1.9144 => 1.9874, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.67% (1.7688 => 1.8337, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/salsa20: 3.47% (7.4271 => 7.6845, std. dev.: 0.0114) MultiSource/Benchmarks/nbench/nbench: 3.14% (11.2619 => 11.6150, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4534, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: 2.89% (1.9199 => 1.9754, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.77% (2.8606 => 2.9397, std. dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.74% (8.8259 => 9.0680, std. dev.: 0.0204) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.40% (7.9275 => 8.1174, std. dev.: 0.0171) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.58% (0.8273 => 0.8404, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 1.47% (3.2729 => 3.3209, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: 1.45% (1.4298 => 1.4505, std. dev.: 0.0013) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5098, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.32% (2.0200 => 2.0466, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bisort/bisort: 1.27% (0.8239 => 0.8344, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: 1.12% (5.0168 => 5.0732, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1775, std. dev.: 0.0018) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.53% (22.5627 => 20.8630, std. dev.: 0.0152) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.00% (0.2670 => 0.2483, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.89% (0.3511 => 0.3269, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.16% (0.3650 => 0.3498, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -4.11% (0.3623 => 0.3474, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -4.11% (0.3601 => 0.3453, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -4.04% (0.3663 => 0.3515, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -4.03% (0.3646 => 0.3499, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -3.97% (0.3578 => 0.3436, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -3.81% (0.3940 => 0.3790, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -3.56% (0.3789 => 0.3654, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -3.53% (0.3914 => 0.3776, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -3.50% (0.4003 => 0.3863, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.31% (0.8818 => 0.8526, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.39% (0.6576 => 0.6419, std. dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/bigfib: -2.34% (0.6250 => 0.6104, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.86% (0.9108 => 0.8939, std. dev.: 0.0003) MultiSource/Applications/lua/lua: -1.68% (3.7467 => 3.6839, std. dev.: 0.0020) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.10% (4.9865 => 4.9317, std. dev.: 0.0082) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.03% (6.2785 => 6.2138, std. dev.: 0.0080) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.53% (0.3139 => 0.2934, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0004) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9624, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.30% (1.3780 => 1.3187, std. dev.: 0.0014) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -4.00% (2.5089 => 2.4086, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -3.65% (1.9762 => 1.9041, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -2.17% (6.6320 => 6.4882, std. dev.: 0.0123) SingleSource/Benchmarks/Misc/richards_benchmark: -2.15% (1.1560 => 1.1312, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -2.14% (6.3560 => 6.2202, std. dev.: 0.0110) MultiSource/Applications/minisat/minisat: -1.91% (9.3358 => 9.1577, std. dev.: 0.0076) MultiSource/Benchmarks/mafft/pairlocalalign: -1.87% (28.2225 => 27.6952, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3446, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9952, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.59% (20.3410 => 20.0171, std. dev.: 0.0323) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.56% (0.9692 => 0.9541, std. dev.: 0.0010) MultiSource/Applications/lua/lua: -1.46% (26.5159 => 26.1292, std. dev.: 0.0367) SingleSource/Benchmarks/Shootout/heapsort: -1.30% (3.9173 => 3.8664, std. dev.: 0.0172) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.10% (3.8887 => 3.8461, std. dev.: 0.0020) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.50s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed May 23 10:28:37 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 23 May 2012 12:28:37 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120523172837.6248F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/765?compare_to=764&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 765, Order: 157325, Start Time: 2012-05-23 16:33:03, End Time: 2012-05-23 17:29:33 To: 764, Order: 157323, Start Time: 2012-05-23 15:10:15, End Time: 2012-05-23 16:06:51 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (46 on baseline) Performance Improvements: 0 (42 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (800 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.08% (2.0176 => 2.2613, std. dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.65% (0.3130 => 0.3307, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.63% (3.9660 => 4.0705, std. dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.15% (0.9199 => 0.9397, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.10% (0.6959 => 0.7105, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.05% (0.5265 => 0.5373, std. dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 2.00% (1.0594 => 1.0806, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 1.90% (0.8310 => 0.8468, std. dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: 1.72% (13.8202 => 14.0576, std. dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.66% (1.2193 => 1.2396, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.57% (1.3245 => 1.3453, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.57% (1.1364 => 1.1542, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.35% (1.4563 => 1.4759, std. dev.: 0.0036) MultiSource/Applications/kimwitu++/kc: 1.26% (16.6129 => 16.8215, std. dev.: 0.0078) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.24% (13.2842 => 13.4483, std. dev.: 0.0060) MultiSource/Applications/siod/siod: 1.20% (2.1791 => 2.2052, std. dev.: 0.0017) MultiSource/Benchmarks/MallocBench/gs/gs: 1.10% (3.8646 => 3.9073, std. dev.: 0.0071) MultiSource/Applications/Burg/burg: 1.02% (1.1061 => 1.1174, std. dev.: 0.0012) MultiSource/Applications/treecc/treecc: 1.01% (1.9270 => 1.9465, std. dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.21% (1.8175 => 2.2575, std. dev.: 0.0374) SingleSource/Benchmarks/Misc/mandel-2: 8.11% (1.2998 => 1.4052, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.90% (1.5824 => 1.6757, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9879, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.73% (1.7688 => 1.8348, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 3.50% (7.4271 => 7.6873, std. dev.: 0.0112) MultiSource/Benchmarks/nbench/nbench: 3.14% (11.2619 => 11.6156, std. dev.: 0.0022) MultiSource/Applications/hexxagon/hexxagon: 2.98% (12.0921 => 12.4521, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/flops-6: 2.91% (1.9199 => 1.9757, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.74% (2.8606 => 2.9391, std. dev.: 0.0025) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.68% (8.8259 => 9.0625, std. dev.: 0.0214) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.50% (7.9275 => 8.1260, std. dev.: 0.0056) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.61% (0.8273 => 0.8406, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.60% (1.9290 => 1.9599, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 1.48% (3.2729 => 3.3213, std. dev.: 0.0025) MultiSource/Applications/lemon/lemon: 1.44% (1.4298 => 1.4504, std. dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: 1.43% (8.3908 => 8.5105, std. dev.: 0.0086) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.31% (1.9433 => 1.9688, std. dev.: 0.0088) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.27% (2.0200 => 2.0456, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bisort/bisort: 1.21% (0.8239 => 0.8339, std. dev.: 0.0006) MultiSource/Benchmarks/sim/sim: 1.18% (5.0168 => 5.0759, std. dev.: 0.0085) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 1.13% (9.0760 => 9.1783, std. dev.: 0.0011) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -20.72% (0.4657 => 0.3692, std. dev.: 0.0062) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.56% (22.5627 => 20.8570, std. dev.: 0.0064) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.04% (0.2670 => 0.2482, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.78% (0.3511 => 0.3273, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-3: -4.61% (0.3623 => 0.3456, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.60% (0.3650 => 0.3482, std. dev.: 0.0033) SingleSource/UnitTests/ObjC/exceptions-2: -4.53% (0.3601 => 0.3438, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -4.42% (0.3663 => 0.3501, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -4.42% (0.3578 => 0.3420, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -4.36% (0.3646 => 0.3487, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -4.19% (0.3940 => 0.3775, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -4.01% (0.3789 => 0.3637, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: -3.91% (0.3914 => 0.3761, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -3.85% (0.4003 => 0.3849, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.33% (0.8818 => 0.8524, std. dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/bigfib: -2.77% (0.6250 => 0.6077, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.71% (0.6576 => 0.6398, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.75% (0.9108 => 0.8949, std. dev.: 0.0004) MultiSource/Applications/lua/lua: -1.69% (3.7467 => 3.6832, std. dev.: 0.0091) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.23% (4.9865 => 4.9252, std. dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.14% (6.2785 => 6.2072, std. dev.: 0.0024) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.16% (1.0460 => 0.9502, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.59% (0.3139 => 0.2932, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.85% (1.3780 => 1.3112, std. dev.: 0.0092) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9622, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -4.07% (2.5089 => 2.4068, std. dev.: 0.0014) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.73% (0.3458 => 0.3329, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.67% (1.9762 => 1.9036, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/richards_benchmark: -2.15% (1.1560 => 1.1311, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -2.04% (6.3560 => 6.2264, std. dev.: 0.0022) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -2.00% (6.6320 => 6.4991, std. dev.: 0.0056) MultiSource/Applications/minisat/minisat: -1.95% (9.3358 => 9.1539, std. dev.: 0.0052) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6908, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3446, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9954, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.53% (3.9173 => 3.8572, std. dev.: 0.0076) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.53% (20.3410 => 20.0300, std. dev.: 0.0337) MultiSource/Applications/lua/lua: -1.35% (26.5159 => 26.1586, std. dev.: 0.0234) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.25s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed May 23 11:51:12 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 23 May 2012 13:51:12 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120523185112.1D99F2A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/766?compare_to=765&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 766, Order: 157331, Start Time: 2012-05-23 17:55:36, End Time: 2012-05-23 18:52:08 To: 765, Order: 157325, Start Time: 2012-05-23 16:33:03, End Time: 2012-05-23 17:29:33 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (50 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 891 (801 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 1.34% (3.7609 => 3.8112, std. dev.: 0.0135) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.11% (2.0176 => 2.2620, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.91% (0.3130 => 0.3315, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.85% (0.6959 => 0.7157, std. dev.: 0.0016) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.83% (3.9660 => 4.0784, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.54% (0.9199 => 0.9433, std. dev.: 0.0015) MultiSource/Benchmarks/nbench/nbench: 2.37% (1.0594 => 1.0845, std. dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.34% (0.5265 => 0.5388, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/football/football: 2.12% (0.8310 => 0.8486, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 2.12% (13.8202 => 14.1129, std. dev.: 0.0157) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.02% (1.2193 => 1.2439, std. dev.: 0.0085) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.94% (1.1364 => 1.1584, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.92% (1.3245 => 1.3499, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.92% (0.5637 => 0.5745, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 1.83% (2.1791 => 2.2189, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.71% (0.7710 => 0.7842, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.68% (1.4563 => 1.4807, std. dev.: 0.0024) MultiSource/Applications/kimwitu++/kc: 1.61% (16.6129 => 16.8811, std. dev.: 0.0087) MultiSource/Benchmarks/MallocBench/gs/gs: 1.57% (3.8646 => 3.9253, std. dev.: 0.0028) MultiSource/Applications/Burg/burg: 1.44% (1.1061 => 1.1220, std. dev.: 0.0022) MultiSource/Applications/treecc/treecc: 1.42% (1.9270 => 1.9543, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.28% (13.2842 => 13.4548, std. dev.: 0.0059) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.09% (1.3813 => 1.3964, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.09% (1.3819 => 1.3970, std. dev.: 0.0010) MultiSource/Applications/SIBsim4/SIBsim4: 1.00% (1.2749 => 1.2877, std. dev.: 0.0019) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.05% (1.8175 => 2.2546, std. dev.: 0.0079) SingleSource/Benchmarks/Misc/mandel-2: 8.14% (1.2998 => 1.4056, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.87% (1.5824 => 1.6753, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8146, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 3.81% (1.9144 => 1.9874, std. dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.71% (1.7688 => 1.8344, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: 3.55% (7.4271 => 7.6906, std. dev.: 0.0075) MultiSource/Benchmarks/nbench/nbench: 3.12% (11.2619 => 11.6133, std. dev.: 0.0044) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4533, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-6: 2.85% (1.9199 => 1.9746, std. dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.77% (8.8259 => 9.0704, std. dev.: 0.0283) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9394, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.28% (7.9275 => 8.1082, std. dev.: 0.0131) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9603, std. dev.: 0.0082) SingleSource/Benchmarks/Misc/ffbench: 1.61% (0.8273 => 0.8406, std. dev.: 0.0025) MultiSource/Applications/siod/siod: 1.48% (3.2729 => 3.3213, std. dev.: 0.0073) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5091, std. dev.: 0.0029) MultiSource/Applications/lemon/lemon: 1.36% (1.4298 => 1.4492, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.28% (2.0200 => 2.0458, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.15% (1.9433 => 1.9657, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: 1.14% (9.0760 => 9.1795, std. dev.: 0.0004) MultiSource/Benchmarks/llubenchmark/llu: 1.01% (3.7731 => 3.8112, std. dev.: 0.0135) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.34% (22.5627 => 20.9061, std. dev.: 0.0140) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.08% (0.2670 => 0.2481, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.64% (0.3511 => 0.3278, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-3: -4.69% (0.3623 => 0.3453, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.60% (0.3650 => 0.3482, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -4.53% (0.3601 => 0.3438, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -4.47% (0.3578 => 0.3418, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -4.47% (0.3646 => 0.3483, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -4.42% (0.3663 => 0.3501, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -4.14% (0.3940 => 0.3777, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -4.06% (0.3914 => 0.3755, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: -4.01% (0.3789 => 0.3637, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -3.82% (0.4003 => 0.3850, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.05% (0.8818 => 0.8549, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.74% (0.6576 => 0.6396, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/bigfib: -2.40% (0.6250 => 0.6100, std. dev.: 0.0047) MultiSource/Applications/lua/lua: -1.39% (3.7467 => 3.6947, std. dev.: 0.0093) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.16% (1.0460 => 0.9502, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.56% (0.3139 => 0.2933, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2642, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9622, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.54% (1.3780 => 1.3154, std. dev.: 0.0025) SingleSource/Benchmarks/Dhrystone/dry: -3.93% (2.5089 => 2.4102, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.73% (0.3458 => 0.3329, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.65% (1.9762 => 1.9041, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/richards_benchmark: -2.12% (1.1560 => 1.1315, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout/lists: -2.08% (6.3560 => 6.2241, std. dev.: 0.0127) MultiSource/Applications/minisat/minisat: -2.01% (9.3358 => 9.1482, std. dev.: 0.0080) MultiSource/Benchmarks/mafft/pairlocalalign: -1.89% (28.2225 => 27.6903, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.85% (6.6320 => 6.5092, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9953, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.56% (20.3410 => 20.0245, std. dev.: 0.0430) MultiSource/Applications/lua/lua: -1.48% (26.5159 => 26.1247, std. dev.: 0.0342) SingleSource/Benchmarks/Shootout/heapsort: -1.29% (3.9173 => 3.8667, std. dev.: 0.0076) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.31s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed May 23 13:13:52 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 23 May 2012 15:13:52 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120523201352.CF7A22A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/767?compare_to=766&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 767, Order: 157337, Start Time: 2012-05-23 19:18:11, End Time: 2012-05-23 20:14:49 To: 766, Order: 157331, Start Time: 2012-05-23 17:55:36, End Time: 2012-05-23 18:52:08 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (50 on baseline) Performance Improvements: 0 (38 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (800 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.38% (2.0176 => 2.2674, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.36% (0.3130 => 0.3329, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.68% (0.2721 => 0.2821, std. dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.07% (3.9660 => 4.0878, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.56% (0.5265 => 0.5400, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.49% (0.6959 => 0.7132, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.48% (0.9199 => 0.9427, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 2.45% (1.0594 => 1.0854, std. dev.: 0.0030) MultiSource/Applications/SPASS/SPASS: 2.39% (13.8202 => 14.1500, std. dev.: 0.0107) MultiSource/Benchmarks/Prolangs-C/football/football: 2.26% (0.8310 => 0.8498, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.06% (0.5637 => 0.5753, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.05% (1.1364 => 1.1597, std. dev.: 0.0015) MultiSource/Applications/kimwitu++/kc: 2.03% (16.6129 => 16.9501, std. dev.: 0.0052) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.02% (0.7710 => 0.7866, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.01% (1.2193 => 1.2438, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.89% (1.3245 => 1.3495, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.77% (1.4563 => 1.4821, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/gs/gs: 1.59% (3.8646 => 3.9262, std. dev.: 0.0034) MultiSource/Applications/treecc/treecc: 1.46% (1.9270 => 1.9551, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.46% (13.2842 => 13.4776, std. dev.: 0.0048) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.34% (0.7460 => 0.7560, std. dev.: 0.0017) MultiSource/Applications/hbd/hbd: 1.23% (1.3693 => 1.3861, std. dev.: 0.0052) MultiSource/Applications/SIBsim4/SIBsim4: 1.18% (1.2749 => 1.2899, std. dev.: 0.0057) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.10% (1.3813 => 1.3965, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.03% (1.3819 => 1.3962, std. dev.: 0.0022) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.26% (1.8175 => 2.2584, std. dev.: 0.0425) SingleSource/Benchmarks/Misc/mandel-2: 7.55% (1.2998 => 1.3979, std. dev.: 0.0045) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0011) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6755, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-5: 3.76% (1.9144 => 1.9864, std. dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.73% (1.7688 => 1.8347, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: 3.68% (7.4271 => 7.7007, std. dev.: 0.0027) MultiSource/Benchmarks/nbench/nbench: 3.17% (11.2619 => 11.6189, std. dev.: 0.0026) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4547, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: 2.88% (1.9199 => 1.9751, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.74% (2.8606 => 2.9391, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.56% (8.8259 => 9.0520, std. dev.: 0.0203) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.31% (7.9275 => 8.1110, std. dev.: 0.0070) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.60% (1.9290 => 1.9599, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 1.56% (0.8273 => 0.8402, std. dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5092, std. dev.: 0.0007) MultiSource/Applications/lemon/lemon: 1.40% (1.4298 => 1.4498, std. dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.29% (2.0200 => 2.0460, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.16% (1.9433 => 1.9659, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 1.13% (9.0760 => 9.1783, std. dev.: 0.0007) SingleSource/Benchmarks/McGill/chomp: 1.03% (1.2308 => 1.2435, std. dev.: 0.0016) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.27% (0.2670 => 0.2476, std. dev.: 0.0011) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.25% (22.5627 => 20.9263, std. dev.: 0.0195) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.58% (0.3511 => 0.3280, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.52% (0.3650 => 0.3485, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-3: -4.39% (0.3623 => 0.3464, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -4.37% (0.3663 => 0.3503, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -4.36% (0.3601 => 0.3444, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: -4.25% (0.3646 => 0.3491, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -4.25% (0.3578 => 0.3426, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -3.93% (0.3940 => 0.3785, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -3.88% (0.3914 => 0.3762, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -3.85% (0.3789 => 0.3643, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -3.62% (0.4003 => 0.3858, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.36% (0.8818 => 0.8522, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.46% (0.6576 => 0.6414, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: -2.13% (0.6250 => 0.6117, std. dev.: 0.0050) MultiSource/Applications/lua/lua: -1.24% (3.7467 => 3.7004, std. dev.: 0.0056) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.53% (0.3139 => 0.2934, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.70% (1.3780 => 1.3132, std. dev.: 0.0009) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9623, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0009) SingleSource/Benchmarks/Dhrystone/dry: -4.06% (2.5089 => 2.4070, std. dev.: 0.0017) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.73% (0.3458 => 0.3329, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.67% (1.9762 => 1.9037, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/richards_benchmark: -2.15% (1.1560 => 1.1312, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -2.14% (6.3560 => 6.2202, std. dev.: 0.0062) MultiSource/Applications/minisat/minisat: -2.08% (9.3358 => 9.1420, std. dev.: 0.0046) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.93% (6.6320 => 6.5041, std. dev.: 0.0026) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6922, std. dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.74% (20.3410 => 19.9864, std. dev.: 0.0358) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9956, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.51% (3.9173 => 3.8583, std. dev.: 0.0154) MultiSource/Applications/lua/lua: -1.42% (26.5159 => 26.1386, std. dev.: 0.0144) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.35s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed May 23 14:36:34 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 23 May 2012 16:36:34 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120523213634.7B5832A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/768?compare_to=767&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 768, Order: 157339, Start Time: 2012-05-23 20:40:52, End Time: 2012-05-23 21:37:30 To: 767, Order: 157337, Start Time: 2012-05-23 19:18:11, End Time: 2012-05-23 20:14:49 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (51 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (798 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.42% (2.0176 => 2.2681, std. dev.: 0.0142) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.04% (0.3130 => 0.3319, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.68% (0.2721 => 0.2821, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.96% (3.9660 => 4.0832, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.54% (0.9199 => 0.9433, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.54% (0.6959 => 0.7136, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.49% (0.5265 => 0.5396, std. dev.: 0.0027) MultiSource/Benchmarks/nbench/nbench: 2.35% (1.0594 => 1.0843, std. dev.: 0.0023) MultiSource/Applications/SPASS/SPASS: 2.28% (13.8202 => 14.1356, std. dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/football/football: 2.27% (0.8310 => 0.8499, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.11% (0.5637 => 0.5756, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.09% (1.2193 => 1.2448, std. dev.: 0.0025) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.01% (1.1364 => 1.1592, std. dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.94% (1.3245 => 1.3502, std. dev.: 0.0015) MultiSource/Applications/kimwitu++/kc: 1.85% (16.6129 => 16.9195, std. dev.: 0.0067) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.73% (0.7710 => 0.7843, std. dev.: 0.0050) MultiSource/Benchmarks/MallocBench/gs/gs: 1.56% (3.8646 => 3.9248, std. dev.: 0.0090) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.53% (13.2842 => 13.4873, std. dev.: 0.0136) MultiSource/Applications/lambda-0_1_3/lambda: 1.52% (0.7038 => 0.7145, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.46% (0.7460 => 0.7569, std. dev.: 0.0011) MultiSource/Applications/treecc/treecc: 1.42% (1.9270 => 1.9543, std. dev.: 0.0015) MultiSource/Applications/Burg/burg: 1.37% (1.1061 => 1.1213, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.32% (1.3813 => 1.3996, std. dev.: 0.0006) MultiSource/Applications/SIBsim4/SIBsim4: 1.29% (1.2749 => 1.2913, std. dev.: 0.0014) MultiSource/Applications/hbd/hbd: 1.20% (1.3693 => 1.3857, std. dev.: 0.0040) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.06% (1.3819 => 1.3965, std. dev.: 0.0013) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.40% (1.8175 => 2.2610, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/mandel-2: 8.63% (1.2998 => 1.4120, std. dev.: 0.0084) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.86% (1.5824 => 1.6751, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9875, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: 3.73% (7.4271 => 7.7040, std. dev.: 0.0030) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.71% (1.7688 => 1.8344, std. dev.: 0.0187) MultiSource/Benchmarks/nbench/nbench: 3.12% (11.2619 => 11.6134, std. dev.: 0.0020) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4534, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-6: 2.91% (1.9199 => 1.9758, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.83% (8.8259 => 9.0760, std. dev.: 0.0253) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9392, std. dev.: 0.0022) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.35% (7.9275 => 8.1135, std. dev.: 0.0073) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.60% (0.8273 => 0.8405, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.51% (1.4298 => 1.4514, std. dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: 1.43% (8.3908 => 8.5109, std. dev.: 0.0007) MultiSource/Applications/siod/siod: 1.43% (3.2729 => 3.3196, std. dev.: 0.0008) SingleSource/Benchmarks/Dhrystone/fldry: 1.35% (1.9290 => 1.9551, std. dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.27% (2.0200 => 2.0456, std. dev.: 0.0006) SingleSource/Benchmarks/McGill/chomp: 1.19% (1.2308 => 1.2454, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/flops: 1.13% (9.0760 => 9.1787, std. dev.: 0.0015) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -14.04% (0.4657 => 0.4003, std. dev.: 0.0218) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.34% (0.2670 => 0.2474, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.28% (22.5627 => 20.9197, std. dev.: 0.0067) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.41% (0.3511 => 0.3286, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -4.55% (0.3623 => 0.3458, std. dev.: 0.0057) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.52% (0.3650 => 0.3485, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -4.42% (0.3601 => 0.3442, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-4: -4.36% (0.3646 => 0.3487, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -4.36% (0.3578 => 0.3422, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -4.31% (0.3663 => 0.3505, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -4.04% (0.3940 => 0.3781, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -3.85% (0.3789 => 0.3643, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -3.70% (0.4003 => 0.3855, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.38% (0.8818 => 0.8520, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.46% (0.6576 => 0.6414, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/bigfib: -2.26% (0.6250 => 0.6109, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.47% (0.9108 => 0.8974, std. dev.: 0.0007) MultiSource/Applications/lua/lua: -1.31% (3.7467 => 3.6977, std. dev.: 0.0024) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.50% (0.3139 => 0.2935, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.62% (1.3780 => 1.3144, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9622, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -3.98% (2.5089 => 2.4090, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.63% (1.9762 => 1.9044, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: -2.14% (1.1560 => 1.1313, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.97% (6.6320 => 6.5015, std. dev.: 0.0045) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.96% (20.3410 => 19.9425, std. dev.: 0.0605) SingleSource/Benchmarks/Shootout/lists: -1.94% (6.3560 => 6.2330, std. dev.: 0.0074) MultiSource/Applications/minisat/minisat: -1.88% (9.3358 => 9.1600, std. dev.: 0.0345) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6913, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3446, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9955, std. dev.: 0.0002) MultiSource/Applications/lua/lua: -1.58% (26.5159 => 26.0973, std. dev.: 0.0317) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.35% (3.9173 => 3.8646, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.02% (3.8887 => 3.8492, std. dev.: 0.0021) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.32s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed May 23 15:59:14 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 23 May 2012 17:59:14 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120523225914.DA3862A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/769?compare_to=768&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 769, Order: 157342, Start Time: 2012-05-23 22:03:31, End Time: 2012-05-23 23:00:11 To: 768, Order: 157339, Start Time: 2012-05-23 20:40:52, End Time: 2012-05-23 21:37:30 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (51 on baseline) Performance Improvements: 1 (41 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 891 (796 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -6.00% (0.4003 => 0.3763, std. dev.: 0.0092) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 11.91% (2.0176 => 2.2579, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.71% (0.2721 => 0.2822, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.84% (3.9660 => 4.0787, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.60% (0.5265 => 0.5402, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.46% (0.6959 => 0.7130, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.42% (0.9199 => 0.9422, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: 2.27% (0.8310 => 0.8499, std. dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 2.22% (13.8202 => 14.1267, std. dev.: 0.0185) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.18% (0.5637 => 0.5760, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 2.08% (1.0594 => 1.0814, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.03% (1.2193 => 1.2440, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.92% (1.3245 => 1.3499, std. dev.: 0.0020) MultiSource/Applications/kimwitu++/kc: 1.86% (16.6129 => 16.9216, std. dev.: 0.0119) MultiSource/Applications/siod/siod: 1.82% (2.1791 => 2.2188, std. dev.: 0.0048) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.80% (1.1364 => 1.1569, std. dev.: 0.0075) MultiSource/Benchmarks/MallocBench/gs/gs: 1.77% (3.8646 => 3.9329, std. dev.: 0.0036) MultiSource/Applications/lambda-0_1_3/lambda: 1.71% (0.7038 => 0.7158, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.62% (0.7710 => 0.7835, std. dev.: 0.0012) MultiSource/Applications/Burg/burg: 1.59% (1.1061 => 1.1237, std. dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.54% (13.2842 => 13.4888, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.49% (1.3819 => 1.4025, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.46% (1.4563 => 1.4775, std. dev.: 0.0013) MultiSource/Applications/treecc/treecc: 1.43% (1.9270 => 1.9546, std. dev.: 0.0025) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.37% (0.7460 => 0.7562, std. dev.: 0.0017) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.26% (1.3813 => 1.3987, std. dev.: 0.0017) MultiSource/Applications/hbd/hbd: 1.14% (1.3693 => 1.3849, std. dev.: 0.0023) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.15% (1.8175 => 2.2565, std. dev.: 0.0168) SingleSource/Benchmarks/Misc/mandel-2: 7.42% (1.2998 => 1.3962, std. dev.: 0.0124) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6755, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8146, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9876, std. dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.68% (1.7688 => 1.8339, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: 3.48% (7.4271 => 7.6855, std. dev.: 0.0122) MultiSource/Benchmarks/nbench/nbench: 3.17% (11.2619 => 11.6186, std. dev.: 0.0015) MultiSource/Applications/hexxagon/hexxagon: 3.01% (12.0921 => 12.4557, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.96% (8.8259 => 9.0873, std. dev.: 0.0062) SingleSource/Benchmarks/Misc/flops-6: 2.90% (1.9199 => 1.9756, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.74% (2.8606 => 2.9390, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.69% (7.9275 => 8.1406, std. dev.: 0.0073) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.61% (0.8273 => 0.8406, std. dev.: 0.0015) MultiSource/Applications/siod/siod: 1.48% (3.2729 => 3.3215, std. dev.: 0.0018) MultiSource/Applications/lemon/lemon: 1.48% (1.4298 => 1.4509, std. dev.: 0.0007) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5082, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.28% (2.0200 => 2.0458, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 1.15% (1.2308 => 1.2450, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1778, std. dev.: 0.0012) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -19.20% (0.4657 => 0.3763, std. dev.: 0.0092) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.19% (22.5627 => 20.9414, std. dev.: 0.0162) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.82% (0.2670 => 0.2488, std. dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.64% (0.3511 => 0.3278, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.75% (0.8818 => 0.8487, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -3.64% (0.3623 => 0.3491, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.56% (0.3650 => 0.3520, std. dev.: 0.0032) SingleSource/UnitTests/ObjC/exceptions-2: -3.50% (0.3601 => 0.3475, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -3.48% (0.3646 => 0.3519, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -3.47% (0.3663 => 0.3536, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -3.38% (0.3578 => 0.3457, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/property: -3.12% (0.3940 => 0.3817, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -3.01% (0.3914 => 0.3796, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.87% (0.6576 => 0.6387, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: -2.85% (0.3789 => 0.3681, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -2.85% (0.4003 => 0.3889, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: -2.40% (0.6250 => 0.6100, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.68% (0.9108 => 0.8955, std. dev.: 0.0007) MultiSource/Applications/lua/lua: -1.22% (3.7467 => 3.7011, std. dev.: 0.0030) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.56% (0.3139 => 0.2933, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0003) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9623, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.18% (1.3780 => 1.3204, std. dev.: 0.0024) SingleSource/Benchmarks/Dhrystone/dry: -4.01% (2.5089 => 2.4083, std. dev.: 0.0041) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -3.63% (1.9762 => 1.9044, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout/lists: -2.13% (6.3560 => 6.2203, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/richards_benchmark: -2.13% (1.1560 => 1.1314, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.03% (20.3410 => 19.9272, std. dev.: 0.0531) MultiSource/Benchmarks/mafft/pairlocalalign: -1.89% (28.2225 => 27.6903, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.88% (6.6320 => 6.5073, std. dev.: 0.0048) MultiSource/Applications/minisat/minisat: -1.86% (9.3358 => 9.1619, std. dev.: 0.0133) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3444, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9953, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.53% (3.9173 => 3.8574, std. dev.: 0.0050) MultiSource/Applications/lua/lua: -1.30% (26.5159 => 26.1703, std. dev.: 0.0232) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.04% (3.8887 => 3.8484, std. dev.: 0.0033) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.52s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed May 23 17:21:51 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 23 May 2012 19:21:51 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120524002151.CCA592A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/770?compare_to=769&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 770, Order: 157354, Start Time: 2012-05-23 23:26:14, End Time: 2012-05-24 00:22:48 To: 769, Order: 157342, Start Time: 2012-05-23 22:03:31, End Time: 2012-05-23 23:00:11 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (49 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (799 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.22% (2.0176 => 2.2642, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.13% (0.3130 => 0.3322, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.76% (3.9660 => 4.0756, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.41% (0.6959 => 0.7127, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.39% (0.9199 => 0.9419, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.30% (0.5265 => 0.5386, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/football/football: 2.07% (0.8310 => 0.8482, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.05% (0.7710 => 0.7868, std. dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 2.04% (13.8202 => 14.1027, std. dev.: 0.0143) MultiSource/Benchmarks/nbench/nbench: 2.04% (1.0594 => 1.0810, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.93% (1.3245 => 1.3501, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.90% (0.5637 => 0.5744, std. dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: 1.83% (16.6129 => 16.9168, std. dev.: 0.0258) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.76% (1.2193 => 1.2408, std. dev.: 0.0010) MultiSource/Applications/siod/siod: 1.76% (2.1791 => 2.2174, std. dev.: 0.0031) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.72% (1.1364 => 1.1559, std. dev.: 0.0012) MultiSource/Applications/lambda-0_1_3/lambda: 1.69% (0.7038 => 0.7157, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/gs/gs: 1.53% (3.8646 => 3.9238, std. dev.: 0.0071) MultiSource/Applications/hbd/hbd: 1.48% (1.3693 => 1.3896, std. dev.: 0.0065) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.33% (1.4563 => 1.4756, std. dev.: 0.0022) MultiSource/Applications/Burg/burg: 1.32% (1.1061 => 1.1207, std. dev.: 0.0043) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.27% (13.2842 => 13.4530, std. dev.: 0.0046) MultiSource/Applications/treecc/treecc: 1.22% (1.9270 => 1.9505, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.18% (1.3819 => 1.3982, std. dev.: 0.0026) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.08% (1.8175 => 2.2552, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/mandel-2: 7.89% (1.2998 => 1.4023, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.89% (1.5824 => 1.6756, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9877, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: 3.77% (7.4271 => 7.7069, std. dev.: 0.0035) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.71% (1.7688 => 1.8344, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 3.11% (11.2619 => 11.6119, std. dev.: 0.0036) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4532, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-6: 2.92% (1.9199 => 1.9760, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.81% (8.8259 => 9.0739, std. dev.: 0.0084) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9393, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.50% (7.9275 => 8.1258, std. dev.: 0.0062) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.61% (0.8273 => 0.8406, std. dev.: 0.0012) MultiSource/Applications/siod/siod: 1.49% (3.2729 => 3.3216, std. dev.: 0.0017) MultiSource/Applications/lemon/lemon: 1.47% (1.4298 => 1.4508, std. dev.: 0.0031) SingleSource/Benchmarks/Dhrystone/fldry: 1.44% (1.9290 => 1.9568, std. dev.: 0.0016) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5085, std. dev.: 0.0021) MultiSource/Benchmarks/sim/sim: 1.37% (5.0168 => 5.0854, std. dev.: 0.0052) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.29% (2.0200 => 2.0460, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1777, std. dev.: 0.0006) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -17.22% (0.4657 => 0.3855, std. dev.: 0.0136) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.26% (22.5627 => 20.9256, std. dev.: 0.0225) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.78% (0.2670 => 0.2489, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.64% (0.3511 => 0.3278, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-3: -4.86% (0.3623 => 0.3447, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.77% (0.3650 => 0.3476, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -4.75% (0.3601 => 0.3430, std. dev.: 0.0028) SingleSource/UnitTests/ObjC/synchronized: -4.72% (0.3663 => 0.3490, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -4.69% (0.3646 => 0.3475, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -4.67% (0.3578 => 0.3411, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -4.31% (0.3940 => 0.3770, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -4.25% (0.3789 => 0.3628, std. dev.: 0.0031) SingleSource/UnitTests/ObjC/exceptions: -4.14% (0.3914 => 0.3752, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -3.97% (0.4003 => 0.3844, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.89% (0.8818 => 0.8475, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.92% (0.6576 => 0.6384, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/bigfib: -2.29% (0.6250 => 0.6107, std. dev.: 0.0003) MultiSource/Applications/lua/lua: -1.41% (3.7467 => 3.6940, std. dev.: 0.0026) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.23% (6.2785 => 6.2013, std. dev.: 0.0124) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.16% (1.0460 => 0.9502, std. dev.: 0.0011) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.53% (0.3139 => 0.2934, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.78% (1.3780 => 1.3121, std. dev.: 0.0036) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9622, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -3.97% (2.5089 => 2.4094, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.73% (0.3458 => 0.3329, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: -3.60% (1.9762 => 1.9050, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/richards_benchmark: -2.15% (1.1560 => 1.1312, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -2.01% (6.6320 => 6.4984, std. dev.: 0.0080) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.96% (20.3410 => 19.9423, std. dev.: 0.0426) SingleSource/Benchmarks/Shootout/lists: -1.95% (6.3560 => 6.2322, std. dev.: 0.0070) MultiSource/Applications/minisat/minisat: -1.89% (9.3358 => 9.1593, std. dev.: 0.0078) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6908, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3446, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9953, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) MultiSource/Applications/lua/lua: -1.38% (26.5159 => 26.1498, std. dev.: 0.0296) SingleSource/Benchmarks/Shootout/heapsort: -1.32% (3.9173 => 3.8657, std. dev.: 0.0159) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.24s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed May 23 18:44:30 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 23 May 2012 20:44:30 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120524014430.20E722A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/771?compare_to=770&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 771, Order: 157359, Start Time: 2012-05-24 00:48:52, End Time: 2012-05-24 01:45:26 To: 770, Order: 157354, Start Time: 2012-05-23 23:26:14, End Time: 2012-05-24 00:22:48 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (44 on baseline) Performance Improvements: 0 (42 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (802 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 11.24% (2.0176 => 2.2444, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.69% (0.3130 => 0.3308, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.37% (3.9660 => 4.0598, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.02% (0.9199 => 0.9385, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.91% (0.6959 => 0.7092, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/football/football: 1.84% (0.8310 => 0.8463, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 1.72% (13.8202 => 14.0584, std. dev.: 0.0046) MultiSource/Benchmarks/nbench/nbench: 1.72% (1.0594 => 1.0776, std. dev.: 0.0032) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.46% (1.1364 => 1.1530, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.44% (1.2193 => 1.2368, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.40% (1.3245 => 1.3431, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 1.40% (2.1791 => 2.2097, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.18% (13.2842 => 13.4414, std. dev.: 0.0091) MultiSource/Benchmarks/MallocBench/gs/gs: 1.18% (3.8646 => 3.9102, std. dev.: 0.0083) MultiSource/Applications/kimwitu++/kc: 1.16% (16.6129 => 16.8055, std. dev.: 0.0146) MultiSource/Applications/Burg/burg: 1.15% (1.1061 => 1.1188, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.11% (1.4563 => 1.4725, std. dev.: 0.0027) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 23.94% (1.8175 => 2.2526, std. dev.: 0.0068) SingleSource/Benchmarks/Misc/mandel-2: 7.93% (1.2998 => 1.4029, std. dev.: 0.0103) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7298, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.87% (1.5824 => 1.6753, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9877, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.72% (1.7688 => 1.8346, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: 3.62% (7.4271 => 7.6960, std. dev.: 0.0062) MultiSource/Benchmarks/nbench/nbench: 3.11% (11.2619 => 11.6127, std. dev.: 0.0028) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4554, std. dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.98% (8.8259 => 9.0885, std. dev.: 0.0114) SingleSource/Benchmarks/Misc/flops-6: 2.86% (1.9199 => 1.9749, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.74% (2.8606 => 2.9391, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.29% (7.9275 => 8.1092, std. dev.: 0.0132) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.60% (0.8273 => 0.8405, std. dev.: 0.0007) MultiSource/Applications/siod/siod: 1.45% (3.2729 => 3.3203, std. dev.: 0.0078) MultiSource/Applications/lemon/lemon: 1.41% (1.4298 => 1.4499, std. dev.: 0.0007) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5086, std. dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.27% (2.0200 => 2.0457, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2139, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1781, std. dev.: 0.0013) MultiSource/Benchmarks/sim/sim: 1.10% (5.0168 => 5.0721, std. dev.: 0.0061) SingleSource/Benchmarks/McGill/chomp: 1.09% (1.2308 => 1.2442, std. dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.06% (1.9433 => 1.9639, std. dev.: 0.0019) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -22.70% (0.4657 => 0.3600, std. dev.: 0.0141) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.64% (22.5627 => 20.8388, std. dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.06% (0.3511 => 0.3263, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.00% (0.2670 => 0.2483, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-3: -5.47% (0.3623 => 0.3425, std. dev.: 0.0039) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.40% (0.3650 => 0.3453, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/trivial-interface: -5.31% (0.3578 => 0.3388, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -5.30% (0.3663 => 0.3469, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -5.19% (0.3601 => 0.3414, std. dev.: 0.0019) SingleSource/UnitTests/ObjC/exceptions-4: -5.07% (0.3646 => 0.3461, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/property: -4.92% (0.3940 => 0.3746, std. dev.: 0.0034) SingleSource/UnitTests/ObjC/exceptions: -4.75% (0.3914 => 0.3728, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -4.65% (0.4003 => 0.3817, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/for-in: -4.59% (0.3789 => 0.3615, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -4.01% (0.8818 => 0.8464, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: -2.78% (0.6250 => 0.6076, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.69% (0.6576 => 0.6399, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -2.24% (0.9108 => 0.8904, std. dev.: 0.0006) MultiSource/Applications/lua/lua: -1.71% (3.7467 => 3.6826, std. dev.: 0.0109) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.52% (6.2785 => 6.1829, std. dev.: 0.0071) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.01% (4.9865 => 4.9362, std. dev.: 0.0192) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.56% (0.3139 => 0.2933, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.02% (1.3780 => 1.3088, std. dev.: 0.0062) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9624, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.99% (2.5089 => 2.4089, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0011) MultiSource/Benchmarks/Olden/bh/bh: -3.62% (1.9762 => 1.9046, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout/lists: -2.33% (6.3560 => 6.2079, std. dev.: 0.0143) SingleSource/Benchmarks/Misc/richards_benchmark: -2.14% (1.1560 => 1.1313, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6910, std. dev.: 0.0013) MultiSource/Applications/minisat/minisat: -1.84% (9.3358 => 9.1636, std. dev.: 0.0148) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.84% (6.6320 => 6.5099, std. dev.: 0.0038) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.80% (20.3410 => 19.9744, std. dev.: 0.0342) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3446, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9957, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) MultiSource/Applications/lua/lua: -1.26% (26.5159 => 26.1811, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout/heapsort: -1.17% (3.9173 => 3.8715, std. dev.: 0.0017) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.53s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed May 23 20:07:00 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 23 May 2012 22:07:00 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120524030700.4837E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/772?compare_to=771&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 772, Order: 157362, Start Time: 2012-05-24 02:11:28, End Time: 2012-05-24 03:07:56 To: 771, Order: 157359, Start Time: 2012-05-24 00:48:52, End Time: 2012-05-24 01:45:26 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (49 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 891 (799 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 11.72% (0.3600 => 0.4022, std. dev.: 0.0102) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.05% (2.0176 => 2.2607, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.97% (0.3130 => 0.3317, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.71% (0.2721 => 0.2822, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.77% (3.9660 => 4.0757, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.37% (0.5265 => 0.5390, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.32% (0.9199 => 0.9412, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 2.25% (1.0594 => 1.0832, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 2.24% (0.8310 => 0.8496, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.18% (0.6959 => 0.7111, std. dev.: 0.0041) MultiSource/Applications/SPASS/SPASS: 2.13% (13.8202 => 14.1141, std. dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.04% (0.5637 => 0.5752, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.89% (1.2193 => 1.2423, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.85% (1.3245 => 1.3490, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.78% (1.1364 => 1.1566, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.74% (0.7710 => 0.7844, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.50% (13.2842 => 13.4830, std. dev.: 0.0069) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.49% (1.4563 => 1.4780, std. dev.: 0.0022) MultiSource/Applications/siod/siod: 1.27% (2.1791 => 2.2068, std. dev.: 0.0053) MultiSource/Applications/treecc/treecc: 1.18% (1.9270 => 1.9498, std. dev.: 0.0005) MultiSource/Applications/Burg/burg: 1.18% (1.1061 => 1.1191, std. dev.: 0.0030) MultiSource/Benchmarks/MallocBench/gs/gs: 1.15% (3.8646 => 3.9089, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.05% (1.3819 => 1.3964, std. dev.: 0.0010) MultiSource/Applications/kimwitu++/kc: 1.05% (16.6129 => 16.7870, std. dev.: 0.0131) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.01% (1.8175 => 2.2539, std. dev.: 0.0289) SingleSource/Benchmarks/Misc/mandel-2: 7.65% (1.2998 => 1.3992, std. dev.: 0.0141) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.90% (1.5824 => 1.6757, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8146, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.81% (1.9144 => 1.9873, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.70% (1.7688 => 1.8343, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: 3.65% (7.4271 => 7.6984, std. dev.: 0.0047) MultiSource/Benchmarks/nbench/nbench: 3.12% (11.2619 => 11.6128, std. dev.: 0.0042) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4545, std. dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.93% (8.8259 => 9.0848, std. dev.: 0.0091) SingleSource/Benchmarks/Misc/flops-6: 2.88% (1.9199 => 1.9751, std. dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.76% (2.8606 => 2.9395, std. dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.35% (7.9275 => 8.1136, std. dev.: 0.0139) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.61% (0.8273 => 0.8406, std. dev.: 0.0014) MultiSource/Applications/lemon/lemon: 1.50% (1.4298 => 1.4512, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: 1.49% (1.9290 => 1.9577, std. dev.: 0.0012) MultiSource/Applications/siod/siod: 1.48% (3.2729 => 3.3215, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5102, std. dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.27% (2.0200 => 2.0457, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 1.16% (5.0168 => 5.0749, std. dev.: 0.0055) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.15% (1.9433 => 1.9657, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1777, std. dev.: 0.0011) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -13.64% (0.4657 => 0.4022, std. dev.: 0.0102) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.33% (22.5627 => 20.9096, std. dev.: 0.0153) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.74% (0.2670 => 0.2490, std. dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.47% (0.3511 => 0.3284, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -4.31% (0.3623 => 0.3467, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.22% (0.3650 => 0.3496, std. dev.: 0.0023) SingleSource/UnitTests/ObjC/exceptions-2: -4.17% (0.3601 => 0.3451, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -4.15% (0.3663 => 0.3511, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -4.14% (0.3646 => 0.3495, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -4.14% (0.3578 => 0.3430, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -3.98% (0.3940 => 0.3783, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -3.82% (0.4003 => 0.3850, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -3.78% (0.3914 => 0.3766, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -3.67% (0.3789 => 0.3650, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.45% (0.8818 => 0.8514, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.68% (0.6576 => 0.6400, std. dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/bigfib: -2.64% (0.6250 => 0.6085, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.77% (0.9108 => 0.8947, std. dev.: 0.0004) MultiSource/Applications/lua/lua: -1.59% (3.7467 => 3.6873, std. dev.: 0.0068) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.59% (0.3139 => 0.2932, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.01% (1.3780 => 1.3089, std. dev.: 0.0200) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9624, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -4.04% (2.5089 => 2.4076, std. dev.: 0.0042) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -3.63% (1.9762 => 1.9045, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/lists: -2.20% (6.3560 => 6.2159, std. dev.: 0.0094) SingleSource/Benchmarks/Misc/richards_benchmark: -2.15% (1.1560 => 1.1312, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: -2.03% (9.3358 => 9.1465, std. dev.: 0.0082) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.98% (6.6320 => 6.5009, std. dev.: 0.0022) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6911, std. dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.77% (20.3410 => 19.9805, std. dev.: 0.0454) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9951, std. dev.: 0.0005) MultiSource/Applications/lua/lua: -1.57% (26.5159 => 26.0989, std. dev.: 0.0108) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/heapsort: -1.43% (3.9173 => 3.8611, std. dev.: 0.0032) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.26s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed May 23 22:30:38 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 24 May 2012 00:30:38 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120524053038.0F9182A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/773?compare_to=772&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 773, Order: 157367, Start Time: 2012-05-24 04:35:02, End Time: 2012-05-24 05:31:34 To: 772, Order: 157362, Start Time: 2012-05-24 02:11:28, End Time: 2012-05-24 03:07:56 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (49 on baseline) Performance Improvements: 0 (41 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (798 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 11.72% (2.0176 => 2.2540, std. dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.94% (0.3130 => 0.3316, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.82% (0.2721 => 0.2825, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.65% (3.9660 => 4.0711, std. dev.: 0.0171) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.41% (0.5265 => 0.5392, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.26% (0.9199 => 0.9407, std. dev.: 0.0030) MultiSource/Benchmarks/nbench/nbench: 2.20% (1.0594 => 1.0827, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.13% (0.6959 => 0.7107, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.11% (0.5637 => 0.5756, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/football/football: 2.09% (0.8310 => 0.8484, std. dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 2.01% (13.8202 => 14.0978, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.94% (1.2193 => 1.2430, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.80% (1.1364 => 1.1569, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.75% (1.3245 => 1.3477, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.66% (0.7710 => 0.7838, std. dev.: 0.0017) MultiSource/Benchmarks/MallocBench/gs/gs: 1.46% (3.8646 => 3.9211, std. dev.: 0.0047) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.44% (13.2842 => 13.4756, std. dev.: 0.0144) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.41% (1.4563 => 1.4768, std. dev.: 0.0026) MultiSource/Applications/siod/siod: 1.27% (2.1791 => 2.2067, std. dev.: 0.0006) MultiSource/Applications/treecc/treecc: 1.20% (1.9270 => 1.9502, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.11% (1.3819 => 1.3973, std. dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: 1.02% (16.6129 => 16.7823, std. dev.: 0.0224) MultiSource/Applications/hbd/hbd: 1.01% (1.3693 => 1.3831, std. dev.: 0.0019) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.23% (1.8175 => 2.2579, std. dev.: 0.0267) SingleSource/Benchmarks/Misc/mandel-2: 7.88% (1.2998 => 1.4022, std. dev.: 0.0051) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7298, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.87% (1.5824 => 1.6753, std. dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8146, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9876, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.66% (1.7688 => 1.8336, std. dev.: 0.0059) SingleSource/Benchmarks/Misc/salsa20: 3.59% (7.4271 => 7.6937, std. dev.: 0.0057) MultiSource/Benchmarks/nbench/nbench: 3.11% (11.2619 => 11.6124, std. dev.: 0.0014) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4541, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: 2.87% (1.9199 => 1.9750, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.76% (2.8606 => 2.9396, std. dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.56% (8.8259 => 9.0515, std. dev.: 0.0219) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.44% (7.9275 => 8.1206, std. dev.: 0.0132) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.60% (1.9290 => 1.9599, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 1.60% (0.8273 => 0.8405, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 1.48% (3.2729 => 3.3214, std. dev.: 0.0008) MultiSource/Applications/lemon/lemon: 1.47% (1.4298 => 1.4508, std. dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: 1.43% (8.3908 => 8.5106, std. dev.: 0.0081) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.29% (2.0200 => 2.0461, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.20% (1.9433 => 1.9666, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1773, std. dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: 1.08% (1.2308 => 1.2441, std. dev.: 0.0027) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -19.39% (0.4657 => 0.3754, std. dev.: 0.0133) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.37% (22.5627 => 20.8999, std. dev.: 0.0055) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.55% (0.3511 => 0.3281, std. dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.33% (0.2670 => 0.2501, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.71% (0.3650 => 0.3478, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -4.61% (0.3623 => 0.3456, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -4.58% (0.3601 => 0.3436, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/synchronized: -4.53% (0.3663 => 0.3497, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -4.53% (0.3646 => 0.3481, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -4.50% (0.3578 => 0.3417, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -4.37% (0.3940 => 0.3768, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -4.09% (0.3789 => 0.3634, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -4.09% (0.3914 => 0.3754, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -4.07% (0.4003 => 0.3840, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.21% (0.8818 => 0.8535, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: -2.50% (0.6250 => 0.6094, std. dev.: 0.0041) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.25% (0.6576 => 0.6428, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: -1.81% (0.5748 => 0.5644, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.69% (0.9108 => 0.8954, std. dev.: 0.0002) MultiSource/Applications/lua/lua: -1.56% (3.7467 => 3.6884, std. dev.: 0.0023) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.56% (0.3139 => 0.2933, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.92% (1.3780 => 1.3102, std. dev.: 0.0037) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9622, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -4.01% (2.5089 => 2.4082, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.64% (0.3458 => 0.3332, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.60% (1.9762 => 1.9050, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/lists: -2.19% (6.3560 => 6.2169, std. dev.: 0.0057) SingleSource/Benchmarks/Misc/richards_benchmark: -2.15% (1.1560 => 1.1312, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: -2.03% (9.3358 => 9.1461, std. dev.: 0.0287) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -2.01% (6.6320 => 6.4986, std. dev.: 0.0059) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.96% (20.3410 => 19.9430, std. dev.: 0.0276) MultiSource/Benchmarks/mafft/pairlocalalign: -1.87% (28.2225 => 27.6935, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9958, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.55% (3.9173 => 3.8564, std. dev.: 0.0052) MultiSource/Applications/lua/lua: -1.51% (26.5159 => 26.1165, std. dev.: 0.0281) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.43s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed May 23 23:53:36 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 24 May 2012 01:53:36 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120524065336.4B1792A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/774?compare_to=773&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 774, Order: 157373, Start Time: 2012-05-24 05:57:39, End Time: 2012-05-24 06:54:33 To: 773, Order: 157367, Start Time: 2012-05-24 04:35:02, End Time: 2012-05-24 05:31:34 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (38 on baseline) Performance Improvements: 0 (42 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (808 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.01% (2.0176 => 2.2599, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.62% (0.3130 => 0.3306, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.40% (3.9660 => 4.0610, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.01% (0.5265 => 0.5371, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.96% (0.9199 => 0.9379, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.87% (0.6959 => 0.7089, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.77% (0.5637 => 0.5737, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.66% (1.2193 => 1.2396, std. dev.: 0.0060) MultiSource/Applications/SPASS/SPASS: 1.65% (13.8202 => 14.0477, std. dev.: 0.0064) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.50% (1.1364 => 1.1535, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.41% (1.3245 => 1.3432, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.15% (13.2842 => 13.4365, std. dev.: 0.0179) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.11% (1.4563 => 1.4725, std. dev.: 0.0012) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.12% (1.8175 => 2.2558, std. dev.: 0.0242) SingleSource/Benchmarks/Misc/mandel-2: 8.87% (1.2998 => 1.4151, std. dev.: 0.0058) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.52% (2.5629 => 2.7299, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.90% (1.5824 => 1.6758, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8146, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9879, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.66% (1.7688 => 1.8336, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/salsa20: 3.62% (7.4271 => 7.6956, std. dev.: 0.0098) MultiSource/Benchmarks/nbench/nbench: 3.14% (11.2619 => 11.6155, std. dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4538, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.91% (8.8259 => 9.0826, std. dev.: 0.0172) SingleSource/Benchmarks/Misc/flops-6: 2.89% (1.9199 => 1.9754, std. dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.76% (2.8606 => 2.9395, std. dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.46% (7.9275 => 8.1229, std. dev.: 0.0063) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.61% (0.8273 => 0.8406, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 1.48% (3.2729 => 3.3212, std. dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: 1.43% (8.3908 => 8.5111, std. dev.: 0.0026) MultiSource/Applications/lemon/lemon: 1.39% (1.4298 => 1.4497, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.26% (2.0200 => 2.0455, std. dev.: 0.0005) MultiSource/Benchmarks/sim/sim: 1.19% (5.0168 => 5.0764, std. dev.: 0.0080) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/flops: 1.13% (9.0760 => 9.1783, std. dev.: 0.0009) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.68% (22.5627 => 20.8306, std. dev.: 0.0082) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.98% (0.3511 => 0.3266, std. dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.89% (0.2670 => 0.2486, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -5.27% (0.3623 => 0.3432, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -5.13% (0.3663 => 0.3475, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -5.11% (0.3578 => 0.3395, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -5.11% (0.3601 => 0.3417, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -5.07% (0.3646 => 0.3461, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.99% (0.3650 => 0.3468, std. dev.: 0.0032) SingleSource/UnitTests/ObjC/property: -4.90% (0.3940 => 0.3747, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -4.57% (0.4003 => 0.3820, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -4.57% (0.3789 => 0.3616, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -4.55% (0.3914 => 0.3736, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.84% (0.8818 => 0.8479, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.97% (0.6576 => 0.6381, std. dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/bigfib: -2.69% (0.6250 => 0.6082, std. dev.: 0.0053) MultiSource/Benchmarks/FreeBench/pifft/pifft: -2.06% (0.9108 => 0.8920, std. dev.: 0.0000) MultiSource/Applications/lua/lua: -1.94% (3.7467 => 3.6741, std. dev.: 0.0119) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.35% (6.2785 => 6.1938, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.12% (4.9865 => 4.9309, std. dev.: 0.0129) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.53% (0.3139 => 0.2934, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.91% (1.3780 => 1.3104, std. dev.: 0.0056) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9622, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -4.01% (2.5089 => 2.4083, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.67% (0.3458 => 0.3331, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.61% (1.9762 => 1.9048, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/lists: -2.28% (6.3560 => 6.2109, std. dev.: 0.0085) SingleSource/Benchmarks/Misc/richards_benchmark: -2.16% (1.1560 => 1.1310, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: -1.89% (28.2225 => 27.6902, std. dev.: 0.0022) MultiSource/Applications/minisat/minisat: -1.89% (9.3358 => 9.1598, std. dev.: 0.0037) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.85% (6.6320 => 6.5090, std. dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.80% (20.3410 => 19.9750, std. dev.: 0.0525) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3446, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9953, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.56% (0.9692 => 0.9541, std. dev.: 0.0000) MultiSource/Applications/lua/lua: -1.44% (26.5159 => 26.1344, std. dev.: 0.0206) SingleSource/Benchmarks/Shootout/heapsort: -1.36% (3.9173 => 3.8641, std. dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.01% (3.8887 => 3.8493, std. dev.: 0.0026) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.52s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu May 24 01:20:25 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 24 May 2012 03:20:25 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120524082025.C8FB92A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/775?compare_to=774&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 775, Order: 157379, Start Time: 2012-05-24 07:24:36, End Time: 2012-05-24 08:21:22 To: 774, Order: 157373, Start Time: 2012-05-24 05:57:39, End Time: 2012-05-24 06:54:33 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (45 on baseline) Performance Improvements: 0 (42 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 891 (801 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 1.73% (7.9425 => 8.0796, std. dev.: 0.0228) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.00% (2.0176 => 2.2597, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.72% (0.3130 => 0.3309, std. dev.: 0.0038) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.51% (3.9660 => 4.0656, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.22% (0.5265 => 0.5382, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.20% (0.9199 => 0.9401, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.16% (0.6959 => 0.7109, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/football/football: 2.07% (0.8310 => 0.8482, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 1.99% (1.0594 => 1.0805, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.88% (0.5637 => 0.5743, std. dev.: 0.0027) MultiSource/Applications/SPASS/SPASS: 1.77% (13.8202 => 14.0643, std. dev.: 0.0045) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.67% (0.7710 => 0.7839, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.67% (1.2193 => 1.2397, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.62% (1.3245 => 1.3460, std. dev.: 0.0027) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.60% (1.1364 => 1.1546, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 1.51% (2.1791 => 2.2120, std. dev.: 0.0037) MultiSource/Applications/Burg/burg: 1.22% (1.1061 => 1.1196, std. dev.: 0.0030) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.19% (1.4563 => 1.4736, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.14% (13.2842 => 13.4351, std. dev.: 0.0130) MultiSource/Benchmarks/MallocBench/gs/gs: 1.10% (3.8646 => 3.9070, std. dev.: 0.0031) MultiSource/Applications/kimwitu++/kc: 1.06% (16.6129 => 16.7890, std. dev.: 0.0071) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 23.68% (1.8175 => 2.2479, std. dev.: 0.0045) SingleSource/Benchmarks/Misc/mandel-2: 8.01% (1.2998 => 1.4039, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/flops-4: 6.52% (1.0640 => 1.1334, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6755, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9880, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: 3.69% (7.4271 => 7.7010, std. dev.: 0.0051) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.61% (1.7688 => 1.8327, std. dev.: 0.0014) MultiSource/Benchmarks/nbench/nbench: 3.11% (11.2619 => 11.6122, std. dev.: 0.0025) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 3.04% (8.8259 => 9.0938, std. dev.: 0.0041) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4538, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-6: 2.89% (1.9199 => 1.9753, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.76% (2.8606 => 2.9396, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.26% (7.9275 => 8.1066, std. dev.: 0.0168) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.57% (0.8273 => 0.8403, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.48% (1.4298 => 1.4509, std. dev.: 0.0007) MultiSource/Applications/siod/siod: 1.44% (3.2729 => 3.3200, std. dev.: 0.0007) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5101, std. dev.: 0.0007) SingleSource/Benchmarks/Dhrystone/fldry: 1.30% (1.9290 => 1.9540, std. dev.: 0.0029) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.28% (2.0200 => 2.0458, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 1.13% (9.0760 => 9.1789, std. dev.: 0.0012) MultiSource/Benchmarks/sim/sim: 1.04% (5.0168 => 5.0692, std. dev.: 0.0023) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.55% (22.5627 => 20.8603, std. dev.: 0.0103) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.89% (0.2670 => 0.2486, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.24% (0.3511 => 0.3292, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-3: -5.13% (0.3623 => 0.3437, std. dev.: 0.0031) SingleSource/UnitTests/ObjC/exceptions-2: -5.11% (0.3601 => 0.3417, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.10% (0.3650 => 0.3464, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/synchronized: -5.02% (0.3663 => 0.3479, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -4.99% (0.3646 => 0.3464, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -4.95% (0.3578 => 0.3401, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -4.70% (0.3940 => 0.3755, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -4.47% (0.3914 => 0.3739, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -4.46% (0.3789 => 0.3620, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -4.37% (0.4003 => 0.3828, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.53% (0.8818 => 0.8507, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.97% (0.6576 => 0.6381, std. dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/bigfib: -2.56% (0.6250 => 0.6090, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.81% (0.9108 => 0.8943, std. dev.: 0.0000) MultiSource/Applications/lua/lua: -1.73% (3.7467 => 3.6818, std. dev.: 0.0109) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.16% (6.2785 => 6.2058, std. dev.: 0.0029) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.06% (4.9865 => 4.9336, std. dev.: 0.0039) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.56% (0.3139 => 0.2933, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.33% (1.3780 => 1.3046, std. dev.: 0.0051) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9622, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -4.05% (2.5089 => 2.4072, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.68% (1.9762 => 1.9034, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/richards_benchmark: -2.14% (1.1560 => 1.1313, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -2.12% (6.3560 => 6.2210, std. dev.: 0.0028) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -2.00% (6.6320 => 6.4991, std. dev.: 0.0068) MultiSource/Applications/minisat/minisat: -1.97% (9.3358 => 9.1520, std. dev.: 0.0119) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.94% (20.3410 => 19.9473, std. dev.: 0.0423) MultiSource/Benchmarks/mafft/pairlocalalign: -1.89% (28.2225 => 27.6898, std. dev.: 0.0103) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9956, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.46% (3.9173 => 3.8603, std. dev.: 0.0113) MultiSource/Applications/lua/lua: -1.40% (26.5159 => 26.1434, std. dev.: 0.0545) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.07% (3.8887 => 3.8469, std. dev.: 0.0023) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.52s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu May 24 02:43:21 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 24 May 2012 04:43:21 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120524094321.892422A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/776?compare_to=775&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 776, Order: 157381, Start Time: 2012-05-24 08:47:45, End Time: 2012-05-24 09:44:18 To: 775, Order: 157379, Start Time: 2012-05-24 07:24:36, End Time: 2012-05-24 08:21:22 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (42 on baseline) Performance Improvements: 0 (42 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 891 (804 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 1.55% (3.7663 => 3.8246, std. dev.: 0.0146) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 11.63% (2.0176 => 2.2522, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.53% (0.3130 => 0.3303, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.25% (3.9660 => 4.0552, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.04% (0.6959 => 0.7101, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.01% (0.9199 => 0.9384, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 1.98% (0.5265 => 0.5369, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/football/football: 1.87% (0.8310 => 0.8465, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 1.78% (1.0594 => 1.0783, std. dev.: 0.0019) MultiSource/Applications/SPASS/SPASS: 1.50% (13.8202 => 14.0279, std. dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.46% (1.3245 => 1.3438, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.44% (1.2193 => 1.2368, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.42% (1.1364 => 1.1525, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.34% (0.7710 => 0.7813, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.12% (1.4563 => 1.4726, std. dev.: 0.0014) MultiSource/Applications/siod/siod: 1.03% (2.1791 => 2.2016, std. dev.: 0.0055) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.15% (1.8175 => 2.2565, std. dev.: 0.0460) SingleSource/Benchmarks/Misc/mandel-2: 7.77% (1.2998 => 1.4008, std. dev.: 0.0055) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7298, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6754, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9878, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.74% (1.7688 => 1.8349, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 3.59% (7.4271 => 7.6939, std. dev.: 0.0050) MultiSource/Benchmarks/nbench/nbench: 3.14% (11.2619 => 11.6154, std. dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4550, std. dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.90% (8.8259 => 9.0815, std. dev.: 0.0074) SingleSource/Benchmarks/Misc/flops-6: 2.85% (1.9199 => 1.9746, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9393, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.24% (7.9275 => 8.1052, std. dev.: 0.0165) SingleSource/Benchmarks/Dhrystone/fldry: 1.60% (1.9290 => 1.9599, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/ffbench: 1.60% (0.8273 => 0.8405, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 1.48% (3.2729 => 3.3214, std. dev.: 0.0023) MultiSource/Applications/lemon/lemon: 1.42% (1.4298 => 1.4501, std. dev.: 0.0009) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5092, std. dev.: 0.0013) MultiSource/Benchmarks/llubenchmark/llu: 1.36% (3.7731 => 3.8246, std. dev.: 0.0146) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.28% (2.0200 => 2.0459, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1780, std. dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.08% (1.9433 => 1.9642, std. dev.: 0.0017) MultiSource/Benchmarks/sim/sim: 1.06% (5.0168 => 5.0699, std. dev.: 0.0095) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -22.89% (0.4657 => 0.3591, std. dev.: 0.0209) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.74% (22.5627 => 20.8168, std. dev.: 0.0085) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.78% (0.2670 => 0.2489, std. dev.: 0.0023) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.49% (0.3511 => 0.3283, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-3: -5.74% (0.3623 => 0.3415, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.73% (0.3650 => 0.3441, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -5.69% (0.3601 => 0.3396, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -5.65% (0.3663 => 0.3456, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -5.59% (0.3578 => 0.3378, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -5.51% (0.3646 => 0.3445, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -5.25% (0.3940 => 0.3733, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: -5.06% (0.3914 => 0.3716, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -5.01% (0.3789 => 0.3599, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -5.00% (0.4003 => 0.3803, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.82% (0.8818 => 0.8481, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.87% (0.6576 => 0.6387, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/bigfib: -2.85% (0.6250 => 0.6072, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: -2.21% (0.9108 => 0.8907, std. dev.: 0.0007) MultiSource/Applications/lua/lua: -1.91% (3.7467 => 3.6750, std. dev.: 0.0110) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.56% (6.2785 => 6.1808, std. dev.: 0.0054) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.34% (4.9865 => 4.9199, std. dev.: 0.0010) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.16% (1.0460 => 0.9502, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.56% (0.3139 => 0.2933, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.40% (1.3780 => 1.3036, std. dev.: 0.0035) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9624, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -4.03% (2.5089 => 2.4077, std. dev.: 0.0014) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.67% (0.3458 => 0.3331, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.62% (1.9762 => 1.9047, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -2.37% (6.3560 => 6.2055, std. dev.: 0.0124) SingleSource/Benchmarks/Misc/richards_benchmark: -2.14% (1.1560 => 1.1313, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.98% (6.6320 => 6.5008, std. dev.: 0.0087) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.96% (20.3410 => 19.9429, std. dev.: 0.0724) MultiSource/Applications/minisat/minisat: -1.92% (9.3358 => 9.1566, std. dev.: 0.0121) MultiSource/Benchmarks/mafft/pairlocalalign: -1.89% (28.2225 => 27.6903, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3444, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9957, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.35% (3.9173 => 3.8643, std. dev.: 0.0050) MultiSource/Applications/lua/lua: -1.32% (26.5159 => 26.1654, std. dev.: 0.0110) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.66s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu May 24 07:14:05 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 24 May 2012 09:14:05 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120524141405.731D42A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/777?compare_to=776&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 777, Order: 157387, Start Time: 2012-05-24 13:18:28, End Time: 2012-05-24 14:15:02 To: 776, Order: 157381, Start Time: 2012-05-24 08:47:45, End Time: 2012-05-24 09:44:18 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (42 on baseline) Performance Improvements: 0 (42 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (804 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.28% (2.0176 => 2.2653, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.69% (0.3130 => 0.3308, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.44% (3.9660 => 4.0629, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.98% (0.9199 => 0.9381, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 1.98% (0.5265 => 0.5369, std. dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 1.90% (13.8202 => 14.0828, std. dev.: 0.0175) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.90% (0.6959 => 0.7091, std. dev.: 0.0037) MultiSource/Benchmarks/nbench/nbench: 1.83% (1.0594 => 1.0788, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 1.82% (0.8310 => 0.8461, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.62% (1.2193 => 1.2390, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.56% (1.1364 => 1.1541, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.51% (1.3245 => 1.3445, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.43% (0.7710 => 0.7820, std. dev.: 0.0009) MultiSource/Applications/siod/siod: 1.14% (2.1791 => 2.2039, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.14% (13.2842 => 13.4350, std. dev.: 0.0048) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.13% (1.4563 => 1.4728, std. dev.: 0.0027) MultiSource/Benchmarks/MallocBench/gs/gs: 1.02% (3.8646 => 3.9042, std. dev.: 0.0039) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.47% (1.8175 => 2.2622, std. dev.: 0.0065) SingleSource/Benchmarks/Misc/mandel-2: 8.12% (1.2998 => 1.4054, std. dev.: 0.0111) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.92% (1.5824 => 1.6760, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8146, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9879, std. dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.67% (1.7688 => 1.8337, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: 3.60% (7.4271 => 7.6944, std. dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 3.14% (11.2619 => 11.6160, std. dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4553, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: 2.87% (1.9199 => 1.9750, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.76% (2.8606 => 2.9395, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.63% (8.8259 => 9.0579, std. dev.: 0.0151) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.41% (7.9275 => 8.1186, std. dev.: 0.0124) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9603, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/ffbench: 1.54% (0.8273 => 0.8400, std. dev.: 0.0004) MultiSource/Applications/lemon/lemon: 1.48% (1.4298 => 1.4510, std. dev.: 0.0014) MultiSource/Applications/siod/siod: 1.47% (3.2729 => 3.3211, std. dev.: 0.0021) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5086, std. dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.27% (2.0200 => 2.0456, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.20% (1.9433 => 1.9666, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.13% (9.0760 => 9.1790, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -19.95% (0.4657 => 0.3728, std. dev.: 0.0165) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.62% (22.5627 => 20.8434, std. dev.: 0.0140) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.08% (0.2670 => 0.2481, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.29% (0.3511 => 0.3290, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-3: -5.11% (0.3623 => 0.3438, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -5.08% (0.3601 => 0.3418, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: -5.02% (0.3646 => 0.3463, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.01% (0.3650 => 0.3467, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -4.94% (0.3663 => 0.3482, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: -4.84% (0.3578 => 0.3405, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -4.59% (0.3940 => 0.3759, std. dev.: 0.0033) SingleSource/UnitTests/ObjC/for-in: -4.49% (0.3789 => 0.3619, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -4.45% (0.3914 => 0.3740, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -4.27% (0.4003 => 0.3832, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.49% (0.8818 => 0.8510, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: -2.69% (0.6250 => 0.6082, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.63% (0.6576 => 0.6403, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.92% (0.9108 => 0.8933, std. dev.: 0.0002) MultiSource/Applications/lua/lua: -1.72% (3.7467 => 3.6822, std. dev.: 0.0064) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.15% (6.2785 => 6.2066, std. dev.: 0.0116) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.12% (4.9865 => 4.9308, std. dev.: 0.0051) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.59% (0.3139 => 0.2932, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0004) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9624, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -3.95% (2.5089 => 2.4097, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.57% (1.9762 => 1.9056, std. dev.: 0.0032) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.20% (20.3410 => 19.8941, std. dev.: 0.1095) SingleSource/Benchmarks/Shootout/lists: -2.18% (6.3560 => 6.2175, std. dev.: 0.0108) SingleSource/Benchmarks/Misc/richards_benchmark: -2.16% (1.1560 => 1.1310, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: -2.01% (9.3358 => 9.1486, std. dev.: 0.0207) MultiSource/Benchmarks/mafft/pairlocalalign: -1.89% (28.2225 => 27.6896, std. dev.: 0.0024) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.88% (6.6320 => 6.5071, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9954, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.46% (3.9173 => 3.8601, std. dev.: 0.0030) MultiSource/Applications/lua/lua: -1.37% (26.5159 => 26.1535, std. dev.: 0.0053) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.11% (2.5254 => 2.4974, std. dev.: 0.0037) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.59s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu May 24 08:50:33 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 24 May 2012 10:50:33 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120524155033.74D9D2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/778?compare_to=777&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 778, Order: 157389, Start Time: 2012-05-24 14:55:09, End Time: 2012-05-24 15:51:30 To: 777, Order: 157387, Start Time: 2012-05-24 13:18:28, End Time: 2012-05-24 14:15:02 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (40 on baseline) Performance Improvements: 0 (43 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (805 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.17% (2.0176 => 2.2631, std. dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.91% (0.3130 => 0.3315, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.39% (3.9660 => 4.0608, std. dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.12% (0.9199 => 0.9394, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.09% (0.5265 => 0.5375, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/football/football: 1.94% (0.8310 => 0.8471, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.93% (0.6959 => 0.7093, std. dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 1.87% (1.0594 => 1.0792, std. dev.: 0.0030) MultiSource/Applications/SPASS/SPASS: 1.78% (13.8202 => 14.0659, std. dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.68% (1.2193 => 1.2398, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.45% (1.1364 => 1.1529, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.43% (1.3245 => 1.3435, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.16% (1.4563 => 1.4732, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.12% (13.2842 => 13.4325, std. dev.: 0.0145) MultiSource/Benchmarks/MallocBench/gs/gs: 1.04% (3.8646 => 3.9049, std. dev.: 0.0070) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.04% (1.8175 => 2.2545, std. dev.: 0.0184) SingleSource/Benchmarks/Misc/mandel-2: 7.23% (1.2998 => 1.3938, std. dev.: 0.0101) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.85% (1.5824 => 1.6749, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9878, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.67% (1.7688 => 1.8338, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/salsa20: 3.61% (7.4271 => 7.6952, std. dev.: 0.0097) MultiSource/Benchmarks/nbench/nbench: 3.14% (11.2619 => 11.6150, std. dev.: 0.0040) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4541, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/flops-6: 2.92% (1.9199 => 1.9759, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.80% (8.8259 => 9.0734, std. dev.: 0.0253) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9393, std. dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.56% (7.9275 => 8.1306, std. dev.: 0.0054) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.56% (0.8273 => 0.8402, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.50% (1.4298 => 1.4513, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 1.46% (3.2729 => 3.3206, std. dev.: 0.0006) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5102, std. dev.: 0.0063) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.26% (2.0200 => 2.0454, std. dev.: 0.0005) MultiSource/Benchmarks/sim/sim: 1.18% (5.0168 => 5.0761, std. dev.: 0.0081) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 1.10% (9.0760 => 9.1758, std. dev.: 0.0012) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -22.37% (0.4657 => 0.3615, std. dev.: 0.0255) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.69% (22.5627 => 20.8267, std. dev.: 0.0098) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.12% (0.2670 => 0.2480, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.32% (0.3511 => 0.3289, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -5.08% (0.3623 => 0.3439, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.07% (0.3650 => 0.3465, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-2: -5.03% (0.3601 => 0.3420, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -4.94% (0.3646 => 0.3466, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -4.92% (0.3578 => 0.3402, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -4.91% (0.3663 => 0.3483, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: -4.67% (0.3940 => 0.3756, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -4.41% (0.3789 => 0.3622, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -4.40% (0.4003 => 0.3827, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -4.39% (0.3914 => 0.3742, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.47% (0.8818 => 0.8512, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.66% (0.6576 => 0.6401, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/bigfib: -2.66% (0.6250 => 0.6084, std. dev.: 0.0004) MultiSource/Applications/lua/lua: -1.81% (3.7467 => 3.6790, std. dev.: 0.0039) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.17% (4.9865 => 4.9280, std. dev.: 0.0015) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.17% (6.2785 => 6.2049, std. dev.: 0.0045) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.59% (0.3139 => 0.2932, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.16% (1.3780 => 1.3069, std. dev.: 0.0090) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9624, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.99% (2.5089 => 2.4088, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -3.66% (1.9762 => 1.9039, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -2.24% (6.3560 => 6.2135, std. dev.: 0.0086) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.19% (20.3410 => 19.8961, std. dev.: 0.0834) SingleSource/Benchmarks/Misc/richards_benchmark: -2.13% (1.1560 => 1.1314, std. dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.05% (0.4867 => 0.4767, std. dev.: 0.0015) MultiSource/Applications/minisat/minisat: -1.90% (9.3358 => 9.1583, std. dev.: 0.0248) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.90% (6.6320 => 6.5063, std. dev.: 0.0039) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6918, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3446, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9958, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) MultiSource/Applications/lua/lua: -1.30% (26.5159 => 26.1705, std. dev.: 0.0073) SingleSource/Benchmarks/Shootout/heapsort: -1.29% (3.9173 => 3.8669, std. dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.08% (3.8887 => 3.8468, std. dev.: 0.0038) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.90s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu May 24 10:30:40 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 24 May 2012 12:30:40 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120524173040.94B372A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/779?compare_to=778&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 779, Order: 157393, Start Time: 2012-05-24 16:35:10, End Time: 2012-05-24 17:31:37 To: 778, Order: 157389, Start Time: 2012-05-24 14:55:09, End Time: 2012-05-24 15:51:30 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (45 on baseline) Performance Improvements: 0 (42 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (801 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 11.63% (2.0176 => 2.2522, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.75% (0.3130 => 0.3310, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.51% (3.9660 => 4.0654, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.39% (0.5265 => 0.5391, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.18% (0.6959 => 0.7111, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.12% (0.9199 => 0.9394, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/football/football: 1.96% (0.8310 => 0.8473, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.88% (0.5637 => 0.5743, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 1.86% (1.0594 => 1.0791, std. dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 1.86% (13.8202 => 14.0770, std. dev.: 0.0146) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.81% (1.2193 => 1.2414, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.68% (1.1364 => 1.1555, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.58% (1.3245 => 1.3454, std. dev.: 0.0033) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.28% (1.4563 => 1.4749, std. dev.: 0.0013) MultiSource/Applications/siod/siod: 1.23% (2.1791 => 2.2060, std. dev.: 0.0029) MultiSource/Benchmarks/MallocBench/gs/gs: 1.23% (3.8646 => 3.9120, std. dev.: 0.0060) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.22% (13.2842 => 13.4461, std. dev.: 0.0210) MultiSource/Applications/kimwitu++/kc: 1.10% (16.6129 => 16.7950, std. dev.: 0.0255) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.20% (1.8175 => 2.2574, std. dev.: 0.0077) SingleSource/Benchmarks/Misc/mandel-2: 7.49% (1.2998 => 1.3972, std. dev.: 0.0061) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.90% (1.5824 => 1.6757, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8146, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9877, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.64% (1.7688 => 1.8332, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: 3.62% (7.4271 => 7.6960, std. dev.: 0.0077) MultiSource/Benchmarks/nbench/nbench: 3.13% (11.2619 => 11.6149, std. dev.: 0.0036) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4550, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: 2.94% (1.9199 => 1.9764, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9392, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.68% (8.8259 => 9.0625, std. dev.: 0.0125) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.28% (7.9275 => 8.1081, std. dev.: 0.0198) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.61% (0.8273 => 0.8406, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 1.45% (3.2729 => 3.3204, std. dev.: 0.0022) MultiSource/Applications/lemon/lemon: 1.41% (1.4298 => 1.4500, std. dev.: 0.0017) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5085, std. dev.: 0.0082) MultiSource/Benchmarks/Olden/bisort/bisort: 1.31% (0.8239 => 0.8347, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.26% (2.0200 => 2.0455, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0029) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.16% (1.9433 => 1.9658, std. dev.: 0.0053) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1777, std. dev.: 0.0010) MultiSource/Benchmarks/sim/sim: 1.06% (5.0168 => 5.0698, std. dev.: 0.0054) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -21.80% (0.4657 => 0.3642, std. dev.: 0.0105) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.64% (22.5627 => 20.8383, std. dev.: 0.0123) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.89% (0.2670 => 0.2486, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.15% (0.3511 => 0.3295, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -4.28% (0.3623 => 0.3468, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.25% (0.3650 => 0.3495, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -4.14% (0.3601 => 0.3452, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -4.07% (0.3663 => 0.3514, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -4.02% (0.3578 => 0.3434, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: -3.98% (0.3646 => 0.3501, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -3.73% (0.3940 => 0.3793, std. dev.: 0.0050) SingleSource/UnitTests/ObjC/exceptions: -3.65% (0.3914 => 0.3771, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -3.60% (0.4003 => 0.3859, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -3.51% (0.3789 => 0.3656, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.36% (0.8818 => 0.8522, std. dev.: 0.0066) SingleSource/Benchmarks/Misc-C++/bigfib: -2.80% (0.6250 => 0.6075, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.37% (0.6576 => 0.6420, std. dev.: 0.0006) MultiSource/Applications/lua/lua: -1.63% (3.7467 => 3.6858, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.20% (4.9865 => 4.9265, std. dev.: 0.0023) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.59% (0.3139 => 0.2932, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2650, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.70% (1.3780 => 1.3132, std. dev.: 0.0068) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9622, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -4.04% (2.5089 => 2.4075, std. dev.: 0.0015) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.70% (1.9762 => 1.9031, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/richards_benchmark: -2.17% (1.1560 => 1.1309, std. dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.12% (0.4867 => 0.4764, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout/lists: -2.06% (6.3560 => 6.2251, std. dev.: 0.0067) MultiSource/Applications/minisat/minisat: -1.96% (9.3358 => 9.1530, std. dev.: 0.0337) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.91% (6.6320 => 6.5056, std. dev.: 0.0047) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6933, std. dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.82% (20.3410 => 19.9703, std. dev.: 0.0410) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3446, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9954, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.42% (3.9173 => 3.8617, std. dev.: 0.0092) MultiSource/Applications/lua/lua: -1.37% (26.5159 => 26.1535, std. dev.: 0.0149) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.08% (3.8887 => 3.8466, std. dev.: 0.0115) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.77s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu May 24 11:53:25 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 24 May 2012 13:53:25 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120524185325.CBD842A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/780?compare_to=779&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 780, Order: 157399, Start Time: 2012-05-24 17:57:40, End Time: 2012-05-24 18:54:22 To: 779, Order: 157393, Start Time: 2012-05-24 16:35:10, End Time: 2012-05-24 17:31:37 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (39 on baseline) Performance Improvements: 0 (42 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (807 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 11.76% (2.0176 => 2.2549, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.65% (0.3130 => 0.3307, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.51% (3.9660 => 4.0657, std. dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.20% (0.5265 => 0.5381, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.15% (0.9199 => 0.9397, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.00% (0.6959 => 0.7098, std. dev.: 0.0015) MultiSource/Benchmarks/nbench/nbench: 1.81% (1.0594 => 1.0786, std. dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/football/football: 1.81% (0.8310 => 0.8460, std. dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 1.78% (13.8202 => 14.0664, std. dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.62% (1.2193 => 1.2391, std. dev.: 0.0037) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.53% (1.1364 => 1.1538, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.24% (1.4563 => 1.4744, std. dev.: 0.0052) MultiSource/Applications/siod/siod: 1.19% (2.1791 => 2.2051, std. dev.: 0.0068) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.14% (13.2842 => 13.4363, std. dev.: 0.0132) MultiSource/Benchmarks/MallocBench/gs/gs: 1.07% (3.8646 => 3.9058, std. dev.: 0.0045) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.06% (1.8175 => 2.2548, std. dev.: 0.0513) SingleSource/Benchmarks/Misc/mandel-2: 7.76% (1.2998 => 1.4006, std. dev.: 0.0070) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.90% (1.5824 => 1.6757, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.81% (1.9144 => 1.9874, std. dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.71% (1.7688 => 1.8344, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: 3.70% (7.4271 => 7.7019, std. dev.: 0.0046) MultiSource/Benchmarks/nbench/nbench: 3.14% (11.2619 => 11.6156, std. dev.: 0.0050) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 3.01% (8.8259 => 9.0920, std. dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4533, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-6: 2.91% (1.9199 => 1.9758, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9393, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.21% (7.9275 => 8.1026, std. dev.: 0.0223) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.60% (0.8273 => 0.8405, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 1.48% (3.2729 => 3.3213, std. dev.: 0.0064) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5091, std. dev.: 0.0004) MultiSource/Applications/lemon/lemon: 1.39% (1.4298 => 1.4497, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.28% (2.0200 => 2.0458, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1775, std. dev.: 0.0009) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -22.72% (0.4657 => 0.3599, std. dev.: 0.0036) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.70% (22.5627 => 20.8252, std. dev.: 0.0053) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.34% (0.2670 => 0.2474, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.44% (0.3511 => 0.3285, std. dev.: 0.0015) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.44% (0.3650 => 0.3488, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -4.42% (0.3623 => 0.3463, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -4.36% (0.3601 => 0.3444, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -4.31% (0.3663 => 0.3505, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -4.25% (0.3646 => 0.3491, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: -4.25% (0.3578 => 0.3426, std. dev.: 0.0035) SingleSource/UnitTests/ObjC/property: -4.01% (0.3940 => 0.3782, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -3.81% (0.3914 => 0.3765, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -3.77% (0.3789 => 0.3646, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/parameter-passing: -3.75% (0.4003 => 0.3853, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.52% (0.8818 => 0.8508, std. dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/bigfib: -2.88% (0.6250 => 0.6070, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.71% (0.6576 => 0.6398, std. dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.92% (0.9108 => 0.8933, std. dev.: 0.0004) MultiSource/Applications/lua/lua: -1.86% (3.7467 => 3.6771, std. dev.: 0.0056) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.19% (4.9865 => 4.9272, std. dev.: 0.0056) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.16% (6.2785 => 6.2054, std. dev.: 0.0045) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.16% (1.0460 => 0.9502, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.56% (0.3139 => 0.2933, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2650, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.75% (1.3780 => 1.3126, std. dev.: 0.0062) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9624, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -4.01% (2.5089 => 2.4083, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.73% (0.3458 => 0.3329, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.64% (1.9762 => 1.9042, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout/lists: -2.25% (6.3560 => 6.2131, std. dev.: 0.0107) SingleSource/Benchmarks/Misc/richards_benchmark: -2.14% (1.1560 => 1.1313, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.00% (20.3410 => 19.9349, std. dev.: 0.0682) MultiSource/Applications/minisat/minisat: -1.91% (9.3358 => 9.1579, std. dev.: 0.0322) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6907, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.85% (6.6320 => 6.5095, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3446, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9951, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) MultiSource/Applications/lua/lua: -1.38% (26.5159 => 26.1502, std. dev.: 0.0366) SingleSource/Benchmarks/Shootout/heapsort: -1.27% (3.9173 => 3.8677, std. dev.: 0.0095) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.96s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu May 24 13:15:52 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 24 May 2012 15:15:52 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120524201552.B2EC02A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/781?compare_to=780&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 781, Order: 157410, Start Time: 2012-05-24 19:20:24, End Time: 2012-05-24 20:16:49 To: 780, Order: 157399, Start Time: 2012-05-24 17:57:40, End Time: 2012-05-24 18:54:22 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (47 on baseline) Performance Improvements: 0 (41 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 891 (800 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 1.30% (7.9474 => 8.0509, std. dev.: 0.0144) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.18% (2.0176 => 2.2633, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.94% (0.3130 => 0.3316, std. dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.76% (3.9660 => 4.0756, std. dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.49% (0.5265 => 0.5396, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.35% (0.9199 => 0.9415, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.26% (0.6959 => 0.7116, std. dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 2.05% (13.8202 => 14.1041, std. dev.: 0.0143) MultiSource/Benchmarks/Prolangs-C/football/football: 2.02% (0.8310 => 0.8478, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 2.02% (1.0594 => 1.0808, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.92% (0.5637 => 0.5745, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.90% (1.2193 => 1.2425, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.80% (1.3245 => 1.3483, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.73% (1.1364 => 1.1561, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 1.52% (3.8646 => 3.9235, std. dev.: 0.0029) MultiSource/Applications/kimwitu++/kc: 1.50% (16.6129 => 16.8617, std. dev.: 0.0109) MultiSource/Applications/siod/siod: 1.48% (2.1791 => 2.2114, std. dev.: 0.0065) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.48% (1.4563 => 1.4778, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.42% (13.2842 => 13.4730, std. dev.: 0.0018) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.36% (0.7710 => 0.7815, std. dev.: 0.0001) MultiSource/Applications/Burg/burg: 1.23% (1.1061 => 1.1197, std. dev.: 0.0008) MultiSource/Applications/hbd/hbd: 1.12% (1.3693 => 1.3847, std. dev.: 0.0001) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 23.99% (1.8175 => 2.2535, std. dev.: 0.0045) SingleSource/Benchmarks/Misc/mandel-2: 8.48% (1.2998 => 1.4100, std. dev.: 0.0043) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.90% (1.5824 => 1.6757, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8146, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9876, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.67% (1.7688 => 1.8337, std. dev.: 0.0057) SingleSource/Benchmarks/Misc/salsa20: 3.58% (7.4271 => 7.6928, std. dev.: 0.0055) MultiSource/Benchmarks/nbench/nbench: 3.14% (11.2619 => 11.6155, std. dev.: 0.0024) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4537, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-6: 2.90% (1.9199 => 1.9755, std. dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.87% (8.8259 => 9.0795, std. dev.: 0.0192) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9392, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.62% (7.9275 => 8.1349, std. dev.: 0.0046) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.55% (0.8273 => 0.8401, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 1.48% (3.2729 => 3.3212, std. dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5100, std. dev.: 0.0010) MultiSource/Applications/lemon/lemon: 1.41% (1.4298 => 1.4499, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.27% (2.0200 => 2.0456, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.22% (1.9433 => 1.9671, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 1.15% (1.2308 => 1.2449, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: 1.14% (9.0760 => 9.1796, std. dev.: 0.0007) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -21.67% (0.4657 => 0.3648, std. dev.: 0.0343) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.41% (22.5627 => 20.8911, std. dev.: 0.0089) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.00% (0.2670 => 0.2483, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.15% (0.3511 => 0.3295, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-3: -4.22% (0.3623 => 0.3470, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.19% (0.3650 => 0.3497, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: -4.17% (0.3601 => 0.3451, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -4.05% (0.3578 => 0.3433, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -4.04% (0.3663 => 0.3515, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -3.98% (0.3646 => 0.3501, std. dev.: 0.0028) SingleSource/UnitTests/ObjC/property: -3.81% (0.3940 => 0.3790, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -3.60% (0.3914 => 0.3773, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -3.56% (0.3789 => 0.3654, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -3.50% (0.4003 => 0.3863, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.40% (0.8818 => 0.8518, std. dev.: 0.0041) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.21% (0.6576 => 0.6365, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: -2.27% (0.6250 => 0.6108, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.76% (0.9108 => 0.8948, std. dev.: 0.0007) MultiSource/Applications/lua/lua: -1.51% (3.7467 => 3.6903, std. dev.: 0.0053) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.07% (6.2785 => 6.2115, std. dev.: 0.0072) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0007) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.63% (0.3139 => 0.2931, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.29% (1.3780 => 1.3051, std. dev.: 0.0120) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9623, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -3.97% (2.5089 => 2.4092, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -3.66% (1.9762 => 1.9038, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/richards_benchmark: -2.15% (1.1560 => 1.1312, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -2.00% (6.3560 => 6.2288, std. dev.: 0.0055) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.96% (6.6320 => 6.5021, std. dev.: 0.0041) MultiSource/Applications/minisat/minisat: -1.92% (9.3358 => 9.1562, std. dev.: 0.0108) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.91% (20.3410 => 19.9526, std. dev.: 0.0775) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6914, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9957, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/heapsort: -1.53% (3.9173 => 3.8572, std. dev.: 0.0038) MultiSource/Applications/lua/lua: -1.38% (26.5159 => 26.1500, std. dev.: 0.0136) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.10s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu May 24 14:39:57 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 24 May 2012 16:39:57 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120524213957.43E582A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/782?compare_to=781&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 782, Order: 157411, Start Time: 2012-05-24 20:44:24, End Time: 2012-05-24 21:40:53 To: 781, Order: 157410, Start Time: 2012-05-24 19:20:24, End Time: 2012-05-24 20:16:49 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (49 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (799 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.17% (2.0176 => 2.2631, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.91% (0.3130 => 0.3315, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.72% (3.9660 => 4.0740, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.62% (0.5265 => 0.5403, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.54% (0.6959 => 0.7136, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.49% (0.9199 => 0.9428, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 2.11% (0.8310 => 0.8485, std. dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 2.07% (13.8202 => 14.1060, std. dev.: 0.0149) MultiSource/Benchmarks/nbench/nbench: 2.05% (1.0594 => 1.0811, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.04% (0.5637 => 0.5752, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.96% (1.2193 => 1.2432, std. dev.: 0.0017) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.86% (1.1364 => 1.1575, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.85% (1.3245 => 1.3490, std. dev.: 0.0016) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.63% (0.7710 => 0.7836, std. dev.: 0.0017) MultiSource/Applications/siod/siod: 1.56% (2.1791 => 2.2131, std. dev.: 0.0035) MultiSource/Benchmarks/MallocBench/gs/gs: 1.53% (3.8646 => 3.9238, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.50% (1.4563 => 1.4782, std. dev.: 0.0015) MultiSource/Applications/kimwitu++/kc: 1.50% (16.6129 => 16.8615, std. dev.: 0.0120) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.44% (13.2842 => 13.4761, std. dev.: 0.0047) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.41% (0.7460 => 0.7565, std. dev.: 0.0009) MultiSource/Applications/Burg/burg: 1.30% (1.1061 => 1.1205, std. dev.: 0.0021) MultiSource/Applications/treecc/treecc: 1.25% (1.9270 => 1.9510, std. dev.: 0.0022) MultiSource/Applications/hbd/hbd: 1.18% (1.3693 => 1.3855, std. dev.: 0.0019) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 23.87% (1.8175 => 2.2513, std. dev.: 0.0509) SingleSource/Benchmarks/Misc/mandel-2: 8.56% (1.2998 => 1.4111, std. dev.: 0.0066) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.91% (1.5824 => 1.6759, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8146, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9878, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.64% (1.7688 => 1.8331, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/salsa20: 3.56% (7.4271 => 7.6917, std. dev.: 0.0109) MultiSource/Benchmarks/nbench/nbench: 3.13% (11.2619 => 11.6149, std. dev.: 0.0015) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4544, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-6: 2.90% (1.9199 => 1.9756, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.76% (8.8259 => 9.0694, std. dev.: 0.0181) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9393, std. dev.: 0.0023) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.45% (7.9275 => 8.1221, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0090) SingleSource/Benchmarks/Misc/ffbench: 1.61% (0.8273 => 0.8406, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 1.45% (3.2729 => 3.3205, std. dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5099, std. dev.: 0.0010) MultiSource/Benchmarks/sim/sim: 1.38% (5.0168 => 5.0862, std. dev.: 0.0058) MultiSource/Applications/lemon/lemon: 1.36% (1.4298 => 1.4493, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.28% (2.0200 => 2.0458, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.21% (1.9433 => 1.9669, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 1.11% (9.0760 => 9.1766, std. dev.: 0.0015) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -21.88% (0.4657 => 0.3638, std. dev.: 0.0056) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.44% (22.5627 => 20.8838, std. dev.: 0.0136) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.08% (0.2670 => 0.2481, std. dev.: 0.0034) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.10% (0.3511 => 0.3297, std. dev.: 0.0032) SingleSource/UnitTests/ObjC/exceptions-3: -4.20% (0.3623 => 0.3471, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.19% (0.3650 => 0.3497, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -4.17% (0.3601 => 0.3451, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -4.07% (0.3663 => 0.3514, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -4.05% (0.3578 => 0.3433, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions-4: -4.00% (0.3646 => 0.3500, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -3.76% (0.3940 => 0.3792, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -3.58% (0.3914 => 0.3774, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -3.56% (0.3789 => 0.3654, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -3.45% (0.4003 => 0.3865, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.36% (0.8818 => 0.8522, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.21% (0.6576 => 0.6365, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/bigfib: -2.40% (0.6250 => 0.6100, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.62% (0.9108 => 0.8960, std. dev.: 0.0001) MultiSource/Applications/lua/lua: -1.44% (3.7467 => 3.6927, std. dev.: 0.0034) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.53% (0.3139 => 0.2934, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0004) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.65% (1.3780 => 1.3139, std. dev.: 0.0058) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9622, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -4.00% (2.5089 => 2.4086, std. dev.: 0.0009) MultiSource/Benchmarks/Olden/bh/bh: -3.70% (1.9762 => 1.9030, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -2.22% (6.3560 => 6.2151, std. dev.: 0.0154) SingleSource/Benchmarks/Misc/richards_benchmark: -2.11% (1.1560 => 1.1316, std. dev.: 0.0013) MultiSource/Applications/minisat/minisat: -1.98% (9.3358 => 9.1507, std. dev.: 0.0138) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.97% (6.6320 => 6.5012, std. dev.: 0.0062) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.94% (20.3410 => 19.9469, std. dev.: 0.1112) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6906, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3444, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9956, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.48% (3.9173 => 3.8594, std. dev.: 0.0040) MultiSource/Applications/lua/lua: -1.37% (26.5159 => 26.1527, std. dev.: 0.0281) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.51s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu May 24 16:02:16 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 24 May 2012 18:02:16 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120524230216.483542A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/783?compare_to=782&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 783, Order: 157415, Start Time: 2012-05-24 22:06:51, End Time: 2012-05-24 23:03:13 To: 782, Order: 157411, Start Time: 2012-05-24 20:44:24, End Time: 2012-05-24 21:40:53 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (51 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (797 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.23% (2.0176 => 2.2644, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.07% (0.3130 => 0.3320, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.87% (3.9660 => 4.0800, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.58% (0.9199 => 0.9436, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.50% (0.6959 => 0.7133, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.49% (0.5265 => 0.5396, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 2.21% (13.8202 => 14.1255, std. dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/football/football: 2.20% (0.8310 => 0.8493, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.02% (0.5637 => 0.5751, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.01% (1.2193 => 1.2438, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.94% (1.3245 => 1.3502, std. dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.86% (1.1364 => 1.1575, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.83% (0.7710 => 0.7851, std. dev.: 0.0008) MultiSource/Applications/siod/siod: 1.75% (2.1791 => 2.2172, std. dev.: 0.0146) MultiSource/Applications/kimwitu++/kc: 1.59% (16.6129 => 16.8777, std. dev.: 0.0048) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.55% (13.2842 => 13.4906, std. dev.: 0.0090) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.55% (1.4563 => 1.4788, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/gs/gs: 1.53% (3.8646 => 3.9239, std. dev.: 0.0011) MultiSource/Applications/Burg/burg: 1.47% (1.1061 => 1.1224, std. dev.: 0.0014) MultiSource/Applications/lambda-0_1_3/lambda: 1.46% (0.7038 => 0.7141, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.42% (0.7460 => 0.7566, std. dev.: 0.0006) MultiSource/Applications/treecc/treecc: 1.42% (1.9270 => 1.9543, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 1.26% (1.3693 => 1.3866, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.03% (1.3819 => 1.3962, std. dev.: 0.0011) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 25.52% (1.8175 => 2.2814, std. dev.: 0.0205) SingleSource/Benchmarks/Misc/mandel-2: 7.91% (1.2998 => 1.4026, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.89% (1.5824 => 1.6756, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9877, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.71% (1.7688 => 1.8344, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 3.58% (7.4271 => 7.6927, std. dev.: 0.0054) MultiSource/Benchmarks/nbench/nbench: 3.13% (11.2619 => 11.6143, std. dev.: 0.0034) MultiSource/Applications/hexxagon/hexxagon: 2.98% (12.0921 => 12.4523, std. dev.: 0.0022) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.91% (8.8259 => 9.0826, std. dev.: 0.0130) SingleSource/Benchmarks/Misc/flops-6: 2.88% (1.9199 => 1.9751, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9394, std. dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.39% (7.9275 => 8.1173, std. dev.: 0.0191) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.54% (0.8273 => 0.8400, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: 1.53% (1.9290 => 1.9586, std. dev.: 0.0008) MultiSource/Applications/siod/siod: 1.44% (3.2729 => 3.3199, std. dev.: 0.0007) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5086, std. dev.: 0.0024) MultiSource/Applications/lemon/lemon: 1.40% (1.4298 => 1.4498, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/bisort/bisort: 1.30% (0.8239 => 0.8346, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.28% (2.0200 => 2.0459, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.22% (1.9433 => 1.9671, std. dev.: 0.0077) MultiSource/Benchmarks/sim/sim: 1.20% (5.0168 => 5.0769, std. dev.: 0.0080) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/flops: 1.13% (9.0760 => 9.1785, std. dev.: 0.0006) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -22.50% (0.4657 => 0.3609, std. dev.: 0.0099) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.39% (22.5627 => 20.8954, std. dev.: 0.0117) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.00% (0.2670 => 0.2483, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.01% (0.3511 => 0.3300, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-3: -3.73% (0.3623 => 0.3488, std. dev.: 0.0038) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.64% (0.3650 => 0.3517, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -3.57% (0.3646 => 0.3516, std. dev.: 0.0030) SingleSource/UnitTests/ObjC/exceptions-2: -3.55% (0.3601 => 0.3473, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -3.49% (0.3578 => 0.3453, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -3.47% (0.3663 => 0.3536, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.37% (0.8818 => 0.8521, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -3.32% (0.3940 => 0.3809, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.13% (0.6576 => 0.6370, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions: -3.12% (0.3914 => 0.3792, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -3.05% (0.4003 => 0.3881, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -2.98% (0.3789 => 0.3676, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: -2.30% (0.6250 => 0.6106, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.59% (0.9108 => 0.8963, std. dev.: 0.0002) MultiSource/Applications/lua/lua: -1.40% (3.7467 => 3.6944, std. dev.: 0.0011) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.16% (1.0460 => 0.9502, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.59% (0.3139 => 0.2932, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.91% (1.3780 => 1.3104, std. dev.: 0.0043) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9623, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -4.03% (2.5089 => 2.4078, std. dev.: 0.0011) MultiSource/Benchmarks/Olden/bh/bh: -3.69% (1.9762 => 1.9032, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.61% (0.3458 => 0.3333, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: -2.10% (1.1560 => 1.1317, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.99% (6.3560 => 6.2292, std. dev.: 0.0143) MultiSource/Applications/minisat/minisat: -1.94% (9.3358 => 9.1549, std. dev.: 0.0490) MultiSource/Benchmarks/mafft/pairlocalalign: -1.89% (28.2225 => 27.6903, std. dev.: 0.0022) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.80% (6.6320 => 6.5126, std. dev.: 0.0039) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.76% (20.3410 => 19.9824, std. dev.: 0.0127) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9951, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/heapsort: -1.48% (3.9173 => 3.8594, std. dev.: 0.0053) MultiSource/Applications/lua/lua: -1.40% (26.5159 => 26.1439, std. dev.: 0.0176) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.65s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu May 24 17:24:33 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 24 May 2012 19:24:33 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120525002433.180D62A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/784?compare_to=783&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 784, Order: 157435, Start Time: 2012-05-24 23:29:07, End Time: 2012-05-25 00:25:30 To: 783, Order: 157415, Start Time: 2012-05-24 22:06:51, End Time: 2012-05-24 23:03:13 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (45 on baseline) Performance Improvements: 3 (44 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 889 (799 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC++/property-reference: -1.51% (0.7070 => 0.6963, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.03% (1.9862 => 1.9658, std. dev.: 0.0033) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/fbench: -1.04% (2.2814 => 2.2577, std. dev.: 0.0080) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 11.75% (2.0176 => 2.2546, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.69% (0.3130 => 0.3308, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.61% (3.9660 => 4.0695, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.25% (0.9199 => 0.9406, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.17% (0.5265 => 0.5379, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.14% (0.6959 => 0.7108, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 2.04% (1.0594 => 1.0810, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 2.02% (13.8202 => 14.0999, std. dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C/football/football: 1.90% (0.8310 => 0.8468, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.84% (1.1364 => 1.1573, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.76% (1.2193 => 1.2407, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.64% (1.3245 => 1.3462, std. dev.: 0.0016) MultiSource/Applications/siod/siod: 1.59% (2.1791 => 2.2138, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.56% (13.2842 => 13.4918, std. dev.: 0.0078) MultiSource/Benchmarks/MallocBench/gs/gs: 1.44% (3.8646 => 3.9201, std. dev.: 0.0060) MultiSource/Applications/kimwitu++/kc: 1.38% (16.6129 => 16.8429, std. dev.: 0.0065) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.28% (1.4563 => 1.4749, std. dev.: 0.0001) MultiSource/Applications/Burg/burg: 1.18% (1.1061 => 1.1191, std. dev.: 0.0013) MultiSource/Applications/treecc/treecc: 1.08% (1.9270 => 1.9479, std. dev.: 0.0019) MultiSource/Applications/SIBsim4/SIBsim4: 1.00% (1.2749 => 1.2877, std. dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.22% (1.8175 => 2.2577, std. dev.: 0.0080) SingleSource/Benchmarks/Misc/mandel-2: 7.17% (1.2998 => 1.3930, std. dev.: 0.0079) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.86% (1.5824 => 1.6751, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8143, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9882, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.70% (1.7688 => 1.8342, std. dev.: 0.0160) SingleSource/Benchmarks/Misc/salsa20: 3.61% (7.4271 => 7.6953, std. dev.: 0.0081) MultiSource/Benchmarks/nbench/nbench: 3.12% (11.2619 => 11.6131, std. dev.: 0.0034) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4539, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-6: 2.89% (1.9199 => 1.9754, std. dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.87% (8.8259 => 9.0791, std. dev.: 0.0280) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.74% (2.8606 => 2.9391, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.30% (7.9275 => 8.1101, std. dev.: 0.0124) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.55% (0.8273 => 0.8401, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: 1.47% (1.4298 => 1.4508, std. dev.: 0.0007) MultiSource/Applications/siod/siod: 1.45% (3.2729 => 3.3202, std. dev.: 0.0023) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5087, std. dev.: 0.0089) MultiSource/Benchmarks/sim/sim: 1.34% (5.0168 => 5.0842, std. dev.: 0.0047) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.28% (2.0200 => 2.0458, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.17% (1.9433 => 1.9661, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1775, std. dev.: 0.0015) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -24.01% (0.4657 => 0.3539, std. dev.: 0.0121) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.45% (0.2670 => 0.2471, std. dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.15% (22.5627 => 20.9496, std. dev.: 0.0056) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.92% (0.3511 => 0.3268, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -5.08% (0.3601 => 0.3418, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.07% (0.3650 => 0.3465, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -5.00% (0.3623 => 0.3442, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -4.97% (0.3663 => 0.3481, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -4.96% (0.3646 => 0.3465, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: -4.84% (0.3578 => 0.3405, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -4.49% (0.3940 => 0.3763, std. dev.: 0.0036) SingleSource/UnitTests/ObjC/for-in: -4.49% (0.3789 => 0.3619, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: -4.29% (0.3914 => 0.3746, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: -4.12% (0.4003 => 0.3838, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.35% (0.8818 => 0.8523, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.01% (0.6576 => 0.6378, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: -2.88% (0.6250 => 0.6070, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: -2.07% (0.5748 => 0.5629, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.86% (0.9108 => 0.8939, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: -1.72% (0.5818 => 0.5718, std. dev.: 0.0000) MultiSource/Applications/lua/lua: -1.40% (3.7467 => 3.6942, std. dev.: 0.0028) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.14% (6.2785 => 6.2071, std. dev.: 0.0022) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.16% (1.0460 => 0.9502, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.59% (0.3139 => 0.2932, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.13% (1.3780 => 1.3073, std. dev.: 0.0105) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9624, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -3.99% (2.5089 => 2.4088, std. dev.: 0.0013) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.67% (0.3458 => 0.3331, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.66% (1.9762 => 1.9039, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -2.15% (6.3560 => 6.2193, std. dev.: 0.0056) SingleSource/Benchmarks/Misc/richards_benchmark: -2.12% (1.1560 => 1.1315, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: -1.96% (9.3358 => 9.1526, std. dev.: 0.0243) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.92% (6.6320 => 6.5049, std. dev.: 0.0036) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6915, std. dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.73% (20.3410 => 19.9886, std. dev.: 0.0373) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3444, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9954, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) MultiSource/Applications/lua/lua: -1.54% (26.5159 => 26.1080, std. dev.: 0.0423) SingleSource/Benchmarks/Shootout/heapsort: -1.25% (3.9173 => 3.8685, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.02% (3.8887 => 3.8490, std. dev.: 0.0045) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.18s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu May 24 18:46:50 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 24 May 2012 20:46:50 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120525014650.6C41B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/785?compare_to=784&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 785, Order: 157446, Start Time: 2012-05-25 00:51:18, End Time: 2012-05-25 01:47:47 To: 784, Order: 157435, Start Time: 2012-05-24 23:29:07, End Time: 2012-05-25 00:25:30 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (54 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (795 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.07% (2.0176 => 2.2812, std. dev.: 0.0143) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.29% (0.3130 => 0.3327, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.75% (0.2721 => 0.2823, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.04% (3.9660 => 4.0865, std. dev.: 0.0094) MultiSource/Benchmarks/nbench/nbench: 2.58% (1.0594 => 1.0867, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.57% (0.9199 => 0.9435, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.53% (0.6959 => 0.7135, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.41% (0.5265 => 0.5392, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/football/football: 2.39% (0.8310 => 0.8509, std. dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 2.34% (13.8202 => 14.1439, std. dev.: 0.0159) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.12% (1.2193 => 1.2452, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.12% (1.1364 => 1.1605, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.00% (0.5637 => 0.5750, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.94% (1.3245 => 1.3502, std. dev.: 0.0010) MultiSource/Applications/siod/siod: 1.85% (2.1791 => 2.2195, std. dev.: 0.0027) MultiSource/Applications/kimwitu++/kc: 1.83% (16.6129 => 16.9166, std. dev.: 0.0301) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.81% (1.4563 => 1.4826, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.80% (13.2842 => 13.5228, std. dev.: 0.0051) MultiSource/Benchmarks/MallocBench/gs/gs: 1.69% (3.8646 => 3.9301, std. dev.: 0.0045) MultiSource/Applications/lambda-0_1_3/lambda: 1.62% (0.7038 => 0.7152, std. dev.: 0.0013) MultiSource/Applications/Burg/burg: 1.55% (1.1061 => 1.1232, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.49% (0.7460 => 0.7571, std. dev.: 0.0001) MultiSource/Applications/treecc/treecc: 1.43% (1.9270 => 1.9545, std. dev.: 0.0037) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.41% (0.7710 => 0.7819, std. dev.: 0.0036) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.26% (1.3819 => 1.3993, std. dev.: 0.0027) MultiSource/Applications/SIBsim4/SIBsim4: 1.25% (1.2749 => 1.2908, std. dev.: 0.0028) MultiSource/Applications/sqlite3/sqlite3: 1.13% (16.2614 => 16.4450, std. dev.: 0.0105) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.11% (1.3813 => 1.3967, std. dev.: 0.0044) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.03% (3.6692 => 3.7069, std. dev.: 0.0049) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.09% (1.8175 => 2.2553, std. dev.: 0.0166) SingleSource/Benchmarks/Misc/mandel-2: 8.17% (1.2998 => 1.4060, std. dev.: 0.0095) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.52% (2.5629 => 2.7299, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.90% (1.5824 => 1.6758, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9880, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.72% (1.7688 => 1.8346, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: 3.71% (7.4271 => 7.7025, std. dev.: 0.0031) MultiSource/Benchmarks/nbench/nbench: 3.10% (11.2619 => 11.6115, std. dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4546, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: 2.88% (1.9199 => 1.9752, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9394, std. dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.75% (8.8259 => 9.0686, std. dev.: 0.0141) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.38% (7.9275 => 8.1159, std. dev.: 0.0111) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0083) SingleSource/Benchmarks/Misc/ffbench: 1.57% (0.8273 => 0.8403, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.48% (1.4298 => 1.4510, std. dev.: 0.0022) MultiSource/Applications/siod/siod: 1.46% (3.2729 => 3.3208, std. dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5094, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.26% (2.0200 => 2.0455, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2135, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.13% (1.9433 => 1.9653, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/flops: 1.11% (9.0760 => 9.1771, std. dev.: 0.0013) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -23.81% (0.4657 => 0.3548, std. dev.: 0.0142) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.34% (0.2670 => 0.2474, std. dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.86% (22.5627 => 21.0147, std. dev.: 0.0185) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.32% (0.3511 => 0.3289, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-3: -4.83% (0.3623 => 0.3448, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.79% (0.3650 => 0.3475, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -4.75% (0.3601 => 0.3430, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -4.61% (0.3578 => 0.3413, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -4.59% (0.3663 => 0.3495, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -4.58% (0.3646 => 0.3479, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -4.24% (0.3940 => 0.3773, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -4.20% (0.3789 => 0.3630, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -4.09% (0.3914 => 0.3754, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -3.87% (0.4003 => 0.3848, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.66% (0.8818 => 0.8495, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: -2.51% (0.6250 => 0.6093, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.84% (0.6576 => 0.6455, std. dev.: 0.0010) MultiSource/Applications/lua/lua: -1.13% (3.7467 => 3.7042, std. dev.: 0.0014) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.16% (1.0460 => 0.9502, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.59% (0.3139 => 0.2932, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.22% (1.3780 => 1.3060, std. dev.: 0.0036) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9622, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.96% (2.5089 => 2.4096, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.64% (1.9762 => 1.9042, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: -2.13% (1.1560 => 1.1314, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout/lists: -2.12% (6.3560 => 6.2213, std. dev.: 0.0052) MultiSource/Applications/minisat/minisat: -1.99% (9.3358 => 9.1501, std. dev.: 0.0107) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.96% (6.6320 => 6.5020, std. dev.: 0.0045) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.91% (20.3410 => 19.9519, std. dev.: 0.0296) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6910, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3446, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9956, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.56% (0.9692 => 0.9541, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.42% (3.9173 => 3.8616, std. dev.: 0.0051) MultiSource/Applications/lua/lua: -1.37% (26.5159 => 26.1528, std. dev.: 0.0149) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.72s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu May 24 20:09:12 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 24 May 2012 22:09:12 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120525030912.956EA2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/786?compare_to=785&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 786, Order: 157452, Start Time: 2012-05-25 02:13:42, End Time: 2012-05-25 03:10:09 To: 785, Order: 157446, Start Time: 2012-05-25 00:51:18, End Time: 2012-05-25 01:47:47 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (51 on baseline) Performance Improvements: 0 (42 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 890 (795 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.19% (0.8495 => 0.8596, std. dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 1.28% (7.9441 => 8.0456, std. dev.: 0.0108) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.50% (2.0176 => 2.2698, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.90% (0.2721 => 0.2827, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.04% (3.9660 => 4.0864, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.59% (0.9199 => 0.9437, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.56% (0.5265 => 0.5400, std. dev.: 0.0016) MultiSource/Benchmarks/nbench/nbench: 2.52% (1.0594 => 1.0861, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: 2.52% (0.8310 => 0.8519, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.46% (0.6959 => 0.7130, std. dev.: 0.0042) MultiSource/Applications/SPASS/SPASS: 2.24% (13.8202 => 14.1291, std. dev.: 0.0201) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.14% (1.1364 => 1.1607, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.07% (1.2193 => 1.2445, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.06% (0.5637 => 0.5753, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.99% (1.3245 => 1.3508, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 1.78% (2.1791 => 2.2178, std. dev.: 0.0065) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.73% (13.2842 => 13.5137, std. dev.: 0.0141) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.70% (1.4563 => 1.4810, std. dev.: 0.0014) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.63% (0.7710 => 0.7836, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/gs/gs: 1.59% (3.8646 => 3.9261, std. dev.: 0.0037) MultiSource/Applications/Burg/burg: 1.49% (1.1061 => 1.1226, std. dev.: 0.0047) MultiSource/Applications/treecc/treecc: 1.49% (1.9270 => 1.9557, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.42% (0.7460 => 0.7566, std. dev.: 0.0013) MultiSource/Applications/kimwitu++/kc: 1.41% (16.6129 => 16.8472, std. dev.: 0.0065) MultiSource/Applications/hbd/hbd: 1.26% (1.3693 => 1.3865, std. dev.: 0.0010) MultiSource/Applications/SIBsim4/SIBsim4: 1.22% (1.2749 => 1.2905, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.06% (1.3813 => 1.3960, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.01% (3.6692 => 3.7062, std. dev.: 0.0015) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.24% (1.8175 => 2.2581, std. dev.: 0.0585) SingleSource/Benchmarks/Misc/mandel-2: 7.93% (1.2998 => 1.4029, std. dev.: 0.0126) SingleSource/Benchmarks/Misc/flops-4: 6.52% (1.0640 => 1.1334, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7298, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.86% (1.5824 => 1.6752, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9875, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.63% (1.7688 => 1.8330, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: 3.57% (7.4271 => 7.6924, std. dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 3.16% (11.2619 => 11.6176, std. dev.: 0.0036) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4550, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: 2.94% (1.9199 => 1.9764, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.93% (8.8259 => 9.0844, std. dev.: 0.0105) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9392, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.30% (7.9275 => 8.1097, std. dev.: 0.0120) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ffbench: 1.58% (0.8273 => 0.8404, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 1.46% (3.2729 => 3.3207, std. dev.: 0.0011) MultiSource/Applications/lemon/lemon: 1.42% (1.4298 => 1.4501, std. dev.: 0.0034) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5088, std. dev.: 0.0042) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.27% (2.0200 => 2.0456, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.24% (1.9433 => 1.9673, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 1.14% (9.0760 => 9.1797, std. dev.: 0.0005) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -17.41% (0.4657 => 0.3846, std. dev.: 0.0213) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.95% (22.5627 => 20.9948, std. dev.: 0.0100) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.85% (0.2670 => 0.2487, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.64% (0.3511 => 0.3278, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -4.94% (0.3623 => 0.3444, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.90% (0.3650 => 0.3471, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -4.89% (0.3601 => 0.3425, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -4.78% (0.3578 => 0.3407, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -4.72% (0.3646 => 0.3474, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -4.70% (0.3663 => 0.3491, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -4.39% (0.3940 => 0.3767, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/for-in: -4.22% (0.3789 => 0.3629, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions: -4.19% (0.3914 => 0.3750, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: -4.10% (0.4003 => 0.3839, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.52% (0.8818 => 0.8596, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: -2.51% (0.6250 => 0.6093, std. dev.: 0.0041) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.48% (0.6576 => 0.6413, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: -2.04% (0.5748 => 0.5631, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: -1.74% (0.5818 => 0.5717, std. dev.: 0.0002) MultiSource/Applications/lua/lua: -1.31% (3.7467 => 3.6977, std. dev.: 0.0091) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.15% (0.9108 => 0.9003, std. dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.56% (0.3139 => 0.2933, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2650, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9621, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.34% (1.3780 => 1.3182, std. dev.: 0.0043) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -3.98% (2.5089 => 2.4090, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -3.62% (1.9762 => 1.9046, std. dev.: 0.0042) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.61% (0.3458 => 0.3333, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -2.33% (6.3560 => 6.2078, std. dev.: 0.0209) SingleSource/Benchmarks/Misc/richards_benchmark: -2.15% (1.1560 => 1.1311, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: -2.03% (9.3358 => 9.1461, std. dev.: 0.0099) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.97% (6.6320 => 6.5015, std. dev.: 0.0050) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6907, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9955, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.53% (20.3410 => 20.0296, std. dev.: 0.0043) SingleSource/Benchmarks/Shootout/heapsort: -1.42% (3.9173 => 3.8616, std. dev.: 0.0005) MultiSource/Applications/lua/lua: -1.36% (26.5159 => 26.1565, std. dev.: 0.0049) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.77s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu May 24 21:31:36 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 24 May 2012 23:31:36 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120525043136.E24B82A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/787?compare_to=786&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 787, Order: 157459, Start Time: 2012-05-25 03:36:00, End Time: 2012-05-25 04:32:33 To: 786, Order: 157452, Start Time: 2012-05-25 02:13:42, End Time: 2012-05-25 03:10:09 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (57 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (792 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.72% (2.0176 => 2.2743, std. dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.39% (0.3130 => 0.3330, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.01% (0.2721 => 0.2830, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.36% (3.9660 => 4.0994, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.75% (0.9199 => 0.9452, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.72% (0.5265 => 0.5408, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.72% (0.6959 => 0.7148, std. dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 2.62% (13.8202 => 14.1820, std. dev.: 0.0025) MultiSource/Benchmarks/nbench/nbench: 2.57% (1.0594 => 1.0866, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/football/football: 2.56% (0.8310 => 0.8523, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 2.52% (0.4328 => 0.4437, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.32% (1.2193 => 1.2476, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.27% (1.1364 => 1.1622, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.25% (0.5637 => 0.5764, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.14% (1.3245 => 1.3528, std. dev.: 0.0011) MultiSource/Applications/siod/siod: 2.01% (2.1791 => 2.2229, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/gs/gs: 1.95% (3.8646 => 3.9401, std. dev.: 0.0038) MultiSource/Applications/kimwitu++/kc: 1.89% (16.6129 => 16.9276, std. dev.: 0.0176) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.89% (1.4563 => 1.4838, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.87% (13.2842 => 13.5332, std. dev.: 0.0217) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.83% (0.5577 => 0.5679, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.82% (0.7710 => 0.7850, std. dev.: 0.0041) MultiSource/Applications/lambda-0_1_3/lambda: 1.78% (0.7038 => 0.7163, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.69% (0.7460 => 0.7586, std. dev.: 0.0007) MultiSource/Applications/treecc/treecc: 1.56% (1.9270 => 1.9571, std. dev.: 0.0009) MultiSource/Applications/hbd/hbd: 1.54% (1.3693 => 1.3904, std. dev.: 0.0040) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.38% (1.3813 => 1.4003, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.30% (1.3819 => 1.3998, std. dev.: 0.0029) MultiSource/Applications/SIBsim4/SIBsim4: 1.19% (1.2749 => 1.2901, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.05% (3.6692 => 3.7076, std. dev.: 0.0084) MultiSource/Applications/sqlite3/sqlite3: 1.04% (16.2614 => 16.4307, std. dev.: 0.0104) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.31% (1.8175 => 2.2594, std. dev.: 0.0251) SingleSource/Benchmarks/Misc/mandel-2: 7.72% (1.2998 => 1.4001, std. dev.: 0.0061) SingleSource/Benchmarks/Misc/flops-4: 6.52% (1.0640 => 1.1334, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6754, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8143, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9876, std. dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.65% (1.7688 => 1.8334, std. dev.: 0.0162) SingleSource/Benchmarks/Misc/salsa20: 3.47% (7.4271 => 7.6847, std. dev.: 0.0107) MultiSource/Benchmarks/nbench/nbench: 3.18% (11.2619 => 11.6196, std. dev.: 0.0021) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4544, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-6: 2.91% (1.9199 => 1.9758, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.84% (8.8259 => 9.0765, std. dev.: 0.0042) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9394, std. dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.41% (7.9275 => 8.1187, std. dev.: 0.0153) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.61% (0.8273 => 0.8406, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 1.47% (3.2729 => 3.3211, std. dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: 1.44% (8.3908 => 8.5117, std. dev.: 0.0089) MultiSource/Applications/lemon/lemon: 1.43% (1.4298 => 1.4502, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: 1.42% (1.9290 => 1.9563, std. dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.31% (2.0200 => 2.0465, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: 1.29% (5.0168 => 5.0815, std. dev.: 0.0054) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.16% (1.9433 => 1.9658, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 1.11% (9.0760 => 9.1766, std. dev.: 0.0019) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -18.70% (0.4657 => 0.3786, std. dev.: 0.0068) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.04% (0.2670 => 0.2482, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.82% (22.5627 => 21.0243, std. dev.: 0.0026) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.15% (0.3511 => 0.3295, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: -3.92% (0.3623 => 0.3481, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.92% (0.3650 => 0.3507, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -3.89% (0.3601 => 0.3461, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -3.75% (0.3578 => 0.3444, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -3.69% (0.3663 => 0.3528, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -3.65% (0.3646 => 0.3513, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -3.50% (0.3940 => 0.3802, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions: -3.35% (0.3914 => 0.3783, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -3.27% (0.3789 => 0.3665, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.18% (0.8818 => 0.8538, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -3.12% (0.4003 => 0.3878, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.39% (0.6576 => 0.6419, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: -1.84% (0.6250 => 0.6135, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.26% (0.9108 => 0.8993, std. dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.59% (0.3139 => 0.2932, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2641, std. dev.: 0.0004) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9623, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.59% (1.3780 => 1.3148, std. dev.: 0.0074) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -4.05% (2.5089 => 2.4073, std. dev.: 0.0019) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.59% (1.9762 => 1.9052, std. dev.: 0.0092) SingleSource/Benchmarks/Misc/richards_benchmark: -2.15% (1.1560 => 1.1311, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: -2.02% (9.3358 => 9.1476, std. dev.: 0.0255) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.01% (20.3410 => 19.9312, std. dev.: 0.0244) SingleSource/Benchmarks/Shootout/lists: -1.96% (6.3560 => 6.2315, std. dev.: 0.0028) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.92% (6.6320 => 6.5044, std. dev.: 0.0033) MultiSource/Benchmarks/mafft/pairlocalalign: -1.89% (28.2225 => 27.6903, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9955, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.50% (3.9173 => 3.8586, std. dev.: 0.0040) MultiSource/Applications/lua/lua: -1.38% (26.5159 => 26.1498, std. dev.: 0.0208) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.62s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri May 25 03:10:43 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 25 May 2012 05:10:43 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120525101043.C63A12A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/788?compare_to=787&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 788, Order: 157462, Start Time: 2012-05-25 09:14:40, End Time: 2012-05-25 10:11:39 To: 787, Order: 157459, Start Time: 2012-05-25 03:36:00, End Time: 2012-05-25 04:32:33 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (60 on baseline) Performance Improvements: 0 (38 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (790 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.77% (2.0176 => 2.2752, std. dev.: 0.0138) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.68% (0.3130 => 0.3339, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.23% (0.2721 => 0.2836, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.45% (3.9660 => 4.1030, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.29% (0.6959 => 0.7188, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.02% (0.9199 => 0.9477, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.74% (0.5265 => 0.5409, std. dev.: 0.0037) MultiSource/Applications/SPASS/SPASS: 2.72% (13.8202 => 14.1966, std. dev.: 0.0044) MultiSource/Benchmarks/nbench/nbench: 2.63% (1.0594 => 1.0873, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/hash2: 2.61% (0.4328 => 0.4441, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 2.53% (0.8310 => 0.8520, std. dev.: 0.0024) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.30% (0.7710 => 0.7887, std. dev.: 0.0015) MultiSource/Applications/siod/siod: 2.29% (2.1791 => 2.2290, std. dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.29% (1.2193 => 1.2472, std. dev.: 0.0018) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.20% (1.1364 => 1.1614, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.20% (0.5637 => 0.5761, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.17% (1.4563 => 1.4879, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.15% (1.3245 => 1.3530, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.13% (13.2842 => 13.5665, std. dev.: 0.0118) MultiSource/Applications/hbd/hbd: 2.05% (1.3693 => 1.3974, std. dev.: 0.0058) MultiSource/Applications/kimwitu++/kc: 1.96% (16.6129 => 16.9383, std. dev.: 0.0126) MultiSource/Benchmarks/MallocBench/gs/gs: 1.93% (3.8646 => 3.9390, std. dev.: 0.0124) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.92% (0.5577 => 0.5684, std. dev.: 0.0017) MultiSource/Applications/Burg/burg: 1.88% (1.1061 => 1.1269, std. dev.: 0.0080) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.85% (0.7460 => 0.7598, std. dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: 1.75% (0.7038 => 0.7161, std. dev.: 0.0019) MultiSource/Applications/treecc/treecc: 1.69% (1.9270 => 1.9596, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.59% (1.3813 => 1.4032, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.56% (1.3819 => 1.4035, std. dev.: 0.0007) MultiSource/Applications/SIBsim4/SIBsim4: 1.29% (1.2749 => 1.2914, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.14% (3.6692 => 3.7109, std. dev.: 0.0022) MultiSource/Applications/sqlite3/sqlite3: 1.11% (16.2614 => 16.4420, std. dev.: 0.0107) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 24.24% (1.8175 => 2.2580, std. dev.: 0.0538) SingleSource/Benchmarks/Misc/mandel-2: 7.24% (1.2998 => 1.3939, std. dev.: 0.0066) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.52% (2.5629 => 2.7300, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6754, std. dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.78% (1.9144 => 1.9868, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.73% (1.7688 => 1.8348, std. dev.: 0.0047) SingleSource/Benchmarks/Misc/salsa20: 3.54% (7.4271 => 7.6900, std. dev.: 0.0116) MultiSource/Benchmarks/nbench/nbench: 3.15% (11.2619 => 11.6162, std. dev.: 0.0031) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.99% (8.8259 => 9.0895, std. dev.: 0.0155) MultiSource/Applications/hexxagon/hexxagon: 2.98% (12.0921 => 12.4527, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-6: 2.79% (1.9199 => 1.9735, std. dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9394, std. dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.33% (7.9275 => 8.1125, std. dev.: 0.0166) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.56% (0.8273 => 0.8402, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 1.54% (5.0168 => 5.0939, std. dev.: 0.0048) MultiSource/Applications/lemon/lemon: 1.50% (1.4298 => 1.4512, std. dev.: 0.0006) MultiSource/Applications/siod/siod: 1.47% (3.2729 => 3.3211, std. dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5087, std. dev.: 0.0103) SingleSource/Benchmarks/Dhrystone/fldry: 1.28% (1.9290 => 1.9537, std. dev.: 0.0031) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.28% (1.9433 => 1.9681, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.27% (2.0200 => 2.0457, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bisort/bisort: 1.21% (0.8239 => 0.8339, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/flops: 1.11% (9.0760 => 9.1771, std. dev.: 0.0017) SingleSource/Benchmarks/McGill/chomp: 1.10% (1.2308 => 1.2444, std. dev.: 0.0009) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.00% (0.2670 => 0.2483, std. dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.76% (22.5627 => 21.0367, std. dev.: 0.0082) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.87% (0.3511 => 0.3305, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -4.00% (0.3623 => 0.3478, std. dev.: 0.0048) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.81% (0.3650 => 0.3511, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -3.75% (0.3601 => 0.3466, std. dev.: 0.0022) SingleSource/UnitTests/ObjC/exceptions-4: -3.68% (0.3646 => 0.3512, std. dev.: 0.0022) SingleSource/UnitTests/ObjC/synchronized: -3.66% (0.3663 => 0.3529, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -3.43% (0.3940 => 0.3805, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -3.27% (0.3789 => 0.3665, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -3.24% (0.3914 => 0.3787, std. dev.: 0.0021) SingleSource/UnitTests/ObjC/parameter-passing: -3.07% (0.4003 => 0.3880, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.93% (0.8818 => 0.8560, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.24% (0.6576 => 0.6429, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: -1.95% (0.6250 => 0.6128, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.16% (0.9108 => 0.9002, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.16% (1.0460 => 0.9502, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.56% (0.3139 => 0.2933, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.70% (1.3780 => 1.3133, std. dev.: 0.0044) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9624, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -4.03% (2.5089 => 2.4077, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: -3.72% (1.9762 => 1.9027, std. dev.: 0.0013) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: -2.16% (1.1560 => 1.1310, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -2.09% (6.3560 => 6.2233, std. dev.: 0.0075) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.96% (20.3410 => 19.9418, std. dev.: 0.0777) MultiSource/Benchmarks/mafft/pairlocalalign: -1.87% (28.2225 => 27.6936, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.84% (6.6320 => 6.5099, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3446, std. dev.: 0.0008) MultiSource/Applications/minisat/minisat: -1.63% (9.3358 => 9.1836, std. dev.: 0.0236) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9958, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0002) MultiSource/Applications/lua/lua: -1.49% (26.5159 => 26.1218, std. dev.: 0.0251) SingleSource/Benchmarks/Shootout/heapsort: -1.26% (3.9173 => 3.8679, std. dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.23% (3.8887 => 3.8410, std. dev.: 0.0080) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 3.27s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri May 25 06:30:39 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 25 May 2012 08:30:39 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120525133039.ADBE82A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/789?compare_to=788&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 789, Order: 157467, Start Time: 2012-05-25 12:34:59, End Time: 2012-05-25 13:31:38 To: 788, Order: 157462, Start Time: 2012-05-25 09:14:40, End Time: 2012-05-25 10:11:39 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (57 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 891 (792 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 44.42% (0.4829 => 0.6974, std. dev.: 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 11.97% (2.0176 => 2.2591, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.49% (0.3130 => 0.3333, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.08% (0.2721 => 0.2832, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.21% (3.9660 => 4.0932, std. dev.: 0.0123) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.83% (0.6959 => 0.7156, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.70% (0.5265 => 0.5407, std. dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.67% (0.9199 => 0.9445, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: 2.61% (0.8310 => 0.8527, std. dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 2.59% (1.0594 => 1.0868, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 2.44% (13.8202 => 14.1572, std. dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.33% (1.2193 => 1.2477, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.20% (0.5637 => 0.5761, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.15% (1.1364 => 1.1608, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 2.10% (2.1791 => 2.2248, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.09% (1.3245 => 1.3522, std. dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.91% (13.2842 => 13.5376, std. dev.: 0.0138) MultiSource/Benchmarks/MallocBench/gs/gs: 1.89% (3.8646 => 3.9378, std. dev.: 0.0149) MultiSource/Applications/kimwitu++/kc: 1.84% (16.6129 => 16.9191, std. dev.: 0.0073) MultiSource/Applications/lambda-0_1_3/lambda: 1.78% (0.7038 => 0.7163, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.77% (1.4563 => 1.4821, std. dev.: 0.0032) MultiSource/Applications/Burg/burg: 1.76% (1.1061 => 1.1256, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.65% (0.7710 => 0.7837, std. dev.: 0.0027) MultiSource/Applications/treecc/treecc: 1.64% (1.9270 => 1.9586, std. dev.: 0.0024) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.54% (0.7460 => 0.7575, std. dev.: 0.0024) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.53% (1.3813 => 1.4025, std. dev.: 0.0042) MultiSource/Applications/hbd/hbd: 1.35% (1.3693 => 1.3878, std. dev.: 0.0050) MultiSource/Applications/JM/lencod/lencod: 1.32% (14.8535 => 15.0497, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.23% (1.3819 => 1.3989, std. dev.: 0.0028) MultiSource/Applications/SIBsim4/SIBsim4: 1.02% (1.2749 => 1.2879, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.00% (3.6692 => 3.7059, std. dev.: 0.0043) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: 24.15% (1.8175 => 2.2565, std. dev.: 0.0131) SingleSource/Benchmarks/Misc/mandel-2: 7.11% (1.2998 => 1.3922, std. dev.: 0.0090) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.90% (1.5824 => 1.6758, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8147, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9879, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.74% (1.7688 => 1.8349, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: 3.52% (7.4271 => 7.6882, std. dev.: 0.0104) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4533, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-6: 2.86% (1.9199 => 1.9748, std. dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.85% (8.8259 => 9.0772, std. dev.: 0.0051) MultiSource/Benchmarks/nbench/nbench: 2.81% (11.2619 => 11.5781, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.76% (2.8606 => 2.9396, std. dev.: 0.0022) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.44% (7.9275 => 8.1213, std. dev.: 0.0124) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Benchmarks/llubenchmark/llu: 2.13% (3.7731 => 3.8535, std. dev.: 0.0275) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.56% (0.8273 => 0.8402, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 1.49% (3.2729 => 3.3217, std. dev.: 0.0019) MultiSource/Applications/lemon/lemon: 1.42% (1.4298 => 1.4501, std. dev.: 0.0040) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5087, std. dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.27% (2.0200 => 2.0456, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/flops: 1.13% (9.0760 => 9.1782, std. dev.: 0.0007) MultiSource/Benchmarks/sim/sim: 1.04% (5.0168 => 5.0691, std. dev.: 0.0109) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.33% (22.5627 => 20.9097, std. dev.: 0.0044) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.12% (0.2670 => 0.2480, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.15% (0.3511 => 0.3295, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: -4.69% (0.3623 => 0.3453, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.63% (0.3650 => 0.3481, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-2: -4.58% (0.3601 => 0.3436, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/trivial-interface: -4.56% (0.3578 => 0.3415, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -4.53% (0.3646 => 0.3481, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/synchronized: -4.50% (0.3663 => 0.3498, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -4.04% (0.3789 => 0.3636, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: -3.96% (0.3940 => 0.3784, std. dev.: 0.0028) SingleSource/UnitTests/ObjC/exceptions: -3.93% (0.3914 => 0.3760, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -3.80% (0.4003 => 0.3851, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.85% (0.8818 => 0.8567, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/bigfib: -2.34% (0.6250 => 0.6104, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.17% (0.6576 => 0.6433, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.60% (0.9108 => 0.8962, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.13% (1.0460 => 0.9505, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.56% (0.3139 => 0.2933, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.13% (1.3780 => 1.3073, std. dev.: 0.0094) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9623, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -4.03% (2.5089 => 2.4079, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.73% (0.3458 => 0.3329, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.68% (1.9762 => 1.9034, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.24% (20.3410 => 19.8855, std. dev.: 0.0811) SingleSource/Benchmarks/Misc/richards_benchmark: -2.17% (1.1560 => 1.1309, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -2.14% (6.3560 => 6.2201, std. dev.: 0.0072) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.92% (6.6320 => 6.5044, std. dev.: 0.0032) MultiSource/Applications/minisat/minisat: -1.86% (9.3358 => 9.1623, std. dev.: 0.0362) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9955, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) MultiSource/Applications/lua/lua: -1.46% (26.5159 => 26.1276, std. dev.: 0.0197) SingleSource/Benchmarks/Shootout/heapsort: -1.36% (3.9173 => 3.8639, std. dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: -1.24% (28.2225 => 27.8722, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.13% (3.8887 => 3.8446, std. dev.: 0.0063) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.29s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri May 25 08:43:51 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 25 May 2012 10:43:51 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120525154351.CB9F32A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/790?compare_to=789&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 790, Order: 157469, Start Time: 2012-05-25 14:48:11, End Time: 2012-05-25 15:44:49 To: 789, Order: 157467, Start Time: 2012-05-25 12:34:59, End Time: 2012-05-25 13:31:38 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (57 on baseline) Performance Improvements: 0 (42 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (789 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 11.96% (2.0176 => 2.2589, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.61% (0.3130 => 0.3337, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.23% (0.2721 => 0.2836, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.19% (3.9660 => 4.0926, std. dev.: 0.0111) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.92% (0.6959 => 0.7162, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.79% (0.9199 => 0.9456, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.79% (0.5265 => 0.5412, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 2.56% (1.0594 => 1.0865, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 2.47% (0.8310 => 0.8515, std. dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 2.46% (13.8202 => 14.1602, std. dev.: 0.0169) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.35% (1.2193 => 1.2479, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.34% (0.5637 => 0.5769, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.24% (1.1364 => 1.1619, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.16% (1.3245 => 1.3531, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.07% (1.4563 => 1.4865, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 2.06% (2.1791 => 2.2240, std. dev.: 0.0015) MultiSource/Applications/kimwitu++/kc: 1.98% (16.6129 => 16.9419, std. dev.: 0.0057) MultiSource/Benchmarks/MallocBench/gs/gs: 1.91% (3.8646 => 3.9383, std. dev.: 0.0038) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.90% (13.2842 => 13.5366, std. dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: 1.89% (0.7038 => 0.7171, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 1.80% (1.1061 => 1.1260, std. dev.: 0.0029) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.78% (0.7710 => 0.7847, std. dev.: 0.0023) MultiSource/Applications/treecc/treecc: 1.70% (1.9270 => 1.9597, std. dev.: 0.0025) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.61% (0.7460 => 0.7580, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.48% (1.3819 => 1.4023, std. dev.: 0.0040) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.41% (1.3813 => 1.4008, std. dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 1.24% (14.8535 => 15.0380, std. dev.: 0.0134) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.12% (3.6692 => 3.7102, std. dev.: 0.0108) MultiSource/Applications/SIBsim4/SIBsim4: 1.04% (1.2749 => 1.2881, std. dev.: 0.0028) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/fbench: 24.09% (1.8175 => 2.2553, std. dev.: 0.0083) SingleSource/Benchmarks/Misc/mandel-2: 7.92% (1.2998 => 1.4028, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7298, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.89% (1.5824 => 1.6756, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.79% (1.9144 => 1.9869, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.75% (1.7688 => 1.8352, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: 3.71% (7.4271 => 7.7029, std. dev.: 0.0030) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4540, std. dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.93% (8.8259 => 9.0846, std. dev.: 0.0097) SingleSource/Benchmarks/Misc/flops-6: 2.89% (1.9199 => 1.9753, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 2.79% (11.2619 => 11.5765, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9394, std. dev.: 0.0031) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.50% (7.9275 => 8.1259, std. dev.: 0.0106) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 1.55% (0.8273 => 0.8401, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 1.49% (3.2729 => 3.3216, std. dev.: 0.0010) MultiSource/Benchmarks/NPB-serial/is/is: 1.43% (8.3908 => 8.5105, std. dev.: 0.0008) MultiSource/Applications/lemon/lemon: 1.41% (1.4298 => 1.4500, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bisort/bisort: 1.29% (0.8239 => 0.8345, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.27% (2.0200 => 2.0456, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.18% (1.9433 => 1.9663, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 1.13% (5.0168 => 5.0733, std. dev.: 0.0021) SingleSource/Benchmarks/Dhrystone/fldry: 1.10% (1.9290 => 1.9503, std. dev.: 0.0047) SingleSource/Benchmarks/Misc/flops: 1.10% (9.0760 => 9.1759, std. dev.: 0.0015) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -17.84% (0.4657 => 0.3826, std. dev.: 0.0242) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.27% (22.5627 => 20.9232, std. dev.: 0.0064) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.12% (0.2670 => 0.2480, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.15% (0.3511 => 0.3295, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-3: -4.69% (0.3623 => 0.3453, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -4.61% (0.3601 => 0.3435, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.60% (0.3650 => 0.3482, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: -4.53% (0.3578 => 0.3416, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: -4.42% (0.3663 => 0.3501, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: -4.39% (0.3646 => 0.3486, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -4.09% (0.3940 => 0.3779, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -4.01% (0.3789 => 0.3637, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -3.96% (0.3914 => 0.3759, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: -3.77% (0.4003 => 0.3852, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.72% (0.8818 => 0.8578, std. dev.: 0.0043) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.42% (0.6576 => 0.6417, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/bigfib: -2.22% (0.6250 => 0.6111, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: -1.76% (0.5748 => 0.5647, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.52% (0.9108 => 0.8970, std. dev.: 0.0042) MultiSource/Applications/lua/lua: -1.03% (3.7467 => 3.7082, std. dev.: 0.0060) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.14% (1.0460 => 0.9504, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.63% (0.3139 => 0.2931, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.70% (1.3780 => 1.3133, std. dev.: 0.0027) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9622, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0010) SingleSource/Benchmarks/Dhrystone/dry: -4.01% (2.5089 => 2.4083, std. dev.: 0.0009) MultiSource/Benchmarks/Olden/bh/bh: -3.67% (1.9762 => 1.9036, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.64% (0.3458 => 0.3332, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -2.32% (6.3560 => 6.2086, std. dev.: 0.0085) SingleSource/Benchmarks/Misc/richards_benchmark: -2.15% (1.1560 => 1.1312, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: -1.98% (9.3358 => 9.1506, std. dev.: 0.0065) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.96% (6.6320 => 6.5021, std. dev.: 0.0035) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.79% (20.3410 => 19.9779, std. dev.: 0.0343) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0001) MultiSource/Applications/lua/lua: -1.63% (26.5159 => 26.0843, std. dev.: 0.0331) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9951, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.44% (3.9173 => 3.8609, std. dev.: 0.0149) MultiSource/Benchmarks/mafft/pairlocalalign: -1.26% (28.2225 => 27.8674, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.15% (3.8887 => 3.8439, std. dev.: 0.0041) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.70s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri May 25 10:06:37 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 25 May 2012 12:06:37 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120525170637.06EFB2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/791?compare_to=790&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 791, Order: 157471, Start Time: 2012-05-25 16:10:52, End Time: 2012-05-25 17:07:35 To: 790, Order: 157469, Start Time: 2012-05-25 14:48:11, End Time: 2012-05-25 15:44:49 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (57 on baseline) Performance Improvements: 0 (42 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 891 (789 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 1.92% (3.7735 => 3.8460, std. dev.: 0.0220) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.01% (2.0176 => 2.2599, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.58% (0.3130 => 0.3336, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.90% (0.2721 => 0.2827, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.08% (3.9660 => 4.0881, std. dev.: 0.0094) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.77% (0.6959 => 0.7152, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.68% (0.5265 => 0.5406, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.66% (0.9199 => 0.9444, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 2.56% (0.8310 => 0.8523, std. dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 2.44% (1.0594 => 1.0853, std. dev.: 0.0071) MultiSource/Applications/SPASS/SPASS: 2.36% (13.8202 => 14.1458, std. dev.: 0.0088) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.24% (1.1364 => 1.1618, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.22% (1.2193 => 1.2464, std. dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.20% (0.5637 => 0.5761, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 2.15% (2.1791 => 2.2259, std. dev.: 0.0061) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.05% (1.4563 => 1.4862, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.01% (1.3245 => 1.3511, std. dev.: 0.0017) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.98% (0.7710 => 0.7863, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.95% (13.2842 => 13.5432, std. dev.: 0.0203) MultiSource/Benchmarks/MallocBench/gs/gs: 1.91% (3.8646 => 3.9384, std. dev.: 0.0110) MultiSource/Applications/lambda-0_1_3/lambda: 1.83% (0.7038 => 0.7167, std. dev.: 0.0008) MultiSource/Applications/treecc/treecc: 1.74% (1.9270 => 1.9606, std. dev.: 0.0017) MultiSource/Applications/Burg/burg: 1.69% (1.1061 => 1.1248, std. dev.: 0.0042) MultiSource/Applications/kimwitu++/kc: 1.60% (16.6129 => 16.8786, std. dev.: 0.0261) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.49% (0.7460 => 0.7571, std. dev.: 0.0030) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.31% (1.3819 => 1.4000, std. dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: 1.19% (14.8535 => 15.0299, std. dev.: 0.0098) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.17% (3.6692 => 3.7120, std. dev.: 0.0033) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.17% (1.3813 => 1.3974, std. dev.: 0.0012) MultiSource/Applications/hbd/hbd: 1.14% (1.3693 => 1.3849, std. dev.: 0.0051) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/fbench: 24.27% (1.8175 => 2.2586, std. dev.: 0.0143) SingleSource/Benchmarks/Misc/mandel-2: 7.69% (1.2998 => 1.3997, std. dev.: 0.0110) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6754, std. dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8147, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: 3.81% (1.9144 => 1.9874, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 3.67% (7.4271 => 7.6997, std. dev.: 0.0052) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.62% (1.7688 => 1.8328, std. dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4540, std. dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.89% (8.8259 => 9.0806, std. dev.: 0.0150) SingleSource/Benchmarks/Misc/flops-6: 2.83% (1.9199 => 1.9743, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 2.80% (11.2619 => 11.5769, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9393, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.52% (7.9275 => 8.1272, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/llubenchmark/llu: 1.93% (3.7731 => 3.8460, std. dev.: 0.0220) SingleSource/Benchmarks/Dhrystone/fldry: 1.60% (1.9290 => 1.9598, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/ffbench: 1.60% (0.8273 => 0.8405, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 1.48% (3.2729 => 3.3213, std. dev.: 0.0034) MultiSource/Applications/lemon/lemon: 1.44% (1.4298 => 1.4504, std. dev.: 0.0028) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5086, std. dev.: 0.0069) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.27% (2.0200 => 2.0457, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.27% (1.9433 => 1.9679, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 1.26% (5.0168 => 5.0799, std. dev.: 0.0101) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.13% (9.0760 => 9.1782, std. dev.: 0.0018) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.37% (22.5627 => 20.8990, std. dev.: 0.0067) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.08% (0.2670 => 0.2481, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.98% (0.3511 => 0.3301, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-2: -4.92% (0.3601 => 0.3424, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.90% (0.3650 => 0.3471, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-3: -4.83% (0.3623 => 0.3448, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -4.78% (0.3663 => 0.3488, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: -4.75% (0.3578 => 0.3408, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -4.74% (0.3646 => 0.3473, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -4.42% (0.3940 => 0.3766, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -4.38% (0.3789 => 0.3623, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -4.16% (0.3914 => 0.3751, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -3.85% (0.4003 => 0.3849, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.85% (0.8818 => 0.8567, std. dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/bigfib: -2.64% (0.6250 => 0.6085, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: -2.51% (0.5748 => 0.5604, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.43% (0.6576 => 0.6416, std. dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference-object: -2.29% (0.5818 => 0.5685, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.66% (0.9108 => 0.8957, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: -1.59% (0.7061 => 0.6949, std. dev.: 0.0029) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.13% (1.0460 => 0.9505, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.56% (0.3139 => 0.2933, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2642, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.93% (1.3780 => 1.3100, std. dev.: 0.0061) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9624, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -4.06% (2.5089 => 2.4070, std. dev.: 0.0013) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.67% (1.9762 => 1.9037, std. dev.: 0.0101) SingleSource/Benchmarks/Misc/richards_benchmark: -2.15% (1.1560 => 1.1312, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.95% (6.3560 => 6.2322, std. dev.: 0.0059) MultiSource/Applications/minisat/minisat: -1.89% (9.3358 => 9.1595, std. dev.: 0.0402) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.84% (6.6320 => 6.5098, std. dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.73% (20.3410 => 19.9890, std. dev.: 0.0234) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9952, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) MultiSource/Applications/lua/lua: -1.47% (26.5159 => 26.1251, std. dev.: 0.0280) SingleSource/Benchmarks/Shootout/heapsort: -1.44% (3.9173 => 3.8608, std. dev.: 0.0024) MultiSource/Benchmarks/mafft/pairlocalalign: -1.24% (28.2225 => 27.8726, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.18% (3.8887 => 3.8429, std. dev.: 0.0108) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.45s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri May 25 11:29:25 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 25 May 2012 13:29:25 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120525182925.A83212A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/792?compare_to=791&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 792, Order: 157481, Start Time: 2012-05-25 17:33:49, End Time: 2012-05-25 18:30:24 To: 791, Order: 157471, Start Time: 2012-05-25 16:10:52, End Time: 2012-05-25 17:07:35 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (60 on baseline) Performance Improvements: 0 (38 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (790 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.56% (2.0176 => 2.2711, std. dev.: 0.0149) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.71% (0.3130 => 0.3340, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.08% (0.2721 => 0.2832, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.31% (3.9660 => 4.0971, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.97% (0.6959 => 0.7166, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.81% (0.5265 => 0.5413, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.75% (0.9199 => 0.9452, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 2.61% (0.8310 => 0.8527, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.52% (1.2193 => 1.2500, std. dev.: 0.0066) MultiSource/Applications/SPASS/SPASS: 2.51% (13.8202 => 14.1672, std. dev.: 0.0100) MultiSource/Benchmarks/nbench/nbench: 2.44% (1.0594 => 1.0852, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.33% (1.3245 => 1.3553, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.26% (1.1364 => 1.1621, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.09% (0.5637 => 0.5755, std. dev.: 0.0015) MultiSource/Applications/siod/siod: 2.09% (2.1791 => 2.2247, std. dev.: 0.0054) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.99% (13.2842 => 13.5480, std. dev.: 0.0124) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.90% (1.4563 => 1.4840, std. dev.: 0.0025) MultiSource/Benchmarks/MallocBench/gs/gs: 1.85% (3.8646 => 3.9361, std. dev.: 0.0025) MultiSource/Applications/kimwitu++/kc: 1.80% (16.6129 => 16.9126, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.79% (0.5577 => 0.5677, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 1.78% (1.1061 => 1.1258, std. dev.: 0.0039) MultiSource/Applications/treecc/treecc: 1.70% (1.9270 => 1.9597, std. dev.: 0.0011) MultiSource/Applications/lambda-0_1_3/lambda: 1.69% (0.7038 => 0.7157, std. dev.: 0.0016) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.53% (0.7710 => 0.7828, std. dev.: 0.0032) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.51% (0.7460 => 0.7573, std. dev.: 0.0031) MultiSource/Applications/JM/lencod/lencod: 1.38% (14.8535 => 15.0590, std. dev.: 0.0055) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.30% (1.3819 => 1.3998, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.28% (1.3813 => 1.3990, std. dev.: 0.0054) MultiSource/Applications/hbd/hbd: 1.22% (1.3693 => 1.3860, std. dev.: 0.0035) MultiSource/Applications/SIBsim4/SIBsim4: 1.13% (1.2749 => 1.2893, std. dev.: 0.0013) MultiSource/Applications/sqlite3/sqlite3: 1.07% (16.2614 => 16.4357, std. dev.: 0.0169) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.05% (3.6692 => 3.7077, std. dev.: 0.0119) MultiSource/Applications/JM/ldecod/ldecod: 1.01% (6.5754 => 6.6421, std. dev.: 0.0067) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.89% (0.4846 => 0.6973, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 24.31% (1.8175 => 2.2594, std. dev.: 0.0246) SingleSource/Benchmarks/Misc/mandel-2: 7.49% (1.2998 => 1.3972, std. dev.: 0.0044) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7298, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.89% (1.5824 => 1.6756, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9882, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.70% (1.7688 => 1.8342, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 3.69% (7.4271 => 7.7008, std. dev.: 0.0052) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4538, std. dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.97% (8.8259 => 9.0879, std. dev.: 0.0147) SingleSource/Benchmarks/Misc/flops-6: 2.93% (1.9199 => 1.9761, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 2.79% (11.2619 => 11.5763, std. dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9392, std. dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.37% (7.9275 => 8.1151, std. dev.: 0.0172) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.56% (0.8273 => 0.8402, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.49% (1.4298 => 1.4511, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 1.48% (3.2729 => 3.3212, std. dev.: 0.0076) SingleSource/Benchmarks/Dhrystone/fldry: 1.45% (1.9290 => 1.9569, std. dev.: 0.0016) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5092, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/bisort/bisort: 1.29% (0.8239 => 0.8345, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.27% (2.0200 => 2.0457, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.27% (1.9433 => 1.9679, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/flops: 1.11% (9.0760 => 9.1765, std. dev.: 0.0011) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -20.40% (0.4657 => 0.3707, std. dev.: 0.0037) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.36% (22.5627 => 20.9027, std. dev.: 0.0036) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.85% (0.2670 => 0.2487, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.07% (0.3511 => 0.3298, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.81% (0.3650 => 0.3511, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -3.78% (0.3601 => 0.3465, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/synchronized: -3.77% (0.3663 => 0.3525, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -3.62% (0.3646 => 0.3514, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -3.61% (0.3578 => 0.3449, std. dev.: 0.0024) SingleSource/UnitTests/ObjC/property: -3.30% (0.3940 => 0.3810, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -3.27% (0.3789 => 0.3665, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -3.24% (0.3914 => 0.3787, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -3.05% (0.4003 => 0.3881, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.55% (0.6576 => 0.6408, std. dev.: 0.0049) SingleSource/Benchmarks/Misc-C++/bigfib: -2.50% (0.6250 => 0.6094, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.38% (0.8818 => 0.8608, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.58% (0.9108 => 0.8964, std. dev.: 0.0015) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.13% (1.0460 => 0.9505, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.50% (0.3139 => 0.2935, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.32% (1.3780 => 1.3047, std. dev.: 0.0063) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9624, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -4.03% (2.5089 => 2.4079, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.68% (1.9762 => 1.9035, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/richards_benchmark: -2.15% (1.1560 => 1.1311, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -2.06% (6.3560 => 6.2248, std. dev.: 0.0019) MultiSource/Applications/minisat/minisat: -1.88% (9.3358 => 9.1599, std. dev.: 0.0337) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.87% (6.6320 => 6.5081, std. dev.: 0.0036) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.81% (20.3410 => 19.9727, std. dev.: 0.0352) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9959, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) MultiSource/Applications/lua/lua: -1.49% (26.5159 => 26.1215, std. dev.: 0.0119) SingleSource/Benchmarks/Shootout/heapsort: -1.41% (3.9173 => 3.8621, std. dev.: 0.0037) MultiSource/Benchmarks/mafft/pairlocalalign: -1.25% (28.2225 => 27.8684, std. dev.: 0.0012) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.73s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri May 25 12:52:15 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 25 May 2012 14:52:15 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120525195215.53ACE2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/793?compare_to=792&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 793, Order: 157486, Start Time: 2012-05-25 18:56:28, End Time: 2012-05-25 19:53:13 To: 792, Order: 157481, Start Time: 2012-05-25 17:33:49, End Time: 2012-05-25 18:30:24 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (54 on baseline) Performance Improvements: 0 (43 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 890 (791 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 12.03% (0.3707 => 0.4153, std. dev.: 0.0125) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.00% (1.3047 => 1.3178, std. dev.: 0.0017) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.80% (2.0176 => 2.2758, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.55% (0.3130 => 0.3335, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.01% (0.2721 => 0.2830, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.30% (3.9660 => 4.0970, std. dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.05% (0.6959 => 0.7171, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.92% (0.5265 => 0.5419, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.77% (0.9199 => 0.9454, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/football/football: 2.54% (0.8310 => 0.8521, std. dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 2.48% (13.8202 => 14.1626, std. dev.: 0.0110) MultiSource/Benchmarks/nbench/nbench: 2.45% (1.0594 => 1.0854, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.34% (1.2193 => 1.2478, std. dev.: 0.0084) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.24% (1.1364 => 1.1619, std. dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.17% (1.3245 => 1.3533, std. dev.: 0.0014) MultiSource/Applications/siod/siod: 2.16% (2.1791 => 2.2262, std. dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.04% (0.5637 => 0.5752, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.01% (1.4563 => 1.4855, std. dev.: 0.0105) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.90% (13.2842 => 13.5360, std. dev.: 0.0073) MultiSource/Benchmarks/MallocBench/gs/gs: 1.86% (3.8646 => 3.9363, std. dev.: 0.0036) MultiSource/Applications/kimwitu++/kc: 1.77% (16.6129 => 16.9066, std. dev.: 0.0026) MultiSource/Applications/treecc/treecc: 1.75% (1.9270 => 1.9608, std. dev.: 0.0114) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.69% (0.7710 => 0.7840, std. dev.: 0.0021) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.62% (0.7460 => 0.7581, std. dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: 1.46% (14.8535 => 15.0710, std. dev.: 0.0053) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.25% (1.3813 => 1.3985, std. dev.: 0.0030) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.14% (1.3819 => 1.3977, std. dev.: 0.0032) MultiSource/Applications/SIBsim4/SIBsim4: 1.07% (1.2749 => 1.2885, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.04% (3.6692 => 3.7075, std. dev.: 0.0032) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 24.57% (1.8175 => 2.2641, std. dev.: 0.0418) SingleSource/Benchmarks/Misc/mandel-2: 7.64% (1.2998 => 1.3991, std. dev.: 0.0039) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.86% (1.5824 => 1.6751, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8146, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9881, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 3.73% (7.4271 => 7.7038, std. dev.: 0.0043) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.61% (1.7688 => 1.8326, std. dev.: 0.0014) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4535, std. dev.: 0.0058) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.95% (8.8259 => 9.0867, std. dev.: 0.0149) SingleSource/Benchmarks/Misc/flops-6: 2.90% (1.9199 => 1.9756, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 2.81% (11.2619 => 11.5779, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.76% (2.8606 => 2.9395, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.32% (7.9275 => 8.1112, std. dev.: 0.0110) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ffbench: 1.55% (0.8273 => 0.8401, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 1.54% (3.2729 => 3.3233, std. dev.: 0.0062) MultiSource/Applications/lemon/lemon: 1.42% (1.4298 => 1.4501, std. dev.: 0.0054) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5097, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/bisort/bisort: 1.31% (0.8239 => 0.8347, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.30% (2.0200 => 2.0463, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.25% (1.9433 => 1.9675, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 1.14% (9.0760 => 9.1795, std. dev.: 0.0007) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -10.82% (0.4657 => 0.4153, std. dev.: 0.0125) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.35% (22.5627 => 20.9053, std. dev.: 0.0102) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.93% (0.2670 => 0.2485, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.10% (0.3511 => 0.3297, std. dev.: 0.0068) SingleSource/UnitTests/ObjC/exceptions-3: -4.58% (0.3623 => 0.3457, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.49% (0.3650 => 0.3486, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-2: -4.42% (0.3601 => 0.3442, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -4.37% (0.3663 => 0.3503, std. dev.: 0.0031) SingleSource/UnitTests/ObjC/trivial-interface: -4.30% (0.3578 => 0.3424, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -4.25% (0.3646 => 0.3491, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/property: -4.01% (0.3940 => 0.3782, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/for-in: -3.93% (0.3789 => 0.3640, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -3.81% (0.3914 => 0.3765, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/parameter-passing: -3.55% (0.4003 => 0.3861, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.54% (0.8818 => 0.8594, std. dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/bigfib: -2.53% (0.6250 => 0.6092, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.37% (0.6576 => 0.6420, std. dev.: 0.0014) SingleSource/UnitTests/ObjC++/Hello: -2.26% (0.5748 => 0.5618, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: -2.10% (0.5818 => 0.5696, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.61% (0.9108 => 0.8961, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: -1.49% (0.7061 => 0.6956, std. dev.: 0.0019) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.14% (1.0460 => 0.9504, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.56% (0.3139 => 0.2933, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9624, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.37% (1.3780 => 1.3178, std. dev.: 0.0017) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -3.98% (2.5089 => 2.4090, std. dev.: 0.0034) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.68% (1.9762 => 1.9034, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: -2.14% (1.1560 => 1.1313, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.98% (6.3560 => 6.2303, std. dev.: 0.0129) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.94% (6.6320 => 6.5032, std. dev.: 0.0056) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.79% (20.3410 => 19.9779, std. dev.: 0.0522) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9950, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0013) MultiSource/Applications/lua/lua: -1.50% (26.5159 => 26.1183, std. dev.: 0.0194) SingleSource/Benchmarks/Shootout/heapsort: -1.42% (3.9173 => 3.8616, std. dev.: 0.0029) MultiSource/Benchmarks/mafft/pairlocalalign: -1.25% (28.2225 => 27.8689, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.19% (2.5254 => 2.4954, std. dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.05% (3.8887 => 3.8478, std. dev.: 0.0019) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.84s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri May 25 14:34:09 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 25 May 2012 16:34:09 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120525213409.5ADF02A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/794?compare_to=793&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 794, Order: 157491, Start Time: 2012-05-25 20:38:25, End Time: 2012-05-25 21:35:08 To: 793, Order: 157486, Start Time: 2012-05-25 18:56:28, End Time: 2012-05-25 19:53:13 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (55 on baseline) Performance Improvements: 0 (44 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (789 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.70% (2.0176 => 2.2738, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.52% (0.3130 => 0.3334, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.19% (0.2721 => 0.2835, std. dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.23% (3.9660 => 4.0942, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.77% (0.6959 => 0.7152, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.77% (0.5265 => 0.5411, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.74% (0.9199 => 0.9451, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 2.47% (1.0594 => 1.0856, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/football/football: 2.47% (0.8310 => 0.8515, std. dev.: 0.0014) MultiSource/Applications/SPASS/SPASS: 2.45% (13.8202 => 14.1593, std. dev.: 0.0132) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.33% (1.2193 => 1.2477, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.31% (0.5637 => 0.5767, std. dev.: 0.0027) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.12% (1.1364 => 1.1605, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.10% (1.3245 => 1.3523, std. dev.: 0.0070) MultiSource/Applications/Burg/burg: 2.02% (1.1061 => 1.1284, std. dev.: 0.0054) MultiSource/Applications/siod/siod: 1.97% (2.1791 => 2.2221, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.83% (13.2842 => 13.5273, std. dev.: 0.0112) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.70% (1.4563 => 1.4811, std. dev.: 0.0025) MultiSource/Benchmarks/MallocBench/gs/gs: 1.70% (3.8646 => 3.9302, std. dev.: 0.0025) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.65% (0.7710 => 0.7837, std. dev.: 0.0025) MultiSource/Applications/kimwitu++/kc: 1.65% (16.6129 => 16.8863, std. dev.: 0.0047) MultiSource/Applications/treecc/treecc: 1.61% (1.9270 => 1.9580, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.55% (0.7460 => 0.7576, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.37% (1.3819 => 1.4009, std. dev.: 0.0017) MultiSource/Applications/JM/lencod/lencod: 1.34% (14.8535 => 15.0531, std. dev.: 0.0110) MultiSource/Applications/hbd/hbd: 1.15% (1.3693 => 1.3851, std. dev.: 0.0027) MultiSource/Applications/SIBsim4/SIBsim4: 1.11% (1.2749 => 1.2891, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.09% (1.3813 => 1.3963, std. dev.: 0.0042) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.05% (3.6692 => 3.7078, std. dev.: 0.0028) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 24.08% (1.8175 => 2.2552, std. dev.: 0.0212) SingleSource/Benchmarks/Misc/mandel-2: 7.81% (1.2998 => 1.4013, std. dev.: 0.0163) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6755, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8146, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 3.81% (1.9144 => 1.9874, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.67% (1.7688 => 1.8337, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/salsa20: 3.62% (7.4271 => 7.6956, std. dev.: 0.0018) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4545, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.86% (8.8259 => 9.0787, std. dev.: 0.0144) SingleSource/Benchmarks/Misc/flops-6: 2.84% (1.9199 => 1.9744, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 2.79% (11.2619 => 11.5765, std. dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.74% (2.8606 => 2.9391, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.28% (7.9275 => 8.1080, std. dev.: 0.0065) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0065) SingleSource/Benchmarks/Misc/ffbench: 1.57% (0.8273 => 0.8403, std. dev.: 0.0016) MultiSource/Applications/siod/siod: 1.50% (3.2729 => 3.3220, std. dev.: 0.0018) MultiSource/Applications/lemon/lemon: 1.45% (1.4298 => 1.4505, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5093, std. dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 1.34% (5.0168 => 5.0840, std. dev.: 0.0047) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.29% (2.0200 => 2.0460, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 1.13% (9.0760 => 9.1782, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -17.33% (0.4657 => 0.3850, std. dev.: 0.0256) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.45% (22.5627 => 20.8824, std. dev.: 0.0120) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.97% (0.2670 => 0.2484, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.29% (0.3511 => 0.3290, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-3: -4.50% (0.3623 => 0.3460, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.49% (0.3650 => 0.3486, std. dev.: 0.0022) SingleSource/UnitTests/ObjC/exceptions-2: -4.47% (0.3601 => 0.3440, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -4.37% (0.3663 => 0.3503, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -4.36% (0.3646 => 0.3487, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -4.33% (0.3578 => 0.3423, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -4.01% (0.3940 => 0.3782, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -3.96% (0.3789 => 0.3639, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -3.81% (0.3914 => 0.3765, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -3.70% (0.4003 => 0.3855, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.61% (0.8818 => 0.8588, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: -2.58% (0.6250 => 0.6089, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.45% (0.6576 => 0.6415, std. dev.: 0.0015) SingleSource/UnitTests/ObjC++/Hello: -2.38% (0.5748 => 0.5611, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: -1.98% (0.5818 => 0.5703, std. dev.: 0.0029) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.64% (0.9108 => 0.8959, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: -1.44% (0.7061 => 0.6959, std. dev.: 0.0020) MultiSource/Applications/lua/lua: -1.03% (3.7467 => 3.7082, std. dev.: 0.0046) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.13% (1.0460 => 0.9505, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.53% (0.3139 => 0.2934, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.07% (1.3780 => 1.3081, std. dev.: 0.0178) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9622, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -4.04% (2.5089 => 2.4075, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -3.70% (1.9762 => 1.9031, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.67% (0.3458 => 0.3331, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: -2.13% (1.1560 => 1.1314, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/lists: -2.04% (6.3560 => 6.2262, std. dev.: 0.0071) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.94% (6.6320 => 6.5031, std. dev.: 0.0063) MultiSource/Applications/minisat/minisat: -1.89% (9.3358 => 9.1589, std. dev.: 0.0049) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.81% (20.3410 => 19.9736, std. dev.: 0.0349) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3446, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9956, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) MultiSource/Applications/lua/lua: -1.54% (26.5159 => 26.1066, std. dev.: 0.0233) SingleSource/Benchmarks/Shootout/heapsort: -1.39% (3.9173 => 3.8629, std. dev.: 0.0025) MultiSource/Benchmarks/mafft/pairlocalalign: -1.26% (28.2225 => 27.8681, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.10% (3.8887 => 3.8460, std. dev.: 0.0046) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.47s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri May 25 15:56:40 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 25 May 2012 17:56:40 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120525225640.6F24F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/795?compare_to=794&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 795, Order: 157498, Start Time: 2012-05-25 22:01:08, End Time: 2012-05-25 22:57:39 To: 794, Order: 157491, Start Time: 2012-05-25 20:38:25, End Time: 2012-05-25 21:35:08 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (58 on baseline) Performance Improvements: 1 (41 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 891 (789 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -4.57% (0.3850 => 0.3674, std. dev.: 0.0053) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.46% (2.0176 => 2.2689, std. dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.42% (0.3130 => 0.3331, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.97% (0.2721 => 0.2829, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.44% (3.9660 => 4.1024, std. dev.: 0.0126) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.02% (0.5265 => 0.5424, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.99% (0.6959 => 0.7167, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.84% (0.9199 => 0.9460, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 2.58% (0.8310 => 0.8524, std. dev.: 0.0021) MultiSource/Applications/SPASS/SPASS: 2.57% (13.8202 => 14.1760, std. dev.: 0.0192) MultiSource/Benchmarks/nbench/nbench: 2.50% (1.0594 => 1.0859, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.32% (1.2193 => 1.2476, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.30% (0.7710 => 0.7887, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.25% (0.5637 => 0.5764, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.25% (1.1364 => 1.1620, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.23% (1.3245 => 1.3540, std. dev.: 0.0011) MultiSource/Applications/siod/siod: 2.09% (2.1791 => 2.2246, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/gs/gs: 2.00% (3.8646 => 3.9418, std. dev.: 0.0075) MultiSource/Applications/Burg/burg: 1.93% (1.1061 => 1.1274, std. dev.: 0.0011) MultiSource/Applications/kimwitu++/kc: 1.90% (16.6129 => 16.9292, std. dev.: 0.0163) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.85% (1.4563 => 1.4833, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.85% (13.2842 => 13.5298, std. dev.: 0.0183) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.85% (0.5577 => 0.5680, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 1.80% (0.7038 => 0.7165, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 1.77% (1.9270 => 1.9611, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.76% (0.7460 => 0.7591, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.58% (1.3819 => 1.4037, std. dev.: 0.0019) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.55% (1.3813 => 1.4027, std. dev.: 0.0000) MultiSource/Applications/hbd/hbd: 1.52% (1.3693 => 1.3901, std. dev.: 0.0030) MultiSource/Applications/JM/lencod/lencod: 1.29% (14.8535 => 15.0448, std. dev.: 0.0055) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.10% (3.6692 => 3.7097, std. dev.: 0.0028) MultiSource/Applications/sqlite3/sqlite3: 1.03% (16.2614 => 16.4288, std. dev.: 0.0032) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/fbench: 23.93% (1.8175 => 2.2524, std. dev.: 0.0508) SingleSource/Benchmarks/Misc/mandel-2: 8.39% (1.2998 => 1.4088, std. dev.: 0.0058) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.83% (1.5824 => 1.6747, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8146, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: 3.80% (1.9144 => 1.9871, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.64% (1.7688 => 1.8332, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: 3.52% (7.4271 => 7.6882, std. dev.: 0.0053) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4536, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-6: 2.86% (1.9199 => 1.9748, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 2.80% (11.2619 => 11.5767, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9392, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.74% (8.8259 => 9.0677, std. dev.: 0.0135) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.27% (7.9275 => 8.1076, std. dev.: 0.0132) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9603, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.60% (0.8273 => 0.8405, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 1.48% (3.2729 => 3.3212, std. dev.: 0.0004) MultiSource/Applications/lemon/lemon: 1.46% (1.4298 => 1.4507, std. dev.: 0.0008) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5090, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.29% (2.0200 => 2.0460, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0034) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.15% (1.9433 => 1.9657, std. dev.: 0.0053) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1780, std. dev.: 0.0014) MultiSource/Benchmarks/sim/sim: 1.02% (5.0168 => 5.0679, std. dev.: 0.0054) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -21.11% (0.4657 => 0.3674, std. dev.: 0.0053) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.17% (22.5627 => 20.9440, std. dev.: 0.0029) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.97% (0.2670 => 0.2484, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.35% (0.3511 => 0.3288, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: -4.06% (0.3623 => 0.3476, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.03% (0.3650 => 0.3503, std. dev.: 0.0019) SingleSource/UnitTests/ObjC/synchronized: -3.88% (0.3663 => 0.3521, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -3.86% (0.3601 => 0.3462, std. dev.: 0.0030) SingleSource/UnitTests/ObjC/trivial-interface: -3.83% (0.3578 => 0.3441, std. dev.: 0.0034) SingleSource/UnitTests/ObjC/exceptions-4: -3.81% (0.3646 => 0.3507, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -3.50% (0.3940 => 0.3802, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -3.40% (0.3914 => 0.3781, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -3.35% (0.3789 => 0.3662, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -3.15% (0.4003 => 0.3877, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.97% (0.8818 => 0.8556, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.57% (0.6576 => 0.6407, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/bigfib: -2.26% (0.6250 => 0.6109, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.56% (0.9108 => 0.8966, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.13% (1.0460 => 0.9505, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.53% (0.3139 => 0.2934, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.86% (1.3780 => 1.3110, std. dev.: 0.0075) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9624, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -4.00% (2.5089 => 2.4086, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.73% (0.3458 => 0.3329, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.67% (1.9762 => 1.9036, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/health/health: -2.23% (0.4533 => 0.4432, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: -2.16% (1.1560 => 1.1310, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -2.06% (6.3560 => 6.2251, std. dev.: 0.0034) MultiSource/Applications/minisat/minisat: -1.99% (9.3358 => 9.1503, std. dev.: 0.0392) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.92% (6.6320 => 6.5048, std. dev.: 0.0032) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.84% (20.3410 => 19.9677, std. dev.: 0.0734) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3446, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9956, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) MultiSource/Applications/lua/lua: -1.56% (26.5159 => 26.1032, std. dev.: 0.0254) SingleSource/Benchmarks/Shootout/heapsort: -1.43% (3.9173 => 3.8611, std. dev.: 0.0061) MultiSource/Benchmarks/mafft/pairlocalalign: -1.24% (28.2225 => 27.8727, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.08% (3.8887 => 3.8466, std. dev.: 0.0043) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.76s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri May 25 17:19:08 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 25 May 2012 19:19:08 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120526001908.E0E0A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/796?compare_to=795&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 796, Order: 157504, Start Time: 2012-05-25 23:23:31, End Time: 2012-05-26 00:20:06 To: 795, Order: 157498, Start Time: 2012-05-25 22:01:08, End Time: 2012-05-25 22:57:39 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (58 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (791 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.44% (2.0176 => 2.2686, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.39% (0.3130 => 0.3330, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.04% (0.2721 => 0.2831, std. dev.: 0.0019) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.31% (3.9660 => 4.0973, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.95% (0.6959 => 0.7164, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.92% (0.5265 => 0.5419, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.79% (0.9199 => 0.9456, std. dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 2.55% (13.8202 => 14.1731, std. dev.: 0.0139) MultiSource/Benchmarks/Prolangs-C/football/football: 2.50% (0.8310 => 0.8518, std. dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 2.44% (1.0594 => 1.0852, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.25% (0.5637 => 0.5764, std. dev.: 0.0025) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.24% (1.1364 => 1.1619, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.22% (1.3245 => 1.3539, std. dev.: 0.0011) MultiSource/Applications/siod/siod: 1.89% (2.1791 => 2.2203, std. dev.: 0.0087) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.88% (0.7710 => 0.7855, std. dev.: 0.0045) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.85% (1.4563 => 1.4833, std. dev.: 0.0019) MultiSource/Applications/Burg/burg: 1.85% (1.1061 => 1.1266, std. dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.85% (0.5577 => 0.5680, std. dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 1.83% (16.6129 => 16.9165, std. dev.: 0.0080) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.83% (13.2842 => 13.5268, std. dev.: 0.0048) MultiSource/Benchmarks/MallocBench/gs/gs: 1.80% (3.8646 => 3.9340, std. dev.: 0.0043) MultiSource/Applications/treecc/treecc: 1.79% (1.9270 => 1.9615, std. dev.: 0.0039) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.77% (1.3819 => 1.4064, std. dev.: 0.0040) MultiSource/Applications/lambda-0_1_3/lambda: 1.62% (0.7038 => 0.7152, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.60% (0.7460 => 0.7579, std. dev.: 0.0016) MultiSource/Applications/hbd/hbd: 1.57% (1.3693 => 1.3908, std. dev.: 0.0040) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.45% (1.3813 => 1.4013, std. dev.: 0.0015) MultiSource/Applications/JM/lencod/lencod: 1.36% (14.8535 => 15.0558, std. dev.: 0.0093) MultiSource/Applications/SIBsim4/SIBsim4: 1.04% (1.2749 => 1.2881, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.02% (3.6692 => 3.7067, std. dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: 1.01% (16.2614 => 16.4251, std. dev.: 0.0201) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 24.37% (1.8175 => 2.2604, std. dev.: 0.0053) SingleSource/Benchmarks/Misc/mandel-2: 7.71% (1.2998 => 1.4000, std. dev.: 0.0113) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7298, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6755, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9878, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 3.65% (7.4271 => 7.6980, std. dev.: 0.0044) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.65% (1.7688 => 1.8333, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4534, std. dev.: 0.0025) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.88% (8.8259 => 9.0801, std. dev.: 0.0168) SingleSource/Benchmarks/Misc/flops-6: 2.84% (1.9199 => 1.9745, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 2.81% (11.2619 => 11.5783, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.74% (2.8606 => 2.9390, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.42% (7.9275 => 8.1195, std. dev.: 0.0124) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0084) SingleSource/Benchmarks/Misc/ffbench: 1.54% (0.8273 => 0.8400, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 1.48% (3.2729 => 3.3213, std. dev.: 0.0069) MultiSource/Applications/lemon/lemon: 1.43% (1.4298 => 1.4503, std. dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.43% (8.3908 => 8.5110, std. dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.30% (2.0200 => 2.0462, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2135, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.16% (1.9433 => 1.9658, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1776, std. dev.: 0.0018) MultiSource/Benchmarks/sim/sim: 1.03% (5.0168 => 5.0686, std. dev.: 0.0066) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -19.37% (0.4657 => 0.3755, std. dev.: 0.0175) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.22% (22.5627 => 20.9347, std. dev.: 0.0188) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.00% (0.2670 => 0.2483, std. dev.: 0.0034) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.38% (0.3511 => 0.3287, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-3: -3.67% (0.3623 => 0.3490, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.59% (0.3650 => 0.3519, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -3.58% (0.3601 => 0.3472, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -3.55% (0.3663 => 0.3533, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -3.49% (0.3578 => 0.3453, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -3.32% (0.3646 => 0.3525, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -3.20% (0.3940 => 0.3814, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -3.09% (0.3789 => 0.3672, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: -3.04% (0.3914 => 0.3795, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.90% (0.8818 => 0.8562, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -2.87% (0.4003 => 0.3888, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.55% (0.6576 => 0.6408, std. dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/bigfib: -2.24% (0.6250 => 0.6110, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.70% (0.9108 => 0.8953, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.13% (1.0460 => 0.9505, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.56% (0.3139 => 0.2933, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.21% (2.4152 => 2.2652, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.65% (1.3780 => 1.3139, std. dev.: 0.0072) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9622, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -4.05% (2.5089 => 2.4072, std. dev.: 0.0013) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.67% (1.9762 => 1.9036, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: -2.23% (9.3358 => 9.1276, std. dev.: 0.0202) SingleSource/Benchmarks/Shootout/lists: -2.22% (6.3560 => 6.2146, std. dev.: 0.0082) SingleSource/Benchmarks/Misc/richards_benchmark: -2.12% (1.1560 => 1.1315, std. dev.: 0.0014) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.96% (6.6320 => 6.5020, std. dev.: 0.0042) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3446, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.67% (20.3410 => 20.0007, std. dev.: 0.0086) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9954, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) MultiSource/Applications/lua/lua: -1.48% (26.5159 => 26.1246, std. dev.: 0.0240) SingleSource/Benchmarks/Shootout/heapsort: -1.41% (3.9173 => 3.8619, std. dev.: 0.0030) MultiSource/Benchmarks/mafft/pairlocalalign: -1.25% (28.2225 => 27.8691, std. dev.: 0.0006) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.42s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri May 25 18:41:38 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 25 May 2012 20:41:38 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120526014138.1480D2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/797?compare_to=796&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 797, Order: 157505, Start Time: 2012-05-26 00:46:04, End Time: 2012-05-26 01:42:35 To: 796, Order: 157504, Start Time: 2012-05-25 23:23:31, End Time: 2012-05-26 00:20:06 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (51 on baseline) Performance Improvements: 1 (43 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 891 (794 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -1.06% (16.9165 => 16.7373, std. dev.: 0.0255) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 11.49% (2.0176 => 2.2494, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.88% (0.3130 => 0.3314, std. dev.: 0.0018) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.86% (3.9660 => 4.0795, std. dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.40% (0.9199 => 0.9420, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/football/football: 2.35% (0.8310 => 0.8505, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.26% (0.5265 => 0.5384, std. dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 2.25% (1.0594 => 1.0832, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.21% (0.6959 => 0.7113, std. dev.: 0.0015) MultiSource/Applications/SPASS/SPASS: 2.04% (13.8202 => 14.1024, std. dev.: 0.0127) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.01% (1.2193 => 1.2438, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.92% (0.5637 => 0.5745, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.88% (1.1364 => 1.1578, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.74% (1.3245 => 1.3476, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.71% (13.2842 => 13.5120, std. dev.: 0.0189) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.63% (0.7710 => 0.7836, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.45% (1.4563 => 1.4774, std. dev.: 0.0033) MultiSource/Applications/Burg/burg: 1.34% (1.1061 => 1.1209, std. dev.: 0.0030) MultiSource/Benchmarks/MallocBench/gs/gs: 1.23% (3.8646 => 3.9121, std. dev.: 0.0034) MultiSource/Applications/treecc/treecc: 1.19% (1.9270 => 1.9500, std. dev.: 0.0015) MultiSource/Applications/siod/siod: 1.16% (2.1791 => 2.2044, std. dev.: 0.0029) MultiSource/Applications/JM/lencod/lencod: 1.15% (14.8535 => 15.0247, std. dev.: 0.0067) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.10% (1.3813 => 1.3965, std. dev.: 0.0047) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.09% (3.6692 => 3.7092, std. dev.: 0.0042) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.06% (1.3819 => 1.3965, std. dev.: 0.0022) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 24.53% (1.8175 => 2.2634, std. dev.: 0.0400) SingleSource/Benchmarks/Misc/mandel-2: 8.49% (1.2998 => 1.4102, std. dev.: 0.0086) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7298, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.92% (1.5824 => 1.6761, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9881, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.67% (1.7688 => 1.8337, std. dev.: 0.0052) SingleSource/Benchmarks/Misc/salsa20: 3.58% (7.4271 => 7.6932, std. dev.: 0.0022) MultiSource/Applications/hexxagon/hexxagon: 2.98% (12.0921 => 12.4527, std. dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.98% (8.8259 => 9.0885, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/flops-6: 2.83% (1.9199 => 1.9743, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 2.80% (11.2619 => 11.5768, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9394, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.23% (7.9275 => 8.1044, std. dev.: 0.0160) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/ffbench: 1.55% (0.8273 => 0.8401, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 1.48% (3.2729 => 3.3213, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5086, std. dev.: 0.0034) MultiSource/Applications/lemon/lemon: 1.36% (1.4298 => 1.4492, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.26% (2.0200 => 2.0455, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.21% (1.9433 => 1.9669, std. dev.: 0.0061) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0099) MultiSource/Benchmarks/sim/sim: 1.12% (5.0168 => 5.0729, std. dev.: 0.0062) SingleSource/Benchmarks/Misc/flops: 1.11% (9.0760 => 9.1768, std. dev.: 0.0008) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -19.86% (0.4657 => 0.3732, std. dev.: 0.0129) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.86% (22.5627 => 20.7894, std. dev.: 0.0076) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.27% (0.2670 => 0.2476, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.49% (0.3511 => 0.3283, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-3: -4.33% (0.3623 => 0.3466, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.30% (0.3650 => 0.3493, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/synchronized: -4.26% (0.3663 => 0.3507, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: -4.14% (0.3578 => 0.3430, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -4.05% (0.3601 => 0.3455, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: -4.00% (0.3646 => 0.3500, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/property: -3.96% (0.3940 => 0.3784, std. dev.: 0.0036) SingleSource/UnitTests/ObjC/parameter-passing: -3.72% (0.4003 => 0.3854, std. dev.: 0.0040) SingleSource/UnitTests/ObjC/exceptions: -3.70% (0.3914 => 0.3769, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: -3.59% (0.3789 => 0.3653, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.90% (0.6576 => 0.6385, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.32% (0.8818 => 0.8613, std. dev.: 0.0067) SingleSource/UnitTests/ObjC++/Hello: -2.19% (0.5748 => 0.5622, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: -1.94% (0.5818 => 0.5705, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.76% (0.9108 => 0.8948, std. dev.: 0.0016) MultiSource/Applications/lua/lua: -1.54% (3.7467 => 3.6890, std. dev.: 0.0035) SingleSource/UnitTests/ObjC++/property-reference: -1.50% (0.7061 => 0.6955, std. dev.: 0.0019) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.14% (4.9865 => 4.9296, std. dev.: 0.0017) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.13% (1.0460 => 0.9505, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.56% (0.3139 => 0.2933, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.02% (1.3780 => 1.3088, std. dev.: 0.0042) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9622, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0016) SingleSource/Benchmarks/Dhrystone/dry: -4.01% (2.5089 => 2.4083, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -3.65% (1.9762 => 1.9041, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout/lists: -2.40% (6.3560 => 6.2033, std. dev.: 0.0101) SingleSource/Benchmarks/Misc/richards_benchmark: -2.12% (1.1560 => 1.1315, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.90% (20.3410 => 19.9550, std. dev.: 0.0799) MultiSource/Applications/minisat/minisat: -1.89% (9.3358 => 9.1592, std. dev.: 0.0454) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.87% (6.6320 => 6.5082, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3446, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9957, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.50% (3.9173 => 3.8586, std. dev.: 0.0011) MultiSource/Applications/lua/lua: -1.40% (26.5159 => 26.1449, std. dev.: 0.0098) MultiSource/Benchmarks/mafft/pairlocalalign: -1.24% (28.2225 => 27.8723, std. dev.: 0.0004) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.37s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri May 25 20:03:59 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 25 May 2012 22:03:59 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120526030359.761592A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/798?compare_to=797&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 798, Order: 157508, Start Time: 2012-05-26 02:08:28, End Time: 2012-05-26 03:04:57 To: 797, Order: 157505, Start Time: 2012-05-26 00:46:04, End Time: 2012-05-26 01:42:35 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (49 on baseline) Performance Improvements: 0 (42 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 891 (797 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 1.66% (3.7817 => 3.8443, std. dev.: 0.0082) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 11.39% (2.0176 => 2.2475, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.01% (0.3130 => 0.3318, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.78% (3.9660 => 4.0761, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.37% (0.6959 => 0.7124, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.34% (0.5265 => 0.5388, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 2.30% (1.0594 => 1.0838, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/football/football: 2.29% (0.8310 => 0.8500, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.28% (0.9199 => 0.9409, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.04% (1.2193 => 1.2442, std. dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: 2.01% (13.8202 => 14.0983, std. dev.: 0.0148) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.92% (1.3245 => 1.3499, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.92% (0.5637 => 0.5745, std. dev.: 0.0020) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.91% (1.1364 => 1.1581, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.66% (13.2842 => 13.5053, std. dev.: 0.0092) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.65% (1.4563 => 1.4803, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.35% (0.7710 => 0.7814, std. dev.: 0.0031) MultiSource/Applications/treecc/treecc: 1.21% (1.9270 => 1.9504, std. dev.: 0.0074) MultiSource/Benchmarks/MallocBench/gs/gs: 1.20% (3.8646 => 3.9110, std. dev.: 0.0029) MultiSource/Applications/siod/siod: 1.18% (2.1791 => 2.2048, std. dev.: 0.0024) MultiSource/Applications/JM/lencod/lencod: 1.15% (14.8535 => 15.0241, std. dev.: 0.0167) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.03% (1.3813 => 1.3955, std. dev.: 0.0013) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.62% (0.4846 => 0.6960, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/fbench: 24.29% (1.8175 => 2.2590, std. dev.: 0.0172) SingleSource/Benchmarks/Misc/mandel-2: 7.71% (1.2998 => 1.4000, std. dev.: 0.0061) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7298, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.89% (1.5824 => 1.6756, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9878, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 3.70% (7.4271 => 7.7020, std. dev.: 0.0015) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.61% (1.7688 => 1.8327, std. dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4541, std. dev.: 0.0026) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.86% (8.8259 => 9.0783, std. dev.: 0.0103) SingleSource/Benchmarks/Misc/flops-6: 2.85% (1.9199 => 1.9746, std. dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 2.80% (11.2619 => 11.5774, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.74% (2.8606 => 2.9390, std. dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.52% (7.9275 => 8.1276, std. dev.: 0.0056) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/llubenchmark/llu: 1.89% (3.7731 => 3.8443, std. dev.: 0.0082) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.60% (0.8273 => 0.8405, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 1.48% (3.2729 => 3.3213, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5092, std. dev.: 0.0029) MultiSource/Benchmarks/sim/sim: 1.39% (5.0168 => 5.0866, std. dev.: 0.0072) MultiSource/Applications/lemon/lemon: 1.38% (1.4298 => 1.4495, std. dev.: 0.0038) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.27% (2.0200 => 2.0457, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.16% (1.9433 => 1.9659, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: 1.10% (9.0760 => 9.1758, std. dev.: 0.0017) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -21.09% (0.4657 => 0.3675, std. dev.: 0.0316) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.77% (22.5627 => 20.8106, std. dev.: 0.0173) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.38% (0.2670 => 0.2473, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.69% (0.3511 => 0.3276, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-3: -4.83% (0.3623 => 0.3448, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -4.75% (0.3663 => 0.3489, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -4.75% (0.3601 => 0.3430, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.68% (0.3650 => 0.3479, std. dev.: 0.0023) SingleSource/UnitTests/ObjC/exceptions-4: -4.64% (0.3646 => 0.3477, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: -4.56% (0.3578 => 0.3415, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -4.52% (0.3940 => 0.3762, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -4.22% (0.3789 => 0.3629, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: -4.17% (0.4003 => 0.3836, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -4.06% (0.3914 => 0.3755, std. dev.: 0.0032) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.18% (0.6576 => 0.6367, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: -2.82% (0.6250 => 0.6074, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.44% (0.8818 => 0.8603, std. dev.: 0.0055) SingleSource/UnitTests/ObjC++/Hello: -2.38% (0.5748 => 0.5611, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: -2.08% (0.5818 => 0.5697, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.77% (0.9108 => 0.8947, std. dev.: 0.0051) MultiSource/Applications/lua/lua: -1.55% (3.7467 => 3.6888, std. dev.: 0.0058) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.13% (1.0460 => 0.9505, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.56% (0.3139 => 0.2933, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.76% (1.3780 => 1.3124, std. dev.: 0.0087) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9624, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -3.95% (2.5089 => 2.4097, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.67% (0.3458 => 0.3331, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.66% (1.9762 => 1.9039, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -2.39% (6.3560 => 6.2044, std. dev.: 0.0131) SingleSource/Benchmarks/Misc/richards_benchmark: -2.15% (1.1560 => 1.1311, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: -1.92% (9.3358 => 9.1563, std. dev.: 0.0046) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.86% (6.6320 => 6.5084, std. dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.70% (20.3410 => 19.9958, std. dev.: 0.0508) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9952, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.56% (0.9692 => 0.9541, std. dev.: 0.0000) MultiSource/Applications/lua/lua: -1.47% (26.5159 => 26.1264, std. dev.: 0.0204) SingleSource/Benchmarks/Shootout/heapsort: -1.40% (3.9173 => 3.8626, std. dev.: 0.0120) MultiSource/Benchmarks/mafft/pairlocalalign: -1.25% (28.2225 => 27.8688, std. dev.: 0.0028) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.75s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat May 26 01:30:08 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 26 May 2012 03:30:08 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120526083008.1C6DD2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/799?compare_to=798&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 799, Order: 157511, Start Time: 2012-05-26 07:34:12, End Time: 2012-05-26 08:31:05 To: 798, Order: 157508, Start Time: 2012-05-26 02:08:28, End Time: 2012-05-26 03:04:57 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (53 on baseline) Performance Improvements: 0 (42 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (793 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 11.83% (2.0176 => 2.2563, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.29% (0.3130 => 0.3327, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.75% (0.2721 => 0.2823, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.94% (3.9660 => 4.0825, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.69% (0.9199 => 0.9446, std. dev.: 0.0030) MultiSource/Benchmarks/nbench/nbench: 2.56% (1.0594 => 1.0865, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.53% (0.6959 => 0.7135, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/football/football: 2.52% (0.8310 => 0.8519, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.51% (0.5265 => 0.5397, std. dev.: 0.0021) MultiSource/Applications/SPASS/SPASS: 2.31% (13.8202 => 14.1396, std. dev.: 0.0130) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.25% (0.5637 => 0.5764, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.15% (1.2193 => 1.2455, std. dev.: 0.0022) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.09% (0.7710 => 0.7871, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.08% (1.3245 => 1.3521, std. dev.: 0.0047) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.08% (1.1364 => 1.1600, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.92% (1.4563 => 1.4843, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.84% (13.2842 => 13.5289, std. dev.: 0.0103) MultiSource/Applications/siod/siod: 1.82% (2.1791 => 2.2188, std. dev.: 0.0063) MultiSource/Benchmarks/MallocBench/gs/gs: 1.59% (3.8646 => 3.9260, std. dev.: 0.0045) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.54% (0.7460 => 0.7575, std. dev.: 0.0014) MultiSource/Applications/Burg/burg: 1.49% (1.1061 => 1.1226, std. dev.: 0.0038) MultiSource/Applications/treecc/treecc: 1.43% (1.9270 => 1.9546, std. dev.: 0.0073) MultiSource/Applications/kimwitu++/kc: 1.36% (16.6129 => 16.8391, std. dev.: 0.0123) MultiSource/Applications/JM/lencod/lencod: 1.32% (14.8535 => 15.0503, std. dev.: 0.0100) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.21% (1.3813 => 1.3980, std. dev.: 0.0019) MultiSource/Applications/SIBsim4/SIBsim4: 1.04% (1.2749 => 1.2882, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.04% (3.6692 => 3.7072, std. dev.: 0.0044) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.93% (0.4846 => 0.6975, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/fbench: 24.13% (1.8175 => 2.2561, std. dev.: 0.0429) SingleSource/Benchmarks/Misc/mandel-2: 7.75% (1.2998 => 1.4005, std. dev.: 0.0099) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.90% (1.5824 => 1.6757, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.80% (1.9144 => 1.9871, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.70% (1.7688 => 1.8343, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 3.64% (7.4271 => 7.6974, std. dev.: 0.0059) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4534, std. dev.: 0.0050) SingleSource/Benchmarks/Misc/flops-6: 2.83% (1.9199 => 1.9742, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 2.79% (11.2619 => 11.5763, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9394, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.70% (8.8259 => 9.0642, std. dev.: 0.0171) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.48% (7.9275 => 8.1238, std. dev.: 0.0051) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.60% (0.8273 => 0.8405, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.52% (1.4298 => 1.4515, std. dev.: 0.0042) MultiSource/Applications/siod/siod: 1.48% (3.2729 => 3.3215, std. dev.: 0.0035) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5085, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.27% (2.0200 => 2.0457, std. dev.: 0.0006) MultiSource/Benchmarks/sim/sim: 1.26% (5.0168 => 5.0801, std. dev.: 0.0099) SingleSource/Benchmarks/Dhrystone/fldry: 1.24% (1.9290 => 1.9530, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0064) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1779, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.37% (22.5627 => 20.9000, std. dev.: 0.0110) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.04% (0.2670 => 0.2482, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.47% (0.3511 => 0.3284, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-2: -4.97% (0.3601 => 0.3422, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.96% (0.3650 => 0.3469, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-3: -4.94% (0.3623 => 0.3444, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -4.89% (0.3663 => 0.3484, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -4.85% (0.3646 => 0.3469, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -4.75% (0.3578 => 0.3408, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/property: -4.49% (0.3940 => 0.3763, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -4.38% (0.3789 => 0.3623, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: -4.19% (0.3914 => 0.3750, std. dev.: 0.0031) SingleSource/UnitTests/ObjC/parameter-passing: -4.05% (0.4003 => 0.3841, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: -2.83% (0.6250 => 0.6073, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: -2.59% (0.5748 => 0.5599, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.52% (0.6576 => 0.6410, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: -2.48% (0.5818 => 0.5674, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.28% (0.8818 => 0.8617, std. dev.: 0.0024) SingleSource/UnitTests/ObjC++/property-reference: -1.91% (0.7061 => 0.6926, std. dev.: 0.0035) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.55% (0.9108 => 0.8967, std. dev.: 0.0004) MultiSource/Applications/lua/lua: -1.16% (3.7467 => 3.7034, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.04% (1.9828 => 1.9622, std. dev.: 0.0013) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.13% (1.0460 => 0.9505, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.63% (0.3139 => 0.2931, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std. dev.: 0.0005) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/perlin: -4.59% (6.2497 => 5.9626, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.41% (1.3780 => 1.3172, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -4.07% (2.5089 => 2.4068, std. dev.: 0.0037) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -3.65% (1.9762 => 1.9041, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout/lists: -2.16% (6.3560 => 6.2186, std. dev.: 0.0082) SingleSource/Benchmarks/Misc/richards_benchmark: -2.14% (1.1560 => 1.1313, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.91% (20.3410 => 19.9521, std. dev.: 0.0284) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.88% (6.6320 => 6.5076, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9957, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) MultiSource/Applications/lua/lua: -1.46% (26.5159 => 26.1294, std. dev.: 0.0372) MultiSource/Benchmarks/mafft/pairlocalalign: -1.26% (28.2225 => 27.8670, std. dev.: 0.0023) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.07% (2.5254 => 2.4983, std. dev.: 0.0035) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.83s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat May 26 02:52:56 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 26 May 2012 04:52:56 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120526095256.4F5EC2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/800?compare_to=799&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 800, Order: 157512, Start Time: 2012-05-26 08:57:12, End Time: 2012-05-26 09:53:54 To: 799, Order: 157511, Start Time: 2012-05-26 07:34:12, End Time: 2012-05-26 08:31:05 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (55 on baseline) Performance Improvements: 1 (44 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 891 (789 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: -1.09% (1.4005 => 1.3853, std. dev.: 0.0048) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 11.90% (2.0176 => 2.2577, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.20% (0.3130 => 0.3324, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.75% (0.2721 => 0.2823, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.98% (3.9660 => 4.0843, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.82% (0.6959 => 0.7155, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.60% (0.9199 => 0.9438, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.56% (0.5265 => 0.5400, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 2.49% (1.0594 => 1.0858, std. dev.: 0.0015) MultiSource/Applications/SPASS/SPASS: 2.49% (13.8202 => 14.1638, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: 2.45% (0.8310 => 0.8514, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.20% (0.5637 => 0.5761, std. dev.: 0.0019) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.17% (1.1364 => 1.1611, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.09% (1.2193 => 1.2448, std. dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.96% (1.3245 => 1.3505, std. dev.: 0.0017) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.94% (0.7460 => 0.7605, std. dev.: 0.0055) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.85% (13.2842 => 13.5305, std. dev.: 0.0243) MultiSource/Applications/siod/siod: 1.80% (2.1791 => 2.2183, std. dev.: 0.0038) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.78% (1.4563 => 1.4822, std. dev.: 0.0023) MultiSource/Benchmarks/MallocBench/gs/gs: 1.59% (3.8646 => 3.9262, std. dev.: 0.0033) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.58% (0.7710 => 0.7832, std. dev.: 0.0028) MultiSource/Applications/Burg/burg: 1.43% (1.1061 => 1.1219, std. dev.: 0.0008) MultiSource/Applications/treecc/treecc: 1.43% (1.9270 => 1.9545, std. dev.: 0.0011) MultiSource/Applications/kimwitu++/kc: 1.42% (16.6129 => 16.8481, std. dev.: 0.0154) MultiSource/Applications/JM/lencod/lencod: 1.22% (14.8535 => 15.0341, std. dev.: 0.0097) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.07% (1.3813 => 1.3961, std. dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 1.06% (1.2749 => 1.2884, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.03% (1.3819 => 1.3962, std. dev.: 0.0022) MultiSource/Applications/hbd/hbd: 1.01% (1.3693 => 1.3831, std. dev.: 0.0042) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/fbench: 24.35% (1.8175 => 2.2601, std. dev.: 0.0071) SingleSource/Benchmarks/Misc/mandel-2: 6.58% (1.2998 => 1.3853, std. dev.: 0.0048) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6754, std. dev.: 0.0060) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.81% (1.9144 => 1.9874, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.71% (1.7688 => 1.8345, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: 3.59% (7.4271 => 7.6940, std. dev.: 0.0090) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 3.02% (8.8259 => 9.0922, std. dev.: 0.0178) MultiSource/Applications/hexxagon/hexxagon: 3.01% (12.0921 => 12.4557, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: 2.85% (1.9199 => 1.9747, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 2.80% (11.2619 => 11.5771, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9394, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.19% (7.9275 => 8.1011, std. dev.: 0.0270) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0084) SingleSource/Benchmarks/Misc/ffbench: 1.54% (0.8273 => 0.8400, std. dev.: 0.0047) MultiSource/Applications/lemon/lemon: 1.50% (1.4298 => 1.4512, std. dev.: 0.0020) MultiSource/Applications/siod/siod: 1.48% (3.2729 => 3.3214, std. dev.: 0.0010) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5082, std. dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.28% (2.0200 => 2.0458, std. dev.: 0.0008) MultiSource/Benchmarks/sim/sim: 1.24% (5.0168 => 5.0789, std. dev.: 0.0058) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.19% (1.9433 => 1.9664, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 1.13% (9.0760 => 9.1784, std. dev.: 0.0005) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -18.45% (0.4657 => 0.3798, std. dev.: 0.0182) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.39% (22.5627 => 20.8958, std. dev.: 0.0136) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.12% (0.2670 => 0.2480, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.44% (0.3511 => 0.3285, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-3: -5.16% (0.3623 => 0.3436, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -5.05% (0.3601 => 0.3419, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.99% (0.3650 => 0.3468, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/trivial-interface: -4.92% (0.3578 => 0.3402, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -4.88% (0.3646 => 0.3468, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -4.86% (0.3663 => 0.3485, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/property: -4.52% (0.3940 => 0.3762, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -4.41% (0.3789 => 0.3622, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -4.37% (0.3914 => 0.3743, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -4.27% (0.4003 => 0.3832, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.87% (0.6576 => 0.6387, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/Hello: -2.71% (0.5748 => 0.5592, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: -2.67% (0.6250 => 0.6083, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: -2.39% (0.5818 => 0.5679, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.23% (0.8818 => 0.8621, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference: -2.05% (0.7061 => 0.6916, std. dev.: 0.0026) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.52% (0.9108 => 0.8970, std. dev.: 0.0003) MultiSource/Applications/lua/lua: -1.18% (3.7467 => 3.7025, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.01% (1.9828 => 1.9628, std. dev.: 0.0008) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.13% (1.0460 => 0.9505, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.56% (0.3139 => 0.2933, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0005) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9624, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -4.01% (2.5089 => 2.4083, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.73% (0.3458 => 0.3329, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.67% (1.9762 => 1.9037, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout/lists: -2.52% (6.3560 => 6.1957, std. dev.: 0.0122) SingleSource/Benchmarks/Misc/richards_benchmark: -2.14% (1.1560 => 1.1313, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.91% (6.6320 => 6.5056, std. dev.: 0.0054) MultiSource/Applications/minisat/minisat: -1.85% (9.3358 => 9.1628, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3446, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.62% (20.3410 => 20.0121, std. dev.: 0.0587) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9952, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.42% (3.9173 => 3.8615, std. dev.: 0.0023) MultiSource/Applications/lua/lua: -1.40% (26.5159 => 26.1443, std. dev.: 0.0125) MultiSource/Benchmarks/mafft/pairlocalalign: -1.25% (28.2225 => 27.8695, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.03% (3.8887 => 3.8486, std. dev.: 0.0037) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.89s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat May 26 06:04:28 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 26 May 2012 08:04:28 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120526130428.B114C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/801?compare_to=800&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 801, Order: 157514, Start Time: 2012-05-26 12:08:59, End Time: 2012-05-26 13:05:28 To: 800, Order: 157512, Start Time: 2012-05-26 08:57:12, End Time: 2012-05-26 09:53:54 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (51 on baseline) Performance Improvements: 1 (45 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 891 (792 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -6.66% (0.3798 => 0.3545, std. dev.: 0.0026) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.15% (2.0176 => 2.2627, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.17% (0.3130 => 0.3323, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.82% (3.9660 => 4.0777, std. dev.: 0.0141) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.66% (0.6959 => 0.7144, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.34% (0.5265 => 0.5388, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.27% (0.9199 => 0.9408, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/football/football: 2.24% (0.8310 => 0.8496, std. dev.: 0.0015) MultiSource/Benchmarks/nbench/nbench: 2.23% (1.0594 => 1.0830, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 2.18% (13.8202 => 14.1213, std. dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.93% (1.2193 => 1.2428, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.91% (1.1364 => 1.1581, std. dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.84% (0.5637 => 0.5741, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.76% (1.3245 => 1.3478, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.67% (13.2842 => 13.5065, std. dev.: 0.0162) MultiSource/Applications/siod/siod: 1.64% (2.1791 => 2.2148, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.62% (1.4563 => 1.4799, std. dev.: 0.0087) MultiSource/Applications/lambda-0_1_3/lambda: 1.56% (0.7038 => 0.7148, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/gs/gs: 1.48% (3.8646 => 3.9219, std. dev.: 0.0113) MultiSource/Applications/Burg/burg: 1.45% (1.1061 => 1.1221, std. dev.: 0.0012) MultiSource/Applications/kimwitu++/kc: 1.42% (16.6129 => 16.8486, std. dev.: 0.0162) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.35% (0.7460 => 0.7561, std. dev.: 0.0011) MultiSource/Applications/treecc/treecc: 1.28% (1.9270 => 1.9516, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.11% (1.3813 => 1.3966, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.07% (1.3819 => 1.3967, std. dev.: 0.0023) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 24.70% (1.8175 => 2.2664, std. dev.: 0.0480) SingleSource/Benchmarks/Misc/mandel-2: 7.25% (1.2998 => 1.3940, std. dev.: 0.0137) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6755, std. dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9882, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.65% (1.7688 => 1.8334, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/salsa20: 3.62% (7.4271 => 7.6957, std. dev.: 0.0043) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4535, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-6: 2.89% (1.9199 => 1.9753, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.84% (8.8259 => 9.0769, std. dev.: 0.0246) MultiSource/Benchmarks/nbench/nbench: 2.79% (11.2619 => 11.5760, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.76% (2.8606 => 2.9396, std. dev.: 0.0017) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.45% (7.9275 => 8.1216, std. dev.: 0.0145) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.61% (0.8273 => 0.8406, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 1.47% (3.2729 => 3.3210, std. dev.: 0.0022) MultiSource/Applications/lemon/lemon: 1.45% (1.4298 => 1.4505, std. dev.: 0.0012) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5100, std. dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.27% (2.0200 => 2.0457, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 1.22% (5.0168 => 5.0782, std. dev.: 0.0086) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.13% (1.9433 => 1.9652, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/flops: 1.11% (9.0760 => 9.1765, std. dev.: 0.0006) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -23.88% (0.4657 => 0.3545, std. dev.: 0.0026) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.38% (0.2670 => 0.2473, std. dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.30% (22.5627 => 20.9150, std. dev.: 0.0072) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.49% (0.3511 => 0.3283, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: -5.58% (0.3623 => 0.3421, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.51% (0.3650 => 0.3449, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -5.47% (0.3601 => 0.3404, std. dev.: 0.0021) SingleSource/UnitTests/ObjC/exceptions-4: -5.43% (0.3646 => 0.3448, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -5.38% (0.3663 => 0.3466, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: -5.37% (0.3578 => 0.3386, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/property: -5.00% (0.3940 => 0.3743, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -4.91% (0.3789 => 0.3603, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -4.78% (0.3914 => 0.3727, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: -4.70% (0.4003 => 0.3815, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.16% (0.6576 => 0.6368, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.03% (0.8818 => 0.8551, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: -2.83% (0.6250 => 0.6073, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: -2.70% (0.5748 => 0.5593, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: -2.37% (0.5818 => 0.5680, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: -2.15% (0.7061 => 0.6909, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.99% (0.9108 => 0.8927, std. dev.: 0.0003) MultiSource/Applications/lua/lua: -1.27% (3.7467 => 3.6993, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.15% (1.9828 => 1.9600, std. dev.: 0.0013) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.02% (6.2785 => 6.2144, std. dev.: 0.0034) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.63% (0.3139 => 0.2931, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.91% (1.3780 => 1.3104, std. dev.: 0.0085) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9623, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -3.99% (2.5089 => 2.4089, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.73% (0.3458 => 0.3329, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.65% (1.9762 => 1.9041, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -2.25% (6.3560 => 6.2127, std. dev.: 0.0082) SingleSource/Benchmarks/Misc/richards_benchmark: -2.15% (1.1560 => 1.1312, std. dev.: 0.0000) MultiSource/Applications/minisat/minisat: -2.03% (9.3358 => 9.1462, std. dev.: 0.0450) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.90% (6.6320 => 6.5057, std. dev.: 0.0041) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.90% (20.3410 => 19.9553, std. dev.: 0.0259) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3444, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9954, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0011) MultiSource/Applications/lua/lua: -1.54% (26.5159 => 26.1076, std. dev.: 0.0202) SingleSource/Benchmarks/Shootout/heapsort: -1.52% (3.9173 => 3.8578, std. dev.: 0.0054) MultiSource/Benchmarks/mafft/pairlocalalign: -1.25% (28.2225 => 27.8685, std. dev.: 0.0017) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.31s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat May 26 08:30:34 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 26 May 2012 10:30:34 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120526153034.A9F2E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/802?compare_to=801&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 802, Order: 157515, Start Time: 2012-05-26 14:34:57, End Time: 2012-05-26 15:31:34 To: 801, Order: 157514, Start Time: 2012-05-26 12:08:59, End Time: 2012-05-26 13:05:28 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (57 on baseline) Performance Improvements: 0 (44 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (787 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 11.89% (2.0176 => 2.2575, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.20% (0.3130 => 0.3324, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.79% (0.2721 => 0.2824, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.97% (3.9660 => 4.0838, std. dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.59% (0.6959 => 0.7139, std. dev.: 0.0016) MultiSource/Benchmarks/nbench/nbench: 2.59% (1.0594 => 1.0868, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.58% (0.9199 => 0.9436, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 2.53% (0.8310 => 0.8520, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.47% (0.5265 => 0.5395, std. dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 2.20% (13.8202 => 14.1245, std. dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.20% (1.2193 => 1.2461, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.18% (1.1364 => 1.1612, std. dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.06% (1.3245 => 1.3518, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.06% (0.5637 => 0.5753, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 1.95% (2.1791 => 2.2216, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.69% (13.2842 => 13.5084, std. dev.: 0.0104) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.63% (1.4563 => 1.4801, std. dev.: 0.0052) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.54% (0.7710 => 0.7829, std. dev.: 0.0025) MultiSource/Benchmarks/MallocBench/gs/gs: 1.53% (3.8646 => 3.9239, std. dev.: 0.0016) MultiSource/Applications/Burg/burg: 1.53% (1.1061 => 1.1230, std. dev.: 0.0055) MultiSource/Applications/lambda-0_1_3/lambda: 1.52% (0.7038 => 0.7145, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 1.46% (1.9270 => 1.9552, std. dev.: 0.0010) MultiSource/Applications/kimwitu++/kc: 1.41% (16.6129 => 16.8470, std. dev.: 0.0203) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.39% (0.7460 => 0.7564, std. dev.: 0.0011) MultiSource/Applications/JM/lencod/lencod: 1.30% (14.8535 => 15.0461, std. dev.: 0.0069) MultiSource/Applications/hbd/hbd: 1.20% (1.3693 => 1.3858, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.18% (1.3819 => 1.3982, std. dev.: 0.0017) MultiSource/Applications/SIBsim4/SIBsim4: 1.09% (1.2749 => 1.2888, std. dev.: 0.0018) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.09% (1.3813 => 1.3963, std. dev.: 0.0057) MultiSource/Applications/sqlite3/sqlite3: 1.03% (16.2614 => 16.4293, std. dev.: 0.0045) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.03% (3.6692 => 3.7069, std. dev.: 0.0070) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 24.17% (1.8175 => 2.2568, std. dev.: 0.0225) SingleSource/Benchmarks/Misc/mandel-2: 7.75% (1.2998 => 1.4005, std. dev.: 0.0081) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.52% (2.5629 => 2.7299, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.90% (1.5824 => 1.6758, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8146, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9878, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.69% (1.7688 => 1.8340, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: 3.58% (7.4271 => 7.6930, std. dev.: 0.0037) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4546, std. dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.92% (8.8259 => 9.0832, std. dev.: 0.0042) SingleSource/Benchmarks/Misc/flops-6: 2.88% (1.9199 => 1.9751, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 2.81% (11.2619 => 11.5778, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.76% (2.8606 => 2.9395, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.23% (7.9275 => 8.1041, std. dev.: 0.0088) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.56% (0.8273 => 0.8402, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.44% (1.4298 => 1.4504, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 1.42% (3.2729 => 3.3193, std. dev.: 0.0011) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5088, std. dev.: 0.0047) MultiSource/Benchmarks/sim/sim: 1.33% (5.0168 => 5.0833, std. dev.: 0.0058) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.27% (2.0200 => 2.0456, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 1.13% (9.0760 => 9.1786, std. dev.: 0.0007) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -21.99% (0.4657 => 0.3633, std. dev.: 0.0107) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.51% (22.5627 => 20.8692, std. dev.: 0.0056) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.27% (0.2670 => 0.2476, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.35% (0.3511 => 0.3288, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -5.30% (0.3623 => 0.3431, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.29% (0.3650 => 0.3457, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: -5.20% (0.3578 => 0.3392, std. dev.: 0.0032) SingleSource/UnitTests/ObjC/exceptions-2: -5.11% (0.3601 => 0.3417, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -5.02% (0.3646 => 0.3463, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -5.00% (0.3663 => 0.3480, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -4.80% (0.3940 => 0.3751, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -4.57% (0.3914 => 0.3735, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: -4.57% (0.3789 => 0.3616, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: -4.52% (0.4003 => 0.3822, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.89% (0.6576 => 0.6386, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: -2.45% (0.6250 => 0.6097, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: -2.38% (0.5748 => 0.5611, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.37% (0.8818 => 0.8609, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: -2.11% (0.5818 => 0.5695, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: -1.74% (0.7061 => 0.6938, std. dev.: 0.0023) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.50% (0.9108 => 0.8971, std. dev.: 0.0004) MultiSource/Applications/lua/lua: -1.18% (3.7467 => 3.7026, std. dev.: 0.0127) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.13% (1.0460 => 0.9505, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.59% (0.3139 => 0.2932, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2650, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.93% (1.3780 => 1.3101, std. dev.: 0.0040) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9623, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -3.97% (2.5089 => 2.4093, std. dev.: 0.0007) MultiSource/Benchmarks/Olden/bh/bh: -3.67% (1.9762 => 1.9036, std. dev.: 0.0040) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.64% (0.3458 => 0.3332, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -2.18% (6.3560 => 6.2177, std. dev.: 0.0060) SingleSource/Benchmarks/Misc/richards_benchmark: -2.12% (1.1560 => 1.1315, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: -2.09% (9.3358 => 9.1409, std. dev.: 0.0078) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.02% (20.3410 => 19.9299, std. dev.: 0.1113) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.88% (6.6320 => 6.5073, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9955, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) MultiSource/Applications/lua/lua: -1.44% (26.5159 => 26.1349, std. dev.: 0.0178) SingleSource/Benchmarks/Shootout/heapsort: -1.31% (3.9173 => 3.8658, std. dev.: 0.0029) MultiSource/Benchmarks/mafft/pairlocalalign: -1.25% (28.2225 => 27.8698, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.06% (3.8887 => 3.8475, std. dev.: 0.0074) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.32s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat May 26 09:53:17 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 26 May 2012 11:53:17 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120526165317.6E5D22A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/803?compare_to=802&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 803, Order: 157516, Start Time: 2012-05-26 15:57:37, End Time: 2012-05-26 16:54:16 To: 802, Order: 157515, Start Time: 2012-05-26 14:34:57, End Time: 2012-05-26 15:31:34 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (54 on baseline) Performance Improvements: 0 (43 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (791 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 11.95% (2.0176 => 2.2588, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.26% (0.3130 => 0.3326, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.86% (0.2721 => 0.2826, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.86% (3.9660 => 4.0794, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.53% (0.6959 => 0.7135, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.45% (0.5265 => 0.5394, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.45% (0.9199 => 0.9424, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 2.42% (0.8310 => 0.8511, std. dev.: 0.0026) MultiSource/Benchmarks/nbench/nbench: 2.35% (1.0594 => 1.0843, std. dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 2.18% (13.8202 => 14.1211, std. dev.: 0.0077) MultiSource/Applications/siod/siod: 2.05% (2.1791 => 2.2237, std. dev.: 0.0100) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.01% (1.1364 => 1.1592, std. dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.98% (1.3245 => 1.3507, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.93% (0.5637 => 0.5746, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.93% (1.2193 => 1.2428, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.72% (13.2842 => 13.5132, std. dev.: 0.0237) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.70% (1.4563 => 1.4810, std. dev.: 0.0073) MultiSource/Benchmarks/MallocBench/gs/gs: 1.53% (3.8646 => 3.9238, std. dev.: 0.0026) MultiSource/Applications/lambda-0_1_3/lambda: 1.52% (0.7038 => 0.7145, std. dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 1.52% (16.6129 => 16.8653, std. dev.: 0.0029) MultiSource/Applications/Burg/burg: 1.50% (1.1061 => 1.1227, std. dev.: 0.0038) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.47% (0.7710 => 0.7823, std. dev.: 0.0009) MultiSource/Applications/treecc/treecc: 1.42% (1.9270 => 1.9543, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.37% (0.7460 => 0.7562, std. dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: 1.14% (14.8535 => 15.0223, std. dev.: 0.0125) MultiSource/Applications/sqlite3/sqlite3: 1.02% (16.2614 => 16.4273, std. dev.: 0.0136) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.01% (1.3819 => 1.3959, std. dev.: 0.0011) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 24.18% (1.8175 => 2.2570, std. dev.: 0.0137) SingleSource/Benchmarks/Misc/mandel-2: 7.96% (1.2998 => 1.4033, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.86% (1.5824 => 1.6752, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8146, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.81% (1.9144 => 1.9874, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.65% (1.7688 => 1.8333, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: 3.54% (7.4271 => 7.6902, std. dev.: 0.0040) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4544, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.92% (8.8259 => 9.0838, std. dev.: 0.0107) SingleSource/Benchmarks/Misc/flops-6: 2.91% (1.9199 => 1.9757, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 2.80% (11.2619 => 11.5776, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.74% (2.8606 => 2.9391, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.53% (7.9275 => 8.1282, std. dev.: 0.0073) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/ffbench: 1.61% (0.8273 => 0.8406, std. dev.: 0.0015) MultiSource/Applications/siod/siod: 1.45% (3.2729 => 3.3205, std. dev.: 0.0021) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5083, std. dev.: 0.0018) MultiSource/Applications/lemon/lemon: 1.30% (1.4298 => 1.4484, std. dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.26% (2.0200 => 2.0455, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.17% (1.9433 => 1.9660, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1774, std. dev.: 0.0013) MultiSource/Benchmarks/sim/sim: 1.11% (5.0168 => 5.0724, std. dev.: 0.0106) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.38% (0.2670 => 0.2473, std. dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.15% (22.5627 => 20.9496, std. dev.: 0.0190) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.49% (0.3511 => 0.3283, std. dev.: 0.0030) SingleSource/UnitTests/ObjC/exceptions-3: -5.35% (0.3623 => 0.3429, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.29% (0.3650 => 0.3457, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -5.28% (0.3601 => 0.3411, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: -5.23% (0.3578 => 0.3391, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -5.19% (0.3663 => 0.3473, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -5.10% (0.3646 => 0.3460, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: -4.70% (0.3789 => 0.3611, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -4.70% (0.3940 => 0.3755, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -4.55% (0.3914 => 0.3736, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -4.32% (0.4003 => 0.3830, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.09% (0.6576 => 0.6373, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.99% (0.8818 => 0.8554, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/Hello: -2.92% (0.5748 => 0.5580, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/bigfib: -2.80% (0.6250 => 0.6075, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: -2.66% (0.5818 => 0.5663, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: -2.07% (0.7061 => 0.6915, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.83% (0.9108 => 0.8941, std. dev.: 0.0008) MultiSource/Applications/lua/lua: -1.20% (3.7467 => 3.7019, std. dev.: 0.0128) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.09% (1.9828 => 1.9612, std. dev.: 0.0012) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.13% (1.0460 => 0.9505, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.63% (0.3139 => 0.2931, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2641, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.31% (1.3780 => 1.3048, std. dev.: 0.0053) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9621, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -4.02% (2.5089 => 2.4081, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.73% (0.3458 => 0.3329, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.60% (1.9762 => 1.9050, std. dev.: 0.0081) SingleSource/Benchmarks/Misc/richards_benchmark: -2.14% (1.1560 => 1.1313, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.14% (20.3410 => 19.9064, std. dev.: 0.0663) SingleSource/Benchmarks/Shootout/lists: -2.07% (6.3560 => 6.2244, std. dev.: 0.0047) MultiSource/Applications/minisat/minisat: -2.03% (9.3358 => 9.1464, std. dev.: 0.0092) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.90% (6.6320 => 6.5059, std. dev.: 0.0057) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9958, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.56% (0.9692 => 0.9541, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.50% (3.9173 => 3.8587, std. dev.: 0.0025) MultiSource/Applications/lua/lua: -1.47% (26.5159 => 26.1251, std. dev.: 0.0106) MultiSource/Benchmarks/mafft/pairlocalalign: -1.26% (28.2225 => 27.8683, std. dev.: 0.0032) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.65s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat May 26 11:15:52 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 26 May 2012 13:15:52 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120526181552.701182A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/804?compare_to=803&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 804, Order: 157518, Start Time: 2012-05-26 17:20:21, End Time: 2012-05-26 18:16:51 To: 803, Order: 157516, Start Time: 2012-05-26 15:57:37, End Time: 2012-05-26 16:54:16 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (49 on baseline) Performance Improvements: 1 (46 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 890 (793 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/sqlite3/sqlite3: 1.64% (4.6263 => 4.7022, std. dev.: 0.0021) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -4.30% (9.0838 => 8.6929, std. dev.: 0.0173) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 11.97% (2.0176 => 2.2591, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.07% (0.3130 => 0.3320, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.82% (0.2721 => 0.2825, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.66% (3.9660 => 4.0716, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/football/football: 2.44% (0.8310 => 0.8513, std. dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.43% (0.6959 => 0.7128, std. dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 2.40% (1.0594 => 1.0848, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.32% (0.5265 => 0.5387, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.32% (0.9199 => 0.9412, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 2.23% (13.8202 => 14.1281, std. dev.: 0.0129) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.08% (0.7710 => 0.7870, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.00% (1.2193 => 1.2437, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.92% (0.5637 => 0.5745, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.80% (1.1364 => 1.1568, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.77% (1.3245 => 1.3479, std. dev.: 0.0013) MultiSource/Applications/siod/siod: 1.67% (2.1791 => 2.2154, std. dev.: 0.0043) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.59% (13.2842 => 13.4955, std. dev.: 0.0105) MultiSource/Benchmarks/MallocBench/gs/gs: 1.38% (3.8646 => 3.9181, std. dev.: 0.0030) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.36% (1.4563 => 1.4761, std. dev.: 0.0015) MultiSource/Applications/kimwitu++/kc: 1.34% (16.6129 => 16.8348, std. dev.: 0.0106) MultiSource/Applications/Burg/burg: 1.25% (1.1061 => 1.1199, std. dev.: 0.0005) MultiSource/Applications/treecc/treecc: 1.18% (1.9270 => 1.9497, std. dev.: 0.0010) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 24.19% (1.8175 => 2.2571, std. dev.: 0.0466) SingleSource/Benchmarks/Misc/mandel-2: 7.59% (1.2998 => 1.3984, std. dev.: 0.0053) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.90% (1.5824 => 1.6757, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.80% (1.9144 => 1.9871, std. dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.65% (1.7688 => 1.8333, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/salsa20: 3.52% (7.4271 => 7.6885, std. dev.: 0.0037) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4544, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: 2.90% (1.9199 => 1.9756, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 2.80% (11.2619 => 11.5769, std. dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9392, std. dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 2.38% (4.5928 => 4.7022, std. dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.27% (7.9275 => 8.1075, std. dev.: 0.0111) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.60% (1.9290 => 1.9599, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 1.54% (0.8273 => 0.8400, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 1.45% (3.2729 => 3.3202, std. dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5100, std. dev.: 0.0032) MultiSource/Applications/lemon/lemon: 1.39% (1.4298 => 1.4497, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.26% (2.0200 => 2.0455, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.21% (1.9433 => 1.9668, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 1.11% (9.0760 => 9.1766, std. dev.: 0.0028) SingleSource/Benchmarks/McGill/chomp: 1.10% (1.2308 => 1.2443, std. dev.: 0.0014) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -21.88% (0.4657 => 0.3638, std. dev.: 0.0295) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.57% (0.2670 => 0.2468, std. dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.07% (22.5627 => 20.9676, std. dev.: 0.0161) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.47% (0.3511 => 0.3284, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: -5.24% (0.3623 => 0.3433, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -5.17% (0.3601 => 0.3415, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.15% (0.3650 => 0.3462, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -5.02% (0.3646 => 0.3463, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -5.00% (0.3578 => 0.3399, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -4.89% (0.3663 => 0.3484, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/property: -4.67% (0.3940 => 0.3756, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -4.59% (0.3789 => 0.3615, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -4.55% (0.3914 => 0.3736, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -4.50% (0.4003 => 0.3823, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.84% (0.6576 => 0.6389, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/Hello: -2.80% (0.5748 => 0.5587, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.74% (0.8818 => 0.8576, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: -2.67% (0.6250 => 0.6083, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: -2.51% (0.5818 => 0.5672, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: -1.98% (0.7061 => 0.6921, std. dev.: 0.0023) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.83% (0.9108 => 0.8941, std. dev.: 0.0002) MultiSource/Applications/lua/lua: -1.38% (3.7467 => 3.6949, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.19% (1.9828 => 1.9592, std. dev.: 0.0018) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.10% (6.2785 => 6.2095, std. dev.: 0.0061) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.13% (1.0460 => 0.9505, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.85% (1.3780 => 1.3111, std. dev.: 0.0176) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9622, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -4.01% (2.5089 => 2.4083, std. dev.: 0.0032) MultiSource/Benchmarks/Olden/bh/bh: -3.75% (1.9762 => 1.9021, std. dev.: 0.0012) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: -2.13% (1.1560 => 1.1314, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.92% (6.6320 => 6.5049, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout/lists: -1.86% (6.3560 => 6.2375, std. dev.: 0.0024) MultiSource/Benchmarks/mafft/pairlocalalign: -1.85% (28.2225 => 27.7015, std. dev.: 0.0021) MultiSource/Applications/minisat/minisat: -1.73% (9.3358 => 9.1740, std. dev.: 0.0063) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3446, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9954, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/heapsort: -1.57% (3.9173 => 3.8558, std. dev.: 0.0048) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.51% (8.8259 => 8.6929, std. dev.: 0.0173) MultiSource/Applications/lua/lua: -1.47% (26.5159 => 26.1269, std. dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.42% (20.3410 => 20.0516, std. dev.: 0.0507) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.63s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat May 26 14:09:45 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 26 May 2012 16:09:45 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120526210945.B86CB2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/805?compare_to=804&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 805, Order: 157520, Start Time: 2012-05-26 20:14:16, End Time: 2012-05-26 21:10:45 To: 804, Order: 157518, Start Time: 2012-05-26 17:20:21, End Time: 2012-05-26 18:16:51 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (47 on baseline) Performance Improvements: 0 (44 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (797 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.02% (2.0176 => 2.2601, std. dev.: 0.0172) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.39% (0.3130 => 0.3330, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.75% (0.2721 => 0.2823, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.75% (3.9660 => 4.0751, std. dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/football/football: 2.41% (0.8310 => 0.8510, std. dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.36% (0.9199 => 0.9416, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.34% (0.6959 => 0.7122, std. dev.: 0.0027) MultiSource/Benchmarks/nbench/nbench: 2.34% (1.0594 => 1.0842, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.26% (0.5265 => 0.5384, std. dev.: 0.0020) MultiSource/Applications/SPASS/SPASS: 2.22% (13.8202 => 14.1265, std. dev.: 0.0120) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.00% (1.2193 => 1.2437, std. dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.92% (0.5637 => 0.5745, std. dev.: 0.0022) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.83% (1.1364 => 1.1572, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.79% (1.3245 => 1.3482, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 1.72% (2.1791 => 2.2165, std. dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.59% (13.2842 => 13.4954, std. dev.: 0.0067) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.47% (1.4563 => 1.4777, std. dev.: 0.0025) MultiSource/Applications/kimwitu++/kc: 1.42% (16.6129 => 16.8496, std. dev.: 0.0184) MultiSource/Benchmarks/MallocBench/gs/gs: 1.39% (3.8646 => 3.9185, std. dev.: 0.0038) MultiSource/Applications/Burg/burg: 1.22% (1.1061 => 1.1196, std. dev.: 0.0009) MultiSource/Applications/treecc/treecc: 1.21% (1.9270 => 1.9504, std. dev.: 0.0012) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/fbench: 24.40% (1.8175 => 2.2609, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/mandel-2: 7.86% (1.2998 => 1.4020, std. dev.: 0.0060) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.92% (1.5824 => 1.6760, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.80% (1.9144 => 1.9871, std. dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.64% (1.7688 => 1.8331, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/salsa20: 3.58% (7.4271 => 7.6931, std. dev.: 0.0082) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4543, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/flops-6: 2.88% (1.9199 => 1.9752, std. dev.: 0.0016) MultiSource/Benchmarks/nbench/nbench: 2.80% (11.2619 => 11.5768, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.74% (2.8606 => 2.9391, std. dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.38% (7.9275 => 8.1165, std. dev.: 0.0090) MultiSource/Applications/sqlite3/sqlite3: 2.33% (4.5928 => 4.6997, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/ffbench: 1.58% (0.8273 => 0.8404, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.43% (1.4298 => 1.4503, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 1.41% (3.2729 => 3.3192, std. dev.: 0.0014) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5092, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.27% (2.0200 => 2.0456, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.16% (1.9433 => 1.9659, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 1.13% (9.0760 => 9.1785, std. dev.: 0.0007) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -21.77% (0.4657 => 0.3643, std. dev.: 0.0237) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.53% (0.2670 => 0.2469, std. dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.07% (22.5627 => 20.9682, std. dev.: 0.0059) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.38% (0.3511 => 0.3287, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.26% (0.3650 => 0.3458, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: -5.19% (0.3623 => 0.3435, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: -5.11% (0.3578 => 0.3395, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -5.11% (0.3601 => 0.3417, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -4.97% (0.3663 => 0.3481, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -4.91% (0.3646 => 0.3467, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -4.70% (0.3940 => 0.3755, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -4.62% (0.3789 => 0.3614, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -4.52% (0.3914 => 0.3737, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -4.42% (0.4003 => 0.3826, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.98% (0.6576 => 0.6380, std. dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/bigfib: -2.77% (0.6250 => 0.6077, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: -2.73% (0.5748 => 0.5591, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: -2.53% (0.5818 => 0.5671, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: -1.98% (0.7061 => 0.6921, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.83% (0.9108 => 0.8941, std. dev.: 0.0001) MultiSource/Applications/lua/lua: -1.38% (3.7467 => 3.6951, std. dev.: 0.0014) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.13% (6.2785 => 6.2074, std. dev.: 0.0097) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.11% (1.9828 => 1.9607, std. dev.: 0.0084) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.14% (1.0460 => 0.9504, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0003) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9622, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -4.05% (2.5089 => 2.4072, std. dev.: 0.0028) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.76% (0.3458 => 0.3328, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -3.65% (1.9762 => 1.9041, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: -2.15% (1.1560 => 1.1311, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.00% (20.3410 => 19.9339, std. dev.: 0.0777) MultiSource/Applications/minisat/minisat: -1.99% (9.3358 => 9.1499, std. dev.: 0.0211) SingleSource/Benchmarks/Shootout/lists: -1.97% (6.3560 => 6.2306, std. dev.: 0.0030) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.94% (6.6320 => 6.5032, std. dev.: 0.0053) MultiSource/Benchmarks/mafft/pairlocalalign: -1.84% (28.2225 => 27.7024, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9953, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.48% (3.9173 => 3.8594, std. dev.: 0.0045) MultiSource/Applications/lua/lua: -1.47% (26.5159 => 26.1249, std. dev.: 0.0210) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.27% (8.8259 => 8.7134, std. dev.: 0.0039) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.41s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat May 26 15:32:10 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 26 May 2012 17:32:10 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120526223210.6F4702A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/806?compare_to=805&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 806, Order: 157521, Start Time: 2012-05-26 21:36:45, End Time: 2012-05-26 22:33:10 To: 805, Order: 157520, Start Time: 2012-05-26 20:14:16, End Time: 2012-05-26 21:10:45 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (53 on baseline) Performance Improvements: 0 (45 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 891 (790 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 2.64% (3.7623 => 3.8618, std. dev.: 0.0113) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.01% (2.0176 => 2.2600, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.04% (0.3130 => 0.3319, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.71% (0.2721 => 0.2822, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.81% (3.9660 => 4.0774, std. dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.47% (0.6959 => 0.7131, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 2.36% (1.0594 => 1.0844, std. dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.34% (0.9199 => 0.9414, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.30% (0.5265 => 0.5386, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 2.22% (13.8202 => 14.1271, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/football/football: 2.21% (0.8310 => 0.8494, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.96% (1.2193 => 1.2432, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.92% (0.5637 => 0.5745, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.87% (1.1364 => 1.1576, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.80% (1.3245 => 1.3483, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.52% (13.2842 => 13.4858, std. dev.: 0.0102) MultiSource/Applications/lambda-0_1_3/lambda: 1.49% (0.7038 => 0.7143, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.48% (1.4563 => 1.4779, std. dev.: 0.0060) MultiSource/Applications/kimwitu++/kc: 1.41% (16.6129 => 16.8466, std. dev.: 0.0080) MultiSource/Benchmarks/MallocBench/gs/gs: 1.39% (3.8646 => 3.9182, std. dev.: 0.0097) MultiSource/Applications/Burg/burg: 1.36% (1.1061 => 1.1211, std. dev.: 0.0021) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.30% (0.7710 => 0.7810, std. dev.: 0.0010) MultiSource/Applications/treecc/treecc: 1.24% (1.9270 => 1.9508, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.11% (1.3819 => 1.3972, std. dev.: 0.0014) MultiSource/Applications/JM/lencod/lencod: 1.09% (14.8535 => 15.0152, std. dev.: 0.0092) MultiSource/Applications/hbd/hbd: 1.04% (1.3693 => 1.3835, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.03% (1.3813 => 1.3955, std. dev.: 0.0013) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 24.10% (1.8175 => 2.2556, std. dev.: 0.0044) SingleSource/Benchmarks/Misc/mandel-2: 7.02% (1.2998 => 1.3911, std. dev.: 0.0120) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.52% (2.5629 => 2.7299, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.87% (1.5824 => 1.6753, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8147, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-5: 3.80% (1.9144 => 1.9872, std. dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.63% (1.7688 => 1.8330, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: 3.61% (7.4271 => 7.6951, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 2.98% (12.0921 => 12.4527, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-6: 2.91% (1.9199 => 1.9757, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 2.79% (11.2619 => 11.5759, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.73% (2.8606 => 2.9386, std. dev.: 0.0023) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.41% (7.9275 => 8.1186, std. dev.: 0.0038) MultiSource/Benchmarks/llubenchmark/llu: 2.35% (3.7731 => 3.8618, std. dev.: 0.0113) MultiSource/Applications/sqlite3/sqlite3: 2.32% (4.5928 => 4.6994, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 1.67% (3.2729 => 3.3275, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/ffbench: 1.60% (0.8273 => 0.8405, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: 1.50% (1.9290 => 1.9579, std. dev.: 0.0011) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5087, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: 1.38% (1.4298 => 1.4496, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.28% (2.0200 => 2.0459, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/flops: 1.13% (9.0760 => 9.1786, std. dev.: 0.0006) MultiSource/Benchmarks/sim/sim: 1.06% (5.0168 => 5.0700, std. dev.: 0.0065) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -22.27% (0.4657 => 0.3620, std. dev.: 0.0061) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.27% (0.2670 => 0.2476, std. dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.15% (22.5627 => 20.9504, std. dev.: 0.0148) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.10% (0.3511 => 0.3297, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -5.38% (0.3623 => 0.3428, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.26% (0.3650 => 0.3458, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-2: -5.22% (0.3601 => 0.3413, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -5.13% (0.3663 => 0.3475, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -5.11% (0.3578 => 0.3395, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: -5.07% (0.3646 => 0.3461, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -4.77% (0.3940 => 0.3752, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -4.62% (0.3789 => 0.3614, std. dev.: 0.0032) SingleSource/UnitTests/ObjC/exceptions: -4.50% (0.3914 => 0.3738, std. dev.: 0.0035) SingleSource/UnitTests/ObjC/parameter-passing: -4.47% (0.4003 => 0.3824, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.74% (0.6576 => 0.6396, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.70% (0.8818 => 0.8580, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: -2.43% (0.6250 => 0.6098, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: -2.28% (0.5748 => 0.5617, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: -1.98% (0.5818 => 0.5703, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.82% (0.9108 => 0.8942, std. dev.: 0.0034) SingleSource/UnitTests/ObjC++/property-reference: -1.70% (0.7061 => 0.6941, std. dev.: 0.0023) MultiSource/Applications/lua/lua: -1.36% (3.7467 => 3.6958, std. dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.05% (6.2785 => 6.2123, std. dev.: 0.0038) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.13% (1.0460 => 0.9505, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2640, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.97% (1.3780 => 1.3095, std. dev.: 0.0092) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9623, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -3.97% (2.5089 => 2.4092, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.73% (0.3458 => 0.3329, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.63% (1.9762 => 1.9045, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: -2.13% (1.1560 => 1.1314, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -2.05% (6.3560 => 6.2256, std. dev.: 0.0066) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -2.02% (6.6320 => 6.4983, std. dev.: 0.0049) MultiSource/Benchmarks/mafft/pairlocalalign: -1.84% (28.2225 => 27.7019, std. dev.: 0.0024) MultiSource/Applications/minisat/minisat: -1.82% (9.3358 => 9.1658, std. dev.: 0.0231) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9954, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.60% (20.3410 => 20.0158, std. dev.: 0.0309) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) MultiSource/Applications/lua/lua: -1.53% (26.5159 => 26.1111, std. dev.: 0.0341) SingleSource/Benchmarks/Shootout/heapsort: -1.52% (3.9173 => 3.8576, std. dev.: 0.0097) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.50% (8.8259 => 8.6938, std. dev.: 0.0233) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.77s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat May 26 16:54:28 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 26 May 2012 18:54:28 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120526235428.1E0C02A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/807?compare_to=806&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 807, Order: 157522, Start Time: 2012-05-26 22:59:02, End Time: 2012-05-26 23:55:27 To: 806, Order: 157521, Start Time: 2012-05-26 21:36:45, End Time: 2012-05-26 22:33:10 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (48 on baseline) Performance Improvements: 0 (45 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 891 (795 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.08% (1.9462 => 1.9672, std. dev.: 0.0009) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 11.99% (2.0176 => 2.2595, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.94% (0.3130 => 0.3316, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.79% (0.2721 => 0.2824, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.89% (3.9660 => 4.0805, std. dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.41% (0.6959 => 0.7127, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.29% (0.9199 => 0.9410, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 2.28% (1.0594 => 1.0836, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.24% (0.5265 => 0.5383, std. dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 2.19% (13.8202 => 14.1228, std. dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/football/football: 2.13% (0.8310 => 0.8487, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.96% (1.2193 => 1.2432, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.93% (0.5637 => 0.5746, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.79% (1.1364 => 1.1567, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.77% (1.3245 => 1.3479, std. dev.: 0.0013) MultiSource/Applications/siod/siod: 1.67% (2.1791 => 2.2155, std. dev.: 0.0071) MultiSource/Applications/lambda-0_1_3/lambda: 1.59% (0.7038 => 0.7150, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.54% (13.2842 => 13.4884, std. dev.: 0.0143) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.53% (1.4563 => 1.4786, std. dev.: 0.0018) MultiSource/Benchmarks/MallocBench/gs/gs: 1.44% (3.8646 => 3.9202, std. dev.: 0.0047) MultiSource/Applications/kimwitu++/kc: 1.39% (16.6129 => 16.8430, std. dev.: 0.0168) MultiSource/Applications/treecc/treecc: 1.26% (1.9270 => 1.9512, std. dev.: 0.0011) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 24.25% (1.8175 => 2.2582, std. dev.: 0.0148) SingleSource/Benchmarks/Misc/mandel-2: 7.36% (1.2998 => 1.3955, std. dev.: 0.0077) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6755, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9878, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.76% (1.7688 => 1.8353, std. dev.: 0.0170) SingleSource/Benchmarks/Misc/salsa20: 3.56% (7.4271 => 7.6915, std. dev.: 0.0083) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4545, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: 2.85% (1.9199 => 1.9746, std. dev.: 0.0018) MultiSource/Benchmarks/nbench/nbench: 2.80% (11.2619 => 11.5773, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.72% (2.8606 => 2.9383, std. dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.65% (7.9275 => 8.1375, std. dev.: 0.0050) MultiSource/Applications/sqlite3/sqlite3: 2.36% (4.5928 => 4.7014, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 1.75% (3.2729 => 3.3303, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.58% (0.8273 => 0.8404, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.45% (1.4298 => 1.4506, std. dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5093, std. dev.: 0.0071) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.27% (2.0200 => 2.0457, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 1.16% (5.0168 => 5.0750, std. dev.: 0.0069) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.13% (1.9433 => 1.9652, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: 1.13% (9.0760 => 9.1782, std. dev.: 0.0010) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -21.28% (0.4657 => 0.3666, std. dev.: 0.0137) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.42% (0.2670 => 0.2472, std. dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.25% (22.5627 => 20.9280, std. dev.: 0.0080) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.10% (0.3511 => 0.3297, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -5.41% (0.3623 => 0.3427, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.32% (0.3650 => 0.3456, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -5.30% (0.3601 => 0.3410, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -5.23% (0.3578 => 0.3391, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -5.16% (0.3646 => 0.3458, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -5.13% (0.3663 => 0.3475, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -4.87% (0.3940 => 0.3748, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -4.80% (0.3789 => 0.3607, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -4.62% (0.3914 => 0.3733, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -4.55% (0.4003 => 0.3821, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: -2.72% (0.6250 => 0.6080, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.65% (0.8818 => 0.8584, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.63% (0.6576 => 0.6403, std. dev.: 0.0026) SingleSource/UnitTests/ObjC++/Hello: -2.38% (0.5748 => 0.5611, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: -2.06% (0.5818 => 0.5698, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.91% (0.9108 => 0.8934, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: -1.63% (0.7061 => 0.6946, std. dev.: 0.0002) MultiSource/Applications/lua/lua: -1.38% (3.7467 => 3.6951, std. dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.12% (6.2785 => 6.2080, std. dev.: 0.0036) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.13% (1.0460 => 0.9505, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.03% (1.3780 => 1.3087, std. dev.: 0.0095) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9622, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -4.03% (2.5089 => 2.4078, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.64% (1.9762 => 1.9043, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: -2.18% (1.1560 => 1.1308, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/lists: -2.11% (6.3560 => 6.2219, std. dev.: 0.0139) MultiSource/Applications/minisat/minisat: -2.05% (9.3358 => 9.1448, std. dev.: 0.0402) MultiSource/Benchmarks/mafft/pairlocalalign: -1.84% (28.2225 => 27.7035, std. dev.: 0.0016) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.83% (6.6320 => 6.5104, std. dev.: 0.0024) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.72% (20.3410 => 19.9912, std. dev.: 0.0383) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9953, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.56% (0.9692 => 0.9541, std. dev.: 0.0000) MultiSource/Applications/lua/lua: -1.50% (26.5159 => 26.1187, std. dev.: 0.0281) SingleSource/Benchmarks/Shootout/heapsort: -1.29% (3.9173 => 3.8667, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.27% (8.8259 => 8.7137, std. dev.: 0.0118) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.48s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat May 26 18:16:47 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 26 May 2012 20:16:47 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120527011647.3DC722A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/808?compare_to=807&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 808, Order: 157524, Start Time: 2012-05-27 00:21:21, End Time: 2012-05-27 01:17:46 To: 807, Order: 157522, Start Time: 2012-05-26 22:59:02, End Time: 2012-05-26 23:55:27 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (55 on baseline) Performance Improvements: 0 (42 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 891 (791 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 1.41% (3.8150 => 3.8688, std. dev.: 0.0174) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.05% (2.0176 => 2.2607, std. dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.36% (0.3130 => 0.3329, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.86% (0.2721 => 0.2826, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.09% (3.9660 => 4.0885, std. dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.70% (0.6959 => 0.7147, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.64% (0.9199 => 0.9442, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.60% (0.5265 => 0.5402, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 2.44% (13.8202 => 14.1575, std. dev.: 0.0065) MultiSource/Benchmarks/nbench/nbench: 2.40% (1.0594 => 1.0848, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 2.39% (0.8310 => 0.8509, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.14% (1.3245 => 1.3528, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.13% (0.5637 => 0.5757, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.12% (1.2193 => 1.2452, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.10% (1.1364 => 1.1603, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.84% (1.4563 => 1.4831, std. dev.: 0.0007) MultiSource/Applications/siod/siod: 1.76% (2.1791 => 2.2175, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.75% (13.2842 => 13.5162, std. dev.: 0.0045) MultiSource/Benchmarks/MallocBench/gs/gs: 1.64% (3.8646 => 3.9278, std. dev.: 0.0066) MultiSource/Applications/kimwitu++/kc: 1.63% (16.6129 => 16.8845, std. dev.: 0.0137) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.62% (0.7710 => 0.7835, std. dev.: 0.0019) MultiSource/Applications/Burg/burg: 1.59% (1.1061 => 1.1237, std. dev.: 0.0020) MultiSource/Applications/treecc/treecc: 1.57% (1.9270 => 1.9572, std. dev.: 0.0049) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.51% (0.7460 => 0.7573, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 1.45% (0.7038 => 0.7140, std. dev.: 0.0007) MultiSource/Applications/hbd/hbd: 1.39% (1.3693 => 1.3883, std. dev.: 0.0070) MultiSource/Applications/JM/lencod/lencod: 1.24% (14.8535 => 15.0374, std. dev.: 0.0068) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.03% (1.3819 => 1.3962, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.02% (3.6692 => 3.7068, std. dev.: 0.0042) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.01% (1.3813 => 1.3953, std. dev.: 0.0027) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/fbench: 24.24% (1.8175 => 2.2581, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/mandel-2: 8.01% (1.2998 => 1.4039, std. dev.: 0.0140) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6755, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8146, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.86% (1.9144 => 1.9883, std. dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.67% (1.7688 => 1.8337, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: 3.64% (7.4271 => 7.6975, std. dev.: 0.0089) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4541, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: 2.88% (1.9199 => 1.9752, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.81% (2.8606 => 2.9409, std. dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 2.80% (11.2619 => 11.5767, std. dev.: 0.0005) MultiSource/Benchmarks/llubenchmark/llu: 2.54% (3.7731 => 3.8688, std. dev.: 0.0174) MultiSource/Applications/sqlite3/sqlite3: 2.40% (4.5928 => 4.7032, std. dev.: 0.0034) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.35% (7.9275 => 8.1138, std. dev.: 0.0064) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 1.67% (3.2729 => 3.3276, std. dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.54% (0.8273 => 0.8400, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: 1.50% (1.4298 => 1.4512, std. dev.: 0.0029) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5086, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.27% (2.0200 => 2.0457, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1777, std. dev.: 0.0017) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -21.28% (0.4657 => 0.3666, std. dev.: 0.0288) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.53% (0.2670 => 0.2469, std. dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.98% (22.5627 => 20.9869, std. dev.: 0.0254) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.10% (0.3511 => 0.3297, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -4.50% (0.3623 => 0.3460, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.49% (0.3650 => 0.3486, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-2: -4.47% (0.3601 => 0.3440, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -4.37% (0.3663 => 0.3503, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -4.28% (0.3646 => 0.3490, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: -4.22% (0.3578 => 0.3427, std. dev.: 0.0021) SingleSource/UnitTests/ObjC/property: -3.98% (0.3940 => 0.3783, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -3.81% (0.3914 => 0.3765, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -3.77% (0.3789 => 0.3646, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: -3.62% (0.4003 => 0.3858, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.73% (0.8818 => 0.8577, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.72% (0.6576 => 0.6397, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: -2.32% (0.6250 => 0.6105, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: -1.81% (0.5748 => 0.5644, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.67% (0.9108 => 0.8956, std. dev.: 0.0001) MultiSource/Applications/lua/lua: -1.08% (3.7467 => 3.7064, std. dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.13% (1.0460 => 0.9505, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std. dev.: 0.0004) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9624, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.42% (1.3780 => 1.3171, std. dev.: 0.0046) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -3.97% (2.5089 => 2.4094, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.66% (1.9762 => 1.9039, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/richards_benchmark: -2.14% (1.1560 => 1.1313, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -2.13% (6.3560 => 6.2208, std. dev.: 0.0100) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.97% (6.6320 => 6.5013, std. dev.: 0.0060) MultiSource/Applications/minisat/minisat: -1.96% (9.3358 => 9.1524, std. dev.: 0.0092) MultiSource/Benchmarks/mafft/pairlocalalign: -1.84% (28.2225 => 27.7045, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.76% (20.3410 => 19.9831, std. dev.: 0.0345) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9955, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.60% (8.8259 => 8.6844, std. dev.: 0.0124) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.56% (0.9692 => 0.9541, std. dev.: 0.0000) MultiSource/Applications/lua/lua: -1.48% (26.5159 => 26.1226, std. dev.: 0.0091) SingleSource/Benchmarks/Shootout/heapsort: -1.46% (3.9173 => 3.8601, std. dev.: 0.0198) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.47s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun May 27 04:15:12 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 27 May 2012 06:15:12 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120527111512.AB6372A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/809?compare_to=808&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 809, Order: 157525, Start Time: 2012-05-27 10:19:15, End Time: 2012-05-27 11:16:13 To: 808, Order: 157524, Start Time: 2012-05-27 00:21:21, End Time: 2012-05-27 01:17:46 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (53 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 891 (795 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 1.30% (1.4039 => 1.4221, std. dev.: 0.0037) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.16% (2.0176 => 2.2630, std. dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.23% (0.3130 => 0.3325, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.90% (0.2721 => 0.2827, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.15% (0.6959 => 0.7178, std. dev.: 0.0016) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.09% (3.9660 => 4.0887, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.75% (0.5265 => 0.5410, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.60% (0.9199 => 0.9438, std. dev.: 0.0018) MultiSource/Benchmarks/nbench/nbench: 2.55% (1.0594 => 1.0864, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/football/football: 2.50% (0.8310 => 0.8518, std. dev.: 0.0016) MultiSource/Applications/SPASS/SPASS: 2.41% (13.8202 => 14.1533, std. dev.: 0.0087) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.31% (0.7710 => 0.7888, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.25% (0.5637 => 0.5764, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.25% (1.2193 => 1.2467, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.21% (1.3245 => 1.3538, std. dev.: 0.0063) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.14% (1.1364 => 1.1607, std. dev.: 0.0022) MultiSource/Applications/siod/siod: 1.98% (2.1791 => 2.2223, std. dev.: 0.0050) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.81% (1.4563 => 1.4827, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.75% (13.2842 => 13.5173, std. dev.: 0.0064) MultiSource/Applications/kimwitu++/kc: 1.66% (16.6129 => 16.8880, std. dev.: 0.0139) MultiSource/Applications/Burg/burg: 1.63% (1.1061 => 1.1241, std. dev.: 0.0035) MultiSource/Benchmarks/MallocBench/gs/gs: 1.62% (3.8646 => 3.9272, std. dev.: 0.0023) MultiSource/Applications/treecc/treecc: 1.54% (1.9270 => 1.9566, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.47% (0.7460 => 0.7570, std. dev.: 0.0016) MultiSource/Applications/JM/lencod/lencod: 1.45% (14.8535 => 15.0691, std. dev.: 0.0039) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.19% (1.3819 => 1.3984, std. dev.: 0.0018) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.11% (1.3813 => 1.3966, std. dev.: 0.0013) MultiSource/Applications/SIBsim4/SIBsim4: 1.01% (1.2749 => 1.2878, std. dev.: 0.0022) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: 24.59% (1.8175 => 2.2645, std. dev.: 0.0503) SingleSource/Benchmarks/Misc/mandel-2: 9.41% (1.2998 => 1.4221, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7298, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6754, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9879, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.68% (1.7688 => 1.8339, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: 3.60% (7.4271 => 7.6945, std. dev.: 0.0057) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4542, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-6: 2.93% (1.9199 => 1.9762, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 2.80% (11.2619 => 11.5770, std. dev.: 0.0051) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.76% (2.8606 => 2.9396, std. dev.: 0.0017) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.55% (7.9275 => 8.1297, std. dev.: 0.0049) MultiSource/Applications/sqlite3/sqlite3: 2.38% (4.5928 => 4.7020, std. dev.: 0.0111) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 1.74% (3.2729 => 3.3298, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/ffbench: 1.58% (0.8273 => 0.8404, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: 1.48% (1.9290 => 1.9575, std. dev.: 0.0013) MultiSource/Applications/lemon/lemon: 1.48% (1.4298 => 1.4509, std. dev.: 0.0006) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5092, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.29% (2.0200 => 2.0460, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.20% (1.9433 => 1.9667, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 1.11% (9.0760 => 9.1771, std. dev.: 0.0014) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.53% (0.2670 => 0.2469, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.93% (22.5627 => 20.9994, std. dev.: 0.0130) SingleSource/UnitTests/ObjC/exceptions-3: -4.47% (0.3623 => 0.3461, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -4.33% (0.3601 => 0.3445, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -4.30% (0.3578 => 0.3424, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -4.25% (0.3646 => 0.3491, std. dev.: 0.0037) SingleSource/UnitTests/ObjC/synchronized: -4.23% (0.3663 => 0.3508, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.08% (0.3650 => 0.3501, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/property: -3.91% (0.3940 => 0.3786, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -3.73% (0.3914 => 0.3768, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -3.72% (0.3789 => 0.3648, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -3.70% (0.4003 => 0.3855, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.78% (0.6576 => 0.6393, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.68% (0.8818 => 0.8582, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: -2.40% (0.6250 => 0.6100, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.70% (0.9108 => 0.8953, std. dev.: 0.0004) MultiSource/Applications/lua/lua: -1.06% (3.7467 => 3.7070, std. dev.: 0.0015) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.14% (1.0460 => 0.9504, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.06% (1.3780 => 1.3083, std. dev.: 0.0125) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9624, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -3.97% (2.5089 => 2.4092, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.67% (0.3458 => 0.3331, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.64% (1.9762 => 1.9043, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/richards_benchmark: -2.16% (1.1560 => 1.1310, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -2.16% (6.3560 => 6.2186, std. dev.: 0.0117) MultiSource/Applications/minisat/minisat: -1.93% (9.3358 => 9.1555, std. dev.: 0.0094) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.88% (6.6320 => 6.5073, std. dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: -1.84% (28.2225 => 27.7030, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.73% (20.3410 => 19.9895, std. dev.: 0.0287) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0001) MultiSource/Applications/lua/lua: -1.60% (26.5159 => 26.0904, std. dev.: 0.0150) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9959, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.58% (8.8259 => 8.6863, std. dev.: 0.0248) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.52% (3.9173 => 3.8577, std. dev.: 0.0062) MultiSource/Applications/spiff/spiff: -1.00% (3.0263 => 2.9960, std. dev.: 0.0034) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.49s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun May 27 05:37:47 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 27 May 2012 07:37:47 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120527123747.BECE82A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/810?compare_to=809&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 810, Order: 157527, Start Time: 2012-05-27 11:42:15, End Time: 2012-05-27 12:38:48 To: 809, Order: 157525, Start Time: 2012-05-27 10:19:15, End Time: 2012-05-27 11:16:13 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (57 on baseline) Performance Improvements: 1 (42 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 891 (789 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -16.35% (0.4427 => 0.3703, std. dev.: 0.0109) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.02% (2.0176 => 2.2602, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.23% (0.3130 => 0.3325, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.93% (0.2721 => 0.2828, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.10% (3.9660 => 4.0889, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.80% (0.6959 => 0.7154, std. dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.63% (0.9199 => 0.9441, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 2.60% (1.0594 => 1.0869, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.58% (0.5265 => 0.5401, std. dev.: 0.0014) MultiSource/Applications/SPASS/SPASS: 2.49% (13.8202 => 14.1637, std. dev.: 0.0151) MultiSource/Benchmarks/Prolangs-C/football/football: 2.37% (0.8310 => 0.8507, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.27% (1.2193 => 1.2470, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.20% (0.5637 => 0.5761, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.05% (1.3245 => 1.3517, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.02% (1.1364 => 1.1594, std. dev.: 0.0011) MultiSource/Applications/siod/siod: 2.02% (2.1791 => 2.2231, std. dev.: 0.0034) MultiSource/Applications/lambda-0_1_3/lambda: 1.78% (0.7038 => 0.7163, std. dev.: 0.0046) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.73% (13.2842 => 13.5141, std. dev.: 0.0073) MultiSource/Applications/Burg/burg: 1.73% (1.1061 => 1.1252, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.71% (0.7710 => 0.7842, std. dev.: 0.0023) MultiSource/Benchmarks/MallocBench/gs/gs: 1.71% (3.8646 => 3.9306, std. dev.: 0.0064) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.70% (1.4563 => 1.4811, std. dev.: 0.0020) MultiSource/Applications/kimwitu++/kc: 1.66% (16.6129 => 16.8881, std. dev.: 0.0107) MultiSource/Applications/treecc/treecc: 1.60% (1.9270 => 1.9579, std. dev.: 0.0119) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.58% (0.7460 => 0.7578, std. dev.: 0.0009) MultiSource/Applications/hbd/hbd: 1.39% (1.3693 => 1.3884, std. dev.: 0.0026) MultiSource/Applications/JM/lencod/lencod: 1.26% (14.8535 => 15.0408, std. dev.: 0.0086) MultiSource/Applications/SIBsim4/SIBsim4: 1.11% (1.2749 => 1.2891, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.08% (1.3819 => 1.3968, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.06% (1.3813 => 1.3959, std. dev.: 0.0029) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/fbench: 24.75% (1.8175 => 2.2673, std. dev.: 0.0414) SingleSource/Benchmarks/Misc/mandel-2: 9.00% (1.2998 => 1.4168, std. dev.: 0.0054) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.87% (1.5824 => 1.6753, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8147, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9879, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.63% (1.7688 => 1.8330, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/salsa20: 3.47% (7.4271 => 7.6851, std. dev.: 0.0042) MultiSource/Applications/hexxagon/hexxagon: 3.01% (12.0921 => 12.4557, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: 2.86% (1.9199 => 1.9748, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 2.80% (11.2619 => 11.5771, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.76% (2.8606 => 2.9395, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.39% (7.9275 => 8.1170, std. dev.: 0.0157) MultiSource/Applications/sqlite3/sqlite3: 2.34% (4.5928 => 4.7005, std. dev.: 0.0088) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 1.67% (3.2729 => 3.3276, std. dev.: 0.0015) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.55% (0.8273 => 0.8401, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.52% (1.4298 => 1.4516, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5079, std. dev.: 0.0034) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.26% (2.0200 => 2.0454, std. dev.: 0.0075) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.21% (1.9433 => 1.9668, std. dev.: 0.0089) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1777, std. dev.: 0.0024) MultiSource/Benchmarks/sim/sim: 1.11% (5.0168 => 5.0726, std. dev.: 0.0062) SingleSource/Benchmarks/McGill/chomp: 1.01% (1.2308 => 1.2432, std. dev.: 0.0028) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -20.49% (0.4657 => 0.3703, std. dev.: 0.0109) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.57% (0.2670 => 0.2468, std. dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.93% (22.5627 => 20.9985, std. dev.: 0.0168) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.07% (0.3511 => 0.3298, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-3: -4.53% (0.3623 => 0.3459, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.47% (0.3650 => 0.3487, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -4.33% (0.3601 => 0.3445, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -4.31% (0.3663 => 0.3505, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: -4.30% (0.3578 => 0.3424, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -4.22% (0.3646 => 0.3492, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -4.01% (0.3940 => 0.3782, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -3.83% (0.3789 => 0.3644, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -3.78% (0.3914 => 0.3766, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -3.67% (0.4003 => 0.3856, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.78% (0.6576 => 0.6393, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.74% (0.8818 => 0.8576, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/bigfib: -2.37% (0.6250 => 0.6102, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.62% (0.9108 => 0.8960, std. dev.: 0.0042) MultiSource/Applications/lua/lua: -1.09% (3.7467 => 3.7060, std. dev.: 0.0034) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.13% (1.0460 => 0.9505, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.31% (0.3139 => 0.2941, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.64% (1.3780 => 1.3140, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9624, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -4.03% (2.5089 => 2.4079, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.73% (0.3458 => 0.3329, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.66% (1.9762 => 1.9038, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/richards_benchmark: -2.15% (1.1560 => 1.1311, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -2.03% (6.6320 => 6.4976, std. dev.: 0.0092) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.99% (20.3410 => 19.9358, std. dev.: 0.0641) SingleSource/Benchmarks/Shootout/lists: -1.99% (6.3560 => 6.2294, std. dev.: 0.0149) MultiSource/Applications/minisat/minisat: -1.92% (9.3358 => 9.1563, std. dev.: 0.0144) MultiSource/Benchmarks/mafft/pairlocalalign: -1.85% (28.2225 => 27.7014, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3446, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9953, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.46% (3.9173 => 3.8600, std. dev.: 0.0078) MultiSource/Applications/lua/lua: -1.38% (26.5159 => 26.1509, std. dev.: 0.0168) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.32% (8.8259 => 8.7098, std. dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.09% (3.8887 => 3.8465, std. dev.: 0.0045) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.30s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun May 27 07:30:27 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 27 May 2012 09:30:27 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120527143027.65B4B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/811?compare_to=810&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 811, Order: 157529, Start Time: 2012-05-27 13:34:51, End Time: 2012-05-27 14:31:28 To: 810, Order: 157527, Start Time: 2012-05-27 11:42:15, End Time: 2012-05-27 12:38:48 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (54 on baseline) Performance Improvements: 0 (41 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (793 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.02% (2.0176 => 2.2601, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.23% (0.3130 => 0.3325, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.93% (0.2721 => 0.2828, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.09% (3.9660 => 4.0885, std. dev.: 0.0092) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.82% (0.6959 => 0.7155, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.60% (0.9199 => 0.9438, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.53% (0.5265 => 0.5398, std. dev.: 0.0028) MultiSource/Applications/SPASS/SPASS: 2.39% (13.8202 => 14.1503, std. dev.: 0.0086) MultiSource/Benchmarks/nbench/nbench: 2.38% (1.0594 => 1.0846, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/football/football: 2.31% (0.8310 => 0.8502, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.20% (1.2193 => 1.2461, std. dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.13% (1.3245 => 1.3527, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.06% (0.5637 => 0.5753, std. dev.: 0.0021) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.02% (1.1364 => 1.1593, std. dev.: 0.0006) MultiSource/Applications/siod/siod: 1.94% (2.1791 => 2.2214, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.93% (1.4563 => 1.4844, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.81% (13.2842 => 13.5252, std. dev.: 0.0233) MultiSource/Applications/Burg/burg: 1.78% (1.1061 => 1.1258, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/gs/gs: 1.77% (3.8646 => 3.9330, std. dev.: 0.0121) MultiSource/Applications/kimwitu++/kc: 1.69% (16.6129 => 16.8930, std. dev.: 0.0205) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.65% (0.7710 => 0.7837, std. dev.: 0.0025) MultiSource/Applications/treecc/treecc: 1.54% (1.9270 => 1.9567, std. dev.: 0.0039) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.51% (0.7460 => 0.7573, std. dev.: 0.0037) MultiSource/Applications/lambda-0_1_3/lambda: 1.51% (0.7038 => 0.7144, std. dev.: 0.0008) MultiSource/Applications/hbd/hbd: 1.41% (1.3693 => 1.3886, std. dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 1.24% (14.8535 => 15.0371, std. dev.: 0.0080) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.07% (1.3813 => 1.3961, std. dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/fbench: 24.58% (1.8175 => 2.2642, std. dev.: 0.0322) SingleSource/Benchmarks/Misc/mandel-2: 7.58% (1.2998 => 1.3983, std. dev.: 0.0107) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.89% (1.5824 => 1.6756, std. dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: 3.81% (1.9144 => 1.9873, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.68% (1.7688 => 1.8339, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: 3.49% (7.4271 => 7.6864, std. dev.: 0.0055) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4533, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-6: 2.89% (1.9199 => 1.9754, std. dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 2.79% (11.2619 => 11.5764, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9394, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.49% (7.9275 => 8.1251, std. dev.: 0.0090) MultiSource/Applications/sqlite3/sqlite3: 2.40% (4.5928 => 4.7032, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 1.72% (3.2729 => 3.3293, std. dev.: 0.0031) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.61% (0.8273 => 0.8406, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.54% (1.4298 => 1.4518, std. dev.: 0.0023) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5085, std. dev.: 0.0034) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.27% (2.0200 => 2.0457, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 1.19% (1.2308 => 1.2454, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.17% (1.9433 => 1.9660, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: 1.11% (9.0760 => 9.1771, std. dev.: 0.0010) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -18.32% (0.4657 => 0.3804, std. dev.: 0.0323) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.53% (0.2670 => 0.2469, std. dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.95% (22.5627 => 20.9954, std. dev.: 0.0053) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.10% (0.3511 => 0.3297, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-3: -4.39% (0.3623 => 0.3464, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.38% (0.3650 => 0.3490, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-2: -4.28% (0.3601 => 0.3447, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -4.26% (0.3663 => 0.3507, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -4.25% (0.3578 => 0.3426, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -4.20% (0.3646 => 0.3493, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -3.88% (0.3940 => 0.3787, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -3.77% (0.3789 => 0.3646, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -3.70% (0.3914 => 0.3769, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -3.65% (0.4003 => 0.3857, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.76% (0.8818 => 0.8575, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: -2.42% (0.6250 => 0.6099, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.36% (0.6576 => 0.6421, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.75% (0.9108 => 0.8949, std. dev.: 0.0002) MultiSource/Applications/lua/lua: -1.02% (3.7467 => 3.7083, std. dev.: 0.0040) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.14% (1.0460 => 0.9504, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.52% (1.3780 => 1.3019, std. dev.: 0.0151) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9624, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -4.08% (2.5089 => 2.4066, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/bh/bh: -3.71% (1.9762 => 1.9028, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -2.44% (6.3560 => 6.2010, std. dev.: 0.0152) SingleSource/Benchmarks/Misc/richards_benchmark: -2.14% (1.1560 => 1.1313, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: -1.94% (9.3358 => 9.1548, std. dev.: 0.0378) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.91% (6.6320 => 6.5053, std. dev.: 0.0035) MultiSource/Benchmarks/mafft/pairlocalalign: -1.83% (28.2225 => 27.7067, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.77% (20.3410 => 19.9814, std. dev.: 0.0633) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.61% (8.8259 => 8.6840, std. dev.: 0.0125) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9960, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) MultiSource/Applications/lua/lua: -1.46% (26.5159 => 26.1285, std. dev.: 0.0073) SingleSource/Benchmarks/Shootout/heapsort: -1.42% (3.9173 => 3.8616, std. dev.: 0.0033) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.30s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun May 27 08:53:02 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 27 May 2012 10:53:02 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120527155302.D38D22A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/812?compare_to=811&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 812, Order: 157533, Start Time: 2012-05-27 14:57:32, End Time: 2012-05-27 15:54:03 To: 811, Order: 157529, Start Time: 2012-05-27 13:34:51, End Time: 2012-05-27 14:31:28 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (51 on baseline) Performance Improvements: 0 (44 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (793 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.35% (2.0176 => 2.2668, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.20% (0.3130 => 0.3324, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.97% (0.2721 => 0.2829, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.08% (3.9660 => 4.0881, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.77% (0.6959 => 0.7152, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.72% (0.5265 => 0.5408, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.52% (0.9199 => 0.9431, std. dev.: 0.0019) MultiSource/Benchmarks/nbench/nbench: 2.48% (1.0594 => 1.0857, std. dev.: 0.0024) MultiSource/Applications/SPASS/SPASS: 2.40% (13.8202 => 14.1520, std. dev.: 0.0138) MultiSource/Benchmarks/Prolangs-C/football/football: 2.27% (0.8310 => 0.8499, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.17% (1.2193 => 1.2458, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.15% (0.5637 => 0.5758, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.07% (1.3245 => 1.3519, std. dev.: 0.0017) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.97% (1.1364 => 1.1588, std. dev.: 0.0086) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.66% (13.2842 => 13.5052, std. dev.: 0.0081) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.63% (0.7710 => 0.7836, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.57% (0.7460 => 0.7577, std. dev.: 0.0015) MultiSource/Applications/treecc/treecc: 1.57% (1.9270 => 1.9572, std. dev.: 0.0019) MultiSource/Benchmarks/MallocBench/gs/gs: 1.57% (3.8646 => 3.9251, std. dev.: 0.0041) MultiSource/Applications/kimwitu++/kc: 1.53% (16.6129 => 16.8669, std. dev.: 0.0068) MultiSource/Applications/Burg/burg: 1.51% (1.1061 => 1.1228, std. dev.: 0.0010) MultiSource/Applications/JM/lencod/lencod: 1.28% (14.8535 => 15.0429, std. dev.: 0.0113) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.22% (1.3819 => 1.3988, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.11% (3.6692 => 3.7101, std. dev.: 0.0018) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.11% (1.3813 => 1.3966, std. dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: 24.09% (1.8175 => 2.2554, std. dev.: 0.0295) SingleSource/Benchmarks/Misc/mandel-2: 7.30% (1.2998 => 1.3947, std. dev.: 0.0074) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.89% (1.5824 => 1.6756, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8146, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9877, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.73% (1.7688 => 1.8347, std. dev.: 0.0058) SingleSource/Benchmarks/Misc/salsa20: 3.60% (7.4271 => 7.6944, std. dev.: 0.0094) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4545, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: 2.90% (1.9199 => 1.9756, std. dev.: 0.0017) MultiSource/Benchmarks/nbench/nbench: 2.80% (11.2619 => 11.5775, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.76% (2.8606 => 2.9395, std. dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 2.36% (4.5928 => 4.7011, std. dev.: 0.0028) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.28% (7.9275 => 8.1085, std. dev.: 0.0155) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 1.69% (3.2729 => 3.3281, std. dev.: 0.0019) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9603, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.62% (0.8273 => 0.8407, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.49% (1.4298 => 1.4511, std. dev.: 0.0006) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5098, std. dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.27% (2.0200 => 2.0456, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.19% (1.9433 => 1.9664, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 1.13% (9.0760 => 9.1783, std. dev.: 0.0018) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.42% (0.2670 => 0.2472, std. dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.12% (22.5627 => 20.9570, std. dev.: 0.0222) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.95% (0.3511 => 0.3302, std. dev.: 0.0046) SingleSource/UnitTests/ObjC/exceptions-3: -4.47% (0.3623 => 0.3461, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.44% (0.3650 => 0.3488, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -4.33% (0.3601 => 0.3445, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -4.30% (0.3578 => 0.3424, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -4.29% (0.3663 => 0.3506, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -4.14% (0.3646 => 0.3495, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -3.81% (0.3940 => 0.3790, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: -3.77% (0.3789 => 0.3646, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -3.70% (0.3914 => 0.3769, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -3.60% (0.4003 => 0.3859, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.87% (0.8818 => 0.8565, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.80% (0.6576 => 0.6392, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: -2.53% (0.6250 => 0.6092, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: -2.21% (0.5748 => 0.5621, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: -1.93% (0.5818 => 0.5706, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.81% (0.9108 => 0.8943, std. dev.: 0.0041) SingleSource/UnitTests/ObjC++/property-reference: -1.59% (0.7061 => 0.6949, std. dev.: 0.0005) MultiSource/Applications/lua/lua: -1.16% (3.7467 => 3.7034, std. dev.: 0.0033) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.13% (1.0460 => 0.9505, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2641, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.02% (1.3780 => 1.3088, std. dev.: 0.0035) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9624, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -3.91% (2.5089 => 2.4107, std. dev.: 0.0030) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.73% (0.3458 => 0.3329, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.69% (1.9762 => 1.9033, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/richards_benchmark: -2.14% (1.1560 => 1.1313, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -2.07% (6.3560 => 6.2243, std. dev.: 0.0045) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.98% (20.3410 => 19.9377, std. dev.: 0.0637) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.97% (6.6320 => 6.5014, std. dev.: 0.0037) MultiSource/Applications/minisat/minisat: -1.86% (9.3358 => 9.1617, std. dev.: 0.0048) MultiSource/Benchmarks/mafft/pairlocalalign: -1.85% (28.2225 => 27.7011, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3444, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9958, std. dev.: 0.0002) MultiSource/Applications/lua/lua: -1.58% (26.5159 => 26.0979, std. dev.: 0.0440) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.38% (8.8259 => 8.7038, std. dev.: 0.0177) SingleSource/Benchmarks/Shootout/heapsort: -1.38% (3.9173 => 3.8633, std. dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.09% (3.8887 => 3.8465, std. dev.: 0.0051) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.46s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun May 27 10:15:37 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 27 May 2012 12:15:37 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120527171537.F11B02A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/813?compare_to=812&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 813, Order: 157534, Start Time: 2012-05-27 16:20:05, End Time: 2012-05-27 17:16:38 To: 812, Order: 157533, Start Time: 2012-05-27 14:57:32, End Time: 2012-05-27 15:54:03 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (52 on baseline) Performance Improvements: 0 (45 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 891 (791 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 1.76% (3.7614 => 3.8277, std. dev.: 0.0180) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.34% (2.0176 => 2.2665, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.20% (0.3130 => 0.3324, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.79% (0.2721 => 0.2824, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.07% (3.9660 => 4.0877, std. dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.73% (0.6959 => 0.7149, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.60% (0.5265 => 0.5402, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 2.48% (1.0594 => 1.0857, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.48% (0.9199 => 0.9427, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/football/football: 2.42% (0.8310 => 0.8511, std. dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 2.33% (13.8202 => 14.1421, std. dev.: 0.0137) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.07% (1.3245 => 1.3519, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.07% (1.2193 => 1.2445, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.97% (0.5637 => 0.5748, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.93% (1.1364 => 1.1583, std. dev.: 0.0006) MultiSource/Applications/siod/siod: 1.75% (2.1791 => 2.2173, std. dev.: 0.0052) MultiSource/Benchmarks/MallocBench/gs/gs: 1.71% (3.8646 => 3.9308, std. dev.: 0.0072) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.61% (13.2842 => 13.4986, std. dev.: 0.0105) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.59% (1.4563 => 1.4794, std. dev.: 0.0023) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.56% (0.7710 => 0.7830, std. dev.: 0.0021) MultiSource/Applications/Burg/burg: 1.53% (1.1061 => 1.1230, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 1.46% (0.7038 => 0.7141, std. dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 1.42% (16.6129 => 16.8492, std. dev.: 0.0100) MultiSource/Applications/treecc/treecc: 1.38% (1.9270 => 1.9536, std. dev.: 0.0023) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.37% (0.7460 => 0.7562, std. dev.: 0.0030) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.17% (1.3813 => 1.3975, std. dev.: 0.0015) MultiSource/Applications/JM/lencod/lencod: 1.14% (14.8535 => 15.0232, std. dev.: 0.0050) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.93% (0.4846 => 0.6975, std. dev.: 0.0070) SingleSource/Benchmarks/Misc/fbench: 25.18% (1.8175 => 2.2751, std. dev.: 0.0103) SingleSource/Benchmarks/Misc/mandel-2: 6.65% (1.2998 => 1.3862, std. dev.: 0.0192) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6755, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.81% (1.9144 => 1.9873, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.66% (1.7688 => 1.8335, std. dev.: 0.0179) SingleSource/Benchmarks/Misc/salsa20: 3.60% (7.4271 => 7.6947, std. dev.: 0.0068) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4531, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-6: 2.84% (1.9199 => 1.9744, std. dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 2.79% (11.2619 => 11.5760, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9393, std. dev.: 0.0019) MultiSource/Applications/sqlite3/sqlite3: 2.36% (4.5928 => 4.7014, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.15% (7.9275 => 8.0980, std. dev.: 0.0163) MultiSource/Applications/siod/siod: 1.74% (3.2729 => 3.3299, std. dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0082) MultiSource/Benchmarks/llubenchmark/llu: 1.45% (3.7731 => 3.8277, std. dev.: 0.0180) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5089, std. dev.: 0.0107) MultiSource/Applications/lemon/lemon: 1.41% (1.4298 => 1.4499, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.28% (2.0200 => 2.0459, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.13% (1.9433 => 1.9652, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: 1.13% (9.0760 => 9.1782, std. dev.: 0.0009) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.53% (0.2670 => 0.2469, std. dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.08% (22.5627 => 20.9657, std. dev.: 0.0152) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.04% (0.3511 => 0.3299, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: -5.38% (0.3623 => 0.3428, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -5.36% (0.3601 => 0.3408, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.32% (0.3650 => 0.3456, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/synchronized: -5.24% (0.3663 => 0.3471, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -5.23% (0.3578 => 0.3391, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -5.18% (0.3646 => 0.3457, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -4.75% (0.3940 => 0.3753, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -4.65% (0.3914 => 0.3732, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -4.65% (0.3789 => 0.3613, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -4.47% (0.4003 => 0.3824, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.85% (0.8818 => 0.8567, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.77% (0.6576 => 0.6394, std. dev.: 0.0015) SingleSource/UnitTests/ObjC++/Hello: -2.70% (0.5748 => 0.5593, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: -2.66% (0.6250 => 0.6084, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: -2.49% (0.5818 => 0.5673, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: -2.12% (0.7061 => 0.6911, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.75% (0.9108 => 0.8949, std. dev.: 0.0024) MultiSource/Applications/lua/lua: -1.12% (3.7467 => 3.7046, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.09% (1.9828 => 1.9612, std. dev.: 0.0013) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.14% (1.0460 => 0.9504, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.31% (0.3139 => 0.2941, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2642, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.77% (1.3780 => 1.3123, std. dev.: 0.0068) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9622, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.94% (2.5089 => 2.4101, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.60% (1.9762 => 1.9050, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: -2.15% (1.1560 => 1.1312, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -2.06% (6.3560 => 6.2252, std. dev.: 0.0045) MultiSource/Applications/minisat/minisat: -1.95% (9.3358 => 9.1538, std. dev.: 0.0267) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.93% (6.6320 => 6.5040, std. dev.: 0.0049) MultiSource/Benchmarks/mafft/pairlocalalign: -1.84% (28.2225 => 27.7032, std. dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.84% (20.3410 => 19.9675, std. dev.: 0.0624) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3444, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9951, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) MultiSource/Applications/lua/lua: -1.48% (26.5159 => 26.1239, std. dev.: 0.0185) SingleSource/Benchmarks/Shootout/heapsort: -1.48% (3.9173 => 3.8594, std. dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.18% (8.8259 => 8.7216, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.05% (3.8887 => 3.8478, std. dev.: 0.0057) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.48s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun May 27 11:38:06 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 27 May 2012 13:38:06 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120527183806.A16BC2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/814?compare_to=813&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 814, Order: 157537, Start Time: 2012-05-27 17:42:35, End Time: 2012-05-27 18:39:07 To: 813, Order: 157534, Start Time: 2012-05-27 16:20:05, End Time: 2012-05-27 17:16:38 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (50 on baseline) Performance Improvements: 0 (44 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (794 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.33% (2.0176 => 2.2664, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.23% (0.3130 => 0.3325, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.90% (0.2721 => 0.2827, std. dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.97% (3.9660 => 4.0839, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.62% (0.6959 => 0.7141, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.60% (0.5265 => 0.5402, std. dev.: 0.0044) MultiSource/Benchmarks/nbench/nbench: 2.46% (1.0594 => 1.0855, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.41% (0.9199 => 0.9421, std. dev.: 0.0079) MultiSource/Applications/SPASS/SPASS: 2.40% (13.8202 => 14.1514, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/football/football: 2.27% (0.8310 => 0.8499, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.12% (1.2193 => 1.2452, std. dev.: 0.0031) MultiSource/Applications/siod/siod: 2.06% (2.1791 => 2.2240, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.00% (0.5637 => 0.5750, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.99% (1.3245 => 1.3509, std. dev.: 0.0017) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.94% (1.1364 => 1.1584, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.79% (1.4563 => 1.4824, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 1.55% (3.8646 => 3.9245, std. dev.: 0.0053) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.55% (13.2842 => 13.4901, std. dev.: 0.0177) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.54% (0.7710 => 0.7829, std. dev.: 0.0011) MultiSource/Applications/Burg/burg: 1.48% (1.1061 => 1.1225, std. dev.: 0.0010) MultiSource/Applications/kimwitu++/kc: 1.43% (16.6129 => 16.8512, std. dev.: 0.0087) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.41% (0.7460 => 0.7565, std. dev.: 0.0024) MultiSource/Applications/JM/lencod/lencod: 1.26% (14.8535 => 15.0400, std. dev.: 0.0105) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.17% (1.3819 => 1.3980, std. dev.: 0.0014) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/fbench: 23.94% (1.8175 => 2.2527, std. dev.: 0.0105) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7298, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.36% (1.2998 => 1.3825, std. dev.: 0.0193) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.87% (1.5824 => 1.6753, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9875, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.66% (1.7688 => 1.8336, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/salsa20: 3.54% (7.4271 => 7.6902, std. dev.: 0.0047) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4538, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: 2.88% (1.9199 => 1.9752, std. dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 2.81% (11.2619 => 11.5783, std. dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.74% (2.8606 => 2.9390, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.60% (7.9275 => 8.1336, std. dev.: 0.0080) MultiSource/Applications/sqlite3/sqlite3: 2.38% (4.5928 => 4.7023, std. dev.: 0.0078) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 1.65% (3.2729 => 3.3269, std. dev.: 0.0083) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9603, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.58% (0.8273 => 0.8404, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.42% (1.4298 => 1.4501, std. dev.: 0.0010) MultiSource/Benchmarks/NPB-serial/is/is: 1.39% (8.3908 => 8.5072, std. dev.: 0.0063) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.27% (2.0200 => 2.0456, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.20% (1.9433 => 1.9666, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 1.13% (9.0760 => 9.1783, std. dev.: 0.0012) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -20.68% (0.4657 => 0.3694, std. dev.: 0.0145) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.45% (0.2670 => 0.2471, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.07% (22.5627 => 20.9680, std. dev.: 0.0160) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.87% (0.3511 => 0.3305, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-3: -5.11% (0.3623 => 0.3438, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.07% (0.3650 => 0.3465, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -5.00% (0.3601 => 0.3421, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -5.00% (0.3663 => 0.3480, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -4.99% (0.3646 => 0.3464, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -4.92% (0.3578 => 0.3402, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/property: -4.59% (0.3940 => 0.3759, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -4.46% (0.3789 => 0.3620, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: -4.34% (0.3914 => 0.3744, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: -4.17% (0.4003 => 0.3836, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.97% (0.6576 => 0.6381, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.74% (0.8818 => 0.8576, std. dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/bigfib: -2.69% (0.6250 => 0.6082, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: -2.49% (0.5748 => 0.5605, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference-object: -2.13% (0.5818 => 0.5694, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: -1.70% (0.7061 => 0.6941, std. dev.: 0.0033) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.66% (0.9108 => 0.8957, std. dev.: 0.0002) MultiSource/Applications/lua/lua: -1.17% (3.7467 => 3.7028, std. dev.: 0.0097) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.13% (1.9828 => 1.9603, std. dev.: 0.0014) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.14% (1.0460 => 0.9504, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2641, std. dev.: 0.0004) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9624, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0010) SingleSource/Benchmarks/Dhrystone/dry: -4.01% (2.5089 => 2.4083, std. dev.: 0.0017) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.73% (0.3458 => 0.3329, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -3.69% (1.9762 => 1.9032, std. dev.: 0.0092) SingleSource/Benchmarks/Shootout/lists: -2.36% (6.3560 => 6.2063, std. dev.: 0.0094) SingleSource/Benchmarks/Misc/richards_benchmark: -2.15% (1.1560 => 1.1312, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.96% (6.6320 => 6.5018, std. dev.: 0.0069) MultiSource/Applications/minisat/minisat: -1.90% (9.3358 => 9.1587, std. dev.: 0.0060) MultiSource/Benchmarks/mafft/pairlocalalign: -1.84% (28.2225 => 27.7027, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.80% (20.3410 => 19.9754, std. dev.: 0.0248) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0001) MultiSource/Applications/lua/lua: -1.62% (26.5159 => 26.0872, std. dev.: 0.0146) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9958, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.56% (0.9692 => 0.9541, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.43% (8.8259 => 8.6995, std. dev.: 0.0128) SingleSource/Benchmarks/Shootout/heapsort: -1.43% (3.9173 => 3.8614, std. dev.: 0.0038) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.24s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun May 27 13:00:50 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 27 May 2012 15:00:50 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120527200050.202522A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/815?compare_to=814&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 815, Order: 157540, Start Time: 2012-05-27 19:04:59, End Time: 2012-05-27 20:01:51 To: 814, Order: 157537, Start Time: 2012-05-27 17:42:35, End Time: 2012-05-27 18:39:07 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (59 on baseline) Performance Improvements: 0 (38 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (791 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.43% (2.0176 => 2.2683, std. dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.58% (0.3130 => 0.3336, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.15% (0.2721 => 0.2834, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.27% (3.9660 => 4.0955, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.06% (0.6959 => 0.7172, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.87% (0.5265 => 0.5416, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.78% (0.9199 => 0.9455, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 2.65% (13.8202 => 14.1866, std. dev.: 0.0214) MultiSource/Benchmarks/nbench/nbench: 2.62% (1.0594 => 1.0872, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/football/football: 2.53% (0.8310 => 0.8520, std. dev.: 0.0034) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.41% (0.7710 => 0.7896, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.40% (1.3245 => 1.3563, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.38% (1.2193 => 1.2483, std. dev.: 0.0011) MultiSource/Applications/siod/siod: 2.19% (2.1791 => 2.2268, std. dev.: 0.0048) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.17% (1.1364 => 1.1611, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.16% (0.5637 => 0.5759, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 2.16% (3.8646 => 3.9481, std. dev.: 0.0033) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.11% (1.4563 => 1.4871, std. dev.: 0.0012) MultiSource/Applications/kimwitu++/kc: 2.01% (16.6129 => 16.9465, std. dev.: 0.0081) MultiSource/Applications/lambda-0_1_3/lambda: 1.99% (0.7038 => 0.7178, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.96% (0.7460 => 0.7606, std. dev.: 0.0047) MultiSource/Applications/Burg/burg: 1.93% (1.1061 => 1.1274, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.90% (13.2842 => 13.5362, std. dev.: 0.0096) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.85% (0.5577 => 0.5680, std. dev.: 0.0013) MultiSource/Applications/treecc/treecc: 1.82% (1.9270 => 1.9621, std. dev.: 0.0032) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.66% (1.3819 => 1.4048, std. dev.: 0.0018) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.63% (1.3813 => 1.4038, std. dev.: 0.0023) MultiSource/Applications/JM/lencod/lencod: 1.19% (14.8535 => 15.0309, std. dev.: 0.0047) MultiSource/Applications/SIBsim4/SIBsim4: 1.14% (1.2749 => 1.2894, std. dev.: 0.0031) MultiSource/Applications/hbd/hbd: 1.08% (1.3693 => 1.3841, std. dev.: 0.0017) MultiSource/Applications/sqlite3/sqlite3: 1.07% (16.2614 => 16.4357, std. dev.: 0.0076) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.03% (3.6692 => 3.7070, std. dev.: 0.0031) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 24.34% (1.8175 => 2.2599, std. dev.: 0.0519) SingleSource/Benchmarks/Misc/mandel-2: 6.92% (1.2998 => 1.3898, std. dev.: 0.0084) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7298, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.86% (1.5824 => 1.6751, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8143, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9878, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.63% (1.7688 => 1.8330, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: 3.58% (7.4271 => 7.6928, std. dev.: 0.0091) MultiSource/Applications/hexxagon/hexxagon: 3.01% (12.0921 => 12.4559, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/flops-6: 2.90% (1.9199 => 1.9756, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 2.79% (11.2619 => 11.5761, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9392, std. dev.: 0.0019) MultiSource/Applications/sqlite3/sqlite3: 2.34% (4.5928 => 4.7004, std. dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.31% (7.9275 => 8.1109, std. dev.: 0.0085) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 1.65% (3.2729 => 3.3269, std. dev.: 0.0019) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.58% (0.8273 => 0.8404, std. dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5089, std. dev.: 0.0039) MultiSource/Applications/lemon/lemon: 1.40% (1.4298 => 1.4498, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.28% (2.0200 => 2.0459, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.21% (1.9433 => 1.9668, std. dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 1.19% (5.0168 => 5.0763, std. dev.: 0.0109) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1778, std. dev.: 0.0009) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -17.01% (0.4657 => 0.3865, std. dev.: 0.0242) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.26% (22.5627 => 20.9247, std. dev.: 0.0188) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.48% (0.2670 => 0.2497, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.10% (0.3511 => 0.3297, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.38% (0.6576 => 0.6354, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.18% (0.3650 => 0.3534, std. dev.: 0.0040) SingleSource/UnitTests/ObjC/synchronized: -3.14% (0.3663 => 0.3548, std. dev.: 0.0042) SingleSource/UnitTests/ObjC/exceptions-2: -3.11% (0.3601 => 0.3489, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-3: -3.09% (0.3623 => 0.3511, std. dev.: 0.0029) SingleSource/UnitTests/ObjC/exceptions-4: -3.04% (0.3646 => 0.3535, std. dev.: 0.0028) SingleSource/UnitTests/ObjC/trivial-interface: -3.02% (0.3578 => 0.3470, std. dev.: 0.0035) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.89% (0.8818 => 0.8563, std. dev.: 0.0022) SingleSource/UnitTests/ObjC/for-in: -2.67% (0.3789 => 0.3688, std. dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/bigfib: -2.64% (0.6250 => 0.6085, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.73% (0.9108 => 0.8950, std. dev.: 0.0005) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.14% (1.0460 => 0.9504, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.47% (0.3139 => 0.2936, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.74% (1.3780 => 1.3127, std. dev.: 0.0069) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9625, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -4.01% (2.5089 => 2.4084, std. dev.: 0.0014) MultiSource/Benchmarks/Olden/bh/bh: -3.66% (1.9762 => 1.9039, std. dev.: 0.0043) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.64% (0.3458 => 0.3332, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -2.16% (6.3560 => 6.2185, std. dev.: 0.0077) SingleSource/Benchmarks/Misc/richards_benchmark: -2.15% (1.1560 => 1.1311, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: -2.04% (9.3358 => 9.1451, std. dev.: 0.0194) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.00% (20.3410 => 19.9343, std. dev.: 0.0361) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.89% (6.6320 => 6.5065, std. dev.: 0.0038) MultiSource/Benchmarks/mafft/pairlocalalign: -1.84% (28.2225 => 27.7025, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3444, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9957, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.41% (3.9173 => 3.8620, std. dev.: 0.0039) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.38% (8.8259 => 8.7037, std. dev.: 0.0087) MultiSource/Applications/lua/lua: -1.38% (26.5159 => 26.1504, std. dev.: 0.0156) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.05% (3.8887 => 3.8477, std. dev.: 0.0105) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.37s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun May 27 14:23:13 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 27 May 2012 16:23:13 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120527212313.123BE2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/816?compare_to=815&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 816, Order: 157545, Start Time: 2012-05-27 20:27:44, End Time: 2012-05-27 21:24:14 To: 815, Order: 157540, Start Time: 2012-05-27 19:04:59, End Time: 2012-05-27 20:01:51 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (54 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (794 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.41% (2.0176 => 2.2680, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.04% (0.3130 => 0.3319, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.79% (0.2721 => 0.2824, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.98% (3.9660 => 4.0841, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.62% (0.6959 => 0.7141, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.47% (0.5265 => 0.5395, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.39% (0.9199 => 0.9419, std. dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 2.28% (13.8202 => 14.1351, std. dev.: 0.0080) MultiSource/Benchmarks/nbench/nbench: 2.27% (1.0594 => 1.0835, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/football/football: 2.27% (0.8310 => 0.8499, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.04% (0.5637 => 0.5752, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.03% (1.2193 => 1.2440, std. dev.: 0.0024) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.96% (0.7710 => 0.7861, std. dev.: 0.0017) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.95% (1.1364 => 1.1586, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.86% (1.3245 => 1.3491, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.77% (13.2842 => 13.5199, std. dev.: 0.0183) MultiSource/Applications/siod/siod: 1.70% (2.1791 => 2.2162, std. dev.: 0.0038) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.63% (1.4563 => 1.4800, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.58% (1.3819 => 1.4037, std. dev.: 0.0018) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.53% (1.3813 => 1.4025, std. dev.: 0.0013) MultiSource/Applications/treecc/treecc: 1.52% (1.9270 => 1.9563, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/gs/gs: 1.51% (3.8646 => 3.9229, std. dev.: 0.0115) MultiSource/Applications/lambda-0_1_3/lambda: 1.46% (0.7038 => 0.7141, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.39% (0.7460 => 0.7564, std. dev.: 0.0015) MultiSource/Applications/Burg/burg: 1.36% (1.1061 => 1.1211, std. dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: 1.26% (16.6129 => 16.8218, std. dev.: 0.0065) MultiSource/Applications/SIBsim4/SIBsim4: 1.18% (1.2749 => 1.2900, std. dev.: 0.0052) MultiSource/Applications/JM/lencod/lencod: 1.02% (14.8535 => 15.0054, std. dev.: 0.0125) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 24.10% (1.8175 => 2.2555, std. dev.: 0.0149) SingleSource/Benchmarks/Misc/mandel-2: 7.62% (1.2998 => 1.3989, std. dev.: 0.0089) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6754, std. dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9877, std. dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.67% (1.7688 => 1.8337, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: 3.62% (7.4271 => 7.6962, std. dev.: 0.0033) MultiSource/Applications/hexxagon/hexxagon: 2.98% (12.0921 => 12.4530, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: 2.89% (1.9199 => 1.9753, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 2.79% (11.2619 => 11.5758, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.74% (2.8606 => 2.9391, std. dev.: 0.0021) MultiSource/Applications/sqlite3/sqlite3: 2.38% (4.5928 => 4.7019, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.15% (7.9275 => 8.0982, std. dev.: 0.0241) MultiSource/Applications/siod/siod: 1.73% (3.2729 => 3.3294, std. dev.: 0.0007) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9601, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 1.61% (0.8273 => 0.8406, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.45% (1.4298 => 1.4505, std. dev.: 0.0026) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5091, std. dev.: 0.0072) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.26% (2.0200 => 2.0454, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.24% (1.9433 => 1.9673, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/flops: 1.10% (9.0760 => 9.1755, std. dev.: 0.0015) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -15.33% (0.4657 => 0.3943, std. dev.: 0.0103) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.35% (22.5627 => 20.9034, std. dev.: 0.0073) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.89% (0.2670 => 0.2486, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.64% (0.3511 => 0.3278, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -3.53% (0.3623 => 0.3495, std. dev.: 0.0033) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.48% (0.3650 => 0.3523, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.44% (0.6576 => 0.6350, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -3.39% (0.3601 => 0.3479, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -3.33% (0.3663 => 0.3541, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: -3.33% (0.3578 => 0.3459, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -3.32% (0.3646 => 0.3525, std. dev.: 0.0032) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.01% (0.8818 => 0.8553, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/property: -2.97% (0.3940 => 0.3823, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -2.93% (0.3789 => 0.3678, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -2.91% (0.3914 => 0.3800, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: -2.85% (0.6250 => 0.6072, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: -2.85% (0.4003 => 0.3889, std. dev.: 0.0002) MultiSource/Applications/lua/lua: -1.26% (3.7467 => 3.6996, std. dev.: 0.0083) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.13% (1.0460 => 0.9505, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-3: -6.21% (2.4152 => 2.2651, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.96% (1.3780 => 1.3096, std. dev.: 0.0055) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9624, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -4.08% (2.5089 => 2.4065, std. dev.: 0.0013) MultiSource/Benchmarks/Olden/bh/bh: -3.66% (1.9762 => 1.9038, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.61% (0.3458 => 0.3333, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -2.38% (6.3560 => 6.2050, std. dev.: 0.0150) SingleSource/Benchmarks/Misc/richards_benchmark: -2.17% (1.1560 => 1.1309, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: -1.92% (9.3358 => 9.1561, std. dev.: 0.0450) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.90% (20.3410 => 19.9546, std. dev.: 0.0251) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.87% (6.6320 => 6.5080, std. dev.: 0.0028) MultiSource/Benchmarks/mafft/pairlocalalign: -1.85% (28.2225 => 27.7003, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3446, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9956, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.56% (0.9692 => 0.9541, std. dev.: 0.0000) MultiSource/Applications/lua/lua: -1.45% (26.5159 => 26.1313, std. dev.: 0.0091) SingleSource/Benchmarks/Shootout/heapsort: -1.44% (3.9173 => 3.8607, std. dev.: 0.0083) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.40% (8.8259 => 8.7025, std. dev.: 0.0206) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.41s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun May 27 15:45:44 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 27 May 2012 17:45:44 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120527224544.5C7E52A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/817?compare_to=816&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 817, Order: 157546, Start Time: 2012-05-27 21:50:12, End Time: 2012-05-27 22:46:45 To: 816, Order: 157545, Start Time: 2012-05-27 20:27:44, End Time: 2012-05-27 21:24:14 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (52 on baseline) Performance Improvements: 0 (41 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (795 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.36% (2.0176 => 2.2670, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.07% (0.3130 => 0.3320, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.68% (0.2721 => 0.2821, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.91% (3.9660 => 4.0816, std. dev.: 0.0153) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.49% (0.6959 => 0.7132, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.44% (0.9199 => 0.9423, std. dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.43% (0.5265 => 0.5393, std. dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 2.33% (1.0594 => 1.0841, std. dev.: 0.0033) MultiSource/Applications/SPASS/SPASS: 2.30% (13.8202 => 14.1378, std. dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C/football/football: 2.20% (0.8310 => 0.8493, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.12% (1.2193 => 1.2452, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.99% (0.5637 => 0.5749, std. dev.: 0.0023) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.92% (1.1364 => 1.1582, std. dev.: 0.0031) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.87% (0.7710 => 0.7854, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.85% (1.3245 => 1.3490, std. dev.: 0.0027) MultiSource/Applications/treecc/treecc: 1.68% (1.9270 => 1.9593, std. dev.: 0.0089) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.67% (13.2842 => 13.5061, std. dev.: 0.0085) MultiSource/Applications/siod/siod: 1.65% (2.1791 => 2.2150, std. dev.: 0.0045) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.59% (1.4563 => 1.4795, std. dev.: 0.0045) MultiSource/Benchmarks/MallocBench/gs/gs: 1.47% (3.8646 => 3.9216, std. dev.: 0.0038) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.46% (1.3813 => 1.4015, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.45% (0.7460 => 0.7568, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.43% (1.3819 => 1.4016, std. dev.: 0.0008) MultiSource/Applications/Burg/burg: 1.37% (1.1061 => 1.1212, std. dev.: 0.0036) MultiSource/Applications/kimwitu++/kc: 1.34% (16.6129 => 16.8362, std. dev.: 0.0105) MultiSource/Applications/JM/lencod/lencod: 1.07% (14.8535 => 15.0127, std. dev.: 0.0025) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 24.70% (1.8175 => 2.2665, std. dev.: 0.0271) SingleSource/Benchmarks/Misc/mandel-2: 6.65% (1.2998 => 1.3863, std. dev.: 0.0064) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7298, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.91% (1.5824 => 1.6759, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8146, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.81% (1.9144 => 1.9874, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/salsa20: 3.62% (7.4271 => 7.6961, std. dev.: 0.0037) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.61% (1.7688 => 1.8327, std. dev.: 0.0014) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4538, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: 2.90% (1.9199 => 1.9755, std. dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 2.80% (11.2619 => 11.5770, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.74% (2.8606 => 2.9390, std. dev.: 0.0017) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.40% (7.9275 => 8.1180, std. dev.: 0.0091) MultiSource/Applications/sqlite3/sqlite3: 2.33% (4.5928 => 4.6998, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 1.65% (3.2729 => 3.3269, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/ffbench: 1.61% (0.8273 => 0.8406, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: 1.60% (1.9290 => 1.9599, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.41% (1.4298 => 1.4500, std. dev.: 0.0023) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5084, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.27% (2.0200 => 2.0456, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.25% (1.9433 => 1.9676, std. dev.: 0.0088) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1779, std. dev.: 0.0013) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.33% (22.5627 => 20.9087, std. dev.: 0.0159) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.93% (0.2670 => 0.2485, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.69% (0.3511 => 0.3276, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.39% (0.6576 => 0.6353, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-2: -3.39% (0.3601 => 0.3479, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.37% (0.3650 => 0.3527, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/trivial-interface: -3.35% (0.3578 => 0.3458, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -3.33% (0.3663 => 0.3541, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -3.31% (0.3623 => 0.3503, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: -3.26% (0.3646 => 0.3527, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -3.10% (0.3940 => 0.3818, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.95% (0.8818 => 0.8558, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/bigfib: -2.91% (0.6250 => 0.6068, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/for-in: -2.90% (0.3789 => 0.3679, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: -2.80% (0.4003 => 0.3891, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -2.73% (0.3914 => 0.3807, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.87% (0.9108 => 0.8938, std. dev.: 0.0001) MultiSource/Applications/lua/lua: -1.23% (3.7467 => 3.7006, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.06% (1.9828 => 1.9617, std. dev.: 0.0010) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.14% (1.0460 => 0.9504, std. dev.: 0.0013) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.31% (0.3139 => 0.2941, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.69% (1.3780 => 1.3134, std. dev.: 0.0060) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9621, std. dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/dry: -3.97% (2.5089 => 2.4094, std. dev.: 0.0032) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.63% (1.9762 => 1.9044, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -2.27% (6.3560 => 6.2116, std. dev.: 0.0180) SingleSource/Benchmarks/Misc/richards_benchmark: -2.15% (1.1560 => 1.1311, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: -1.98% (9.3358 => 9.1509, std. dev.: 0.0148) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.88% (6.6320 => 6.5072, std. dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: -1.84% (28.2225 => 27.7019, std. dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.68% (20.3410 => 19.9989, std. dev.: 0.0121) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9954, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) MultiSource/Applications/lua/lua: -1.53% (26.5159 => 26.1105, std. dev.: 0.0291) SingleSource/Benchmarks/Shootout/heapsort: -1.45% (3.9173 => 3.8605, std. dev.: 0.0161) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.38% (8.8259 => 8.7040, std. dev.: 0.0149) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.05% (3.8887 => 3.8479, std. dev.: 0.0134) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.37s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun May 27 17:08:11 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 27 May 2012 19:08:11 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120528000811.4E5E22A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/818?compare_to=817&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 818, Order: 157548, Start Time: 2012-05-27 23:12:40, End Time: 2012-05-28 00:09:12 To: 817, Order: 157546, Start Time: 2012-05-27 21:50:12, End Time: 2012-05-27 22:46:45 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (52 on baseline) Performance Improvements: 0 (41 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (795 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.23% (2.0176 => 2.2644, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.20% (0.3130 => 0.3324, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.95% (3.9660 => 4.0829, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.62% (0.5265 => 0.5403, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.56% (0.6959 => 0.7137, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.54% (0.9199 => 0.9433, std. dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 2.28% (13.8202 => 14.1348, std. dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/football/football: 2.23% (0.8310 => 0.8495, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 2.21% (1.0594 => 1.0828, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.11% (0.5637 => 0.5756, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.11% (1.2193 => 1.2450, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.96% (0.7710 => 0.7861, std. dev.: 0.0024) MultiSource/Applications/siod/siod: 1.95% (2.1791 => 2.2217, std. dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.90% (1.3245 => 1.3497, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.88% (1.1364 => 1.1578, std. dev.: 0.0065) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.78% (13.2842 => 13.5200, std. dev.: 0.0111) MultiSource/Applications/treecc/treecc: 1.76% (1.9270 => 1.9609, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.58% (1.3819 => 1.4038, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/gs/gs: 1.53% (3.8646 => 3.9237, std. dev.: 0.0093) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.40% (1.3813 => 1.4007, std. dev.: 0.0019) MultiSource/Applications/Burg/burg: 1.38% (1.1061 => 1.1214, std. dev.: 0.0008) MultiSource/Applications/kimwitu++/kc: 1.27% (16.6129 => 16.8246, std. dev.: 0.0108) MultiSource/Applications/JM/lencod/lencod: 1.09% (14.8535 => 15.0157, std. dev.: 0.0051) MultiSource/Applications/hbd/hbd: 1.00% (1.3693 => 1.3830, std. dev.: 0.0037) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: 23.94% (1.8175 => 2.2526, std. dev.: 0.0421) SingleSource/Benchmarks/Misc/mandel-2: 6.85% (1.2998 => 1.3889, std. dev.: 0.0147) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.86% (1.5824 => 1.6752, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8146, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 3.81% (1.9144 => 1.9873, std. dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.68% (1.7688 => 1.8339, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: 3.65% (7.4271 => 7.6979, std. dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4537, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-6: 2.86% (1.9199 => 1.9749, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 2.80% (11.2619 => 11.5773, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9393, std. dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 2.34% (4.5928 => 4.7001, std. dev.: 0.0040) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.18% (7.9275 => 8.1002, std. dev.: 0.0219) MultiSource/Applications/siod/siod: 1.68% (3.2729 => 3.3278, std. dev.: 0.0008) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 1.60% (0.8273 => 0.8405, std. dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5080, std. dev.: 0.0009) MultiSource/Applications/lemon/lemon: 1.38% (1.4298 => 1.4496, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.31% (2.0200 => 2.0464, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0035) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.16% (1.9433 => 1.9658, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: 1.11% (9.0760 => 9.1767, std. dev.: 0.0016) MultiSource/Benchmarks/sim/sim: 1.11% (5.0168 => 5.0724, std. dev.: 0.0037) SingleSource/Benchmarks/McGill/chomp: 1.02% (1.2308 => 1.2433, std. dev.: 0.0018) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -18.60% (0.4657 => 0.3791, std. dev.: 0.0092) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.52% (22.5627 => 20.8651, std. dev.: 0.0134) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.00% (0.2670 => 0.2483, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.75% (0.3511 => 0.3274, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.41% (0.6576 => 0.6352, std. dev.: 0.0024) SingleSource/UnitTests/ObjC/exceptions-3: -3.26% (0.3623 => 0.3505, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.21% (0.3650 => 0.3533, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -3.08% (0.3601 => 0.3490, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -3.07% (0.3578 => 0.3468, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.07% (0.8818 => 0.8547, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions-4: -3.04% (0.3646 => 0.3535, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -3.00% (0.3663 => 0.3553, std. dev.: 0.0035) SingleSource/UnitTests/ObjC/property: -2.84% (0.3940 => 0.3828, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: -2.82% (0.6250 => 0.6074, std. dev.: 0.0049) SingleSource/UnitTests/ObjC/exceptions: -2.66% (0.3914 => 0.3810, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -2.60% (0.4003 => 0.3899, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: -2.08% (0.9108 => 0.8919, std. dev.: 0.0005) MultiSource/Applications/lua/lua: -1.23% (3.7467 => 3.7005, std. dev.: 0.0019) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.14% (1.0460 => 0.9504, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.82% (1.3780 => 1.3116, std. dev.: 0.0047) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9624, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -4.03% (2.5089 => 2.4078, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.64% (1.9762 => 1.9043, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: -2.16% (1.1560 => 1.1310, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -2.00% (6.6320 => 6.4995, std. dev.: 0.0075) SingleSource/Benchmarks/Shootout/lists: -1.94% (6.3560 => 6.2330, std. dev.: 0.0072) MultiSource/Benchmarks/mafft/pairlocalalign: -1.84% (28.2225 => 27.7030, std. dev.: 0.0015) MultiSource/Applications/minisat/minisat: -1.75% (9.3358 => 9.1726, std. dev.: 0.0332) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3446, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9954, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.56% (0.9692 => 0.9541, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.50% (3.9173 => 3.8586, std. dev.: 0.0066) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.43% (8.8259 => 8.6998, std. dev.: 0.0205) MultiSource/Applications/lua/lua: -1.39% (26.5159 => 26.1486, std. dev.: 0.0208) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.30% (20.3410 => 20.0757, std. dev.: 0.0246) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.10% (3.8887 => 3.8460, std. dev.: 0.0104) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.49s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun May 27 18:30:56 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 27 May 2012 20:30:56 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120528013056.31F342A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/819?compare_to=818&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 819, Order: 157551, Start Time: 2012-05-28 00:35:08, End Time: 2012-05-28 01:31:57 To: 818, Order: 157548, Start Time: 2012-05-27 23:12:40, End Time: 2012-05-28 00:09:12 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (56 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 890 (792 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 6.44% (0.3791 => 0.4035, std. dev.: 0.0036) MultiSource/Benchmarks/Bullet/bullet: 1.20% (33.1732 => 33.5714, std. dev.: 0.0080) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.50% (2.0176 => 2.2698, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.29% (0.3130 => 0.3327, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.45% (0.2721 => 0.2842, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.14% (3.9660 => 4.0905, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.77% (0.6959 => 0.7152, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.75% (0.5265 => 0.5410, std. dev.: 0.0017) MultiSource/Benchmarks/nbench/nbench: 2.70% (1.0594 => 1.0880, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.62% (0.9199 => 0.9440, std. dev.: 0.0062) MultiSource/Applications/SPASS/SPASS: 2.59% (13.8202 => 14.1776, std. dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C/football/football: 2.53% (0.8310 => 0.8520, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.39% (1.2193 => 1.2484, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.38% (1.1364 => 1.1635, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.13% (1.3245 => 1.3527, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.13% (0.5637 => 0.5757, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.02% (13.2842 => 13.5531, std. dev.: 0.0066) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.02% (1.4563 => 1.4857, std. dev.: 0.0016) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.84% (0.7710 => 0.7852, std. dev.: 0.0025) MultiSource/Applications/treecc/treecc: 1.72% (1.9270 => 1.9602, std. dev.: 0.0035) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.70% (1.3819 => 1.4054, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.69% (0.7460 => 0.7586, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 1.68% (3.8646 => 3.9297, std. dev.: 0.0023) MultiSource/Applications/lambda-0_1_3/lambda: 1.68% (0.7038 => 0.7156, std. dev.: 0.0013) MultiSource/Applications/siod/siod: 1.65% (2.1791 => 2.2151, std. dev.: 0.0043) MultiSource/Applications/Burg/burg: 1.57% (1.1061 => 1.1235, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.55% (1.3813 => 1.4027, std. dev.: 0.0027) MultiSource/Applications/kimwitu++/kc: 1.52% (16.6129 => 16.8646, std. dev.: 0.0114) MultiSource/Applications/sqlite3/sqlite3: 1.49% (16.2614 => 16.5035, std. dev.: 0.0050) MultiSource/Applications/hbd/hbd: 1.48% (1.3693 => 1.3895, std. dev.: 0.0060) MultiSource/Applications/JM/lencod/lencod: 1.39% (14.8535 => 15.0603, std. dev.: 0.0067) MultiSource/Applications/SIBsim4/SIBsim4: 1.37% (1.2749 => 1.2924, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.14% (3.6692 => 3.7110, std. dev.: 0.0021) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/fbench: 24.26% (1.8175 => 2.2585, std. dev.: 0.0466) SingleSource/Benchmarks/Misc/mandel-2: 7.64% (1.2998 => 1.3991, std. dev.: 0.0082) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7298, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6754, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8146, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9876, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.75% (1.7688 => 1.8352, std. dev.: 0.0053) SingleSource/Benchmarks/Misc/salsa20: 3.56% (7.4271 => 7.6915, std. dev.: 0.0071) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4537, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/flops-6: 2.89% (1.9199 => 1.9753, std. dev.: 0.0016) MultiSource/Benchmarks/nbench/nbench: 2.79% (11.2619 => 11.5765, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9392, std. dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 2.40% (4.5928 => 4.7029, std. dev.: 0.0051) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.09% (7.9275 => 8.0933, std. dev.: 0.0254) MultiSource/Applications/siod/siod: 1.73% (3.2729 => 3.3294, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/ffbench: 1.60% (0.8273 => 0.8405, std. dev.: 0.0006) SingleSource/Benchmarks/Dhrystone/fldry: 1.46% (1.9290 => 1.9571, std. dev.: 0.0015) MultiSource/Applications/lemon/lemon: 1.41% (1.4298 => 1.4500, std. dev.: 0.0006) MultiSource/Benchmarks/NPB-serial/is/is: 1.39% (8.3908 => 8.5076, std. dev.: 0.0032) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.28% (2.0200 => 2.0458, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1774, std. dev.: 0.0010) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -13.36% (0.4657 => 0.4035, std. dev.: 0.0036) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.99% (22.5627 => 20.9850, std. dev.: 0.0113) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.55% (0.2670 => 0.2495, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.24% (0.3511 => 0.3292, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -4.03% (0.3623 => 0.3477, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.97% (0.3650 => 0.3505, std. dev.: 0.0018) SingleSource/UnitTests/ObjC/trivial-interface: -3.86% (0.3578 => 0.3440, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -3.78% (0.3601 => 0.3465, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-4: -3.73% (0.3646 => 0.3510, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -3.71% (0.3663 => 0.3527, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -3.55% (0.3940 => 0.3800, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions: -3.40% (0.3914 => 0.3781, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: -3.38% (0.3789 => 0.3661, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -3.37% (0.4003 => 0.3868, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.09% (0.6576 => 0.6373, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/bigfib: -2.54% (0.6250 => 0.6091, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.43% (0.8818 => 0.8604, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.57% (0.9108 => 0.8965, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.14% (1.0460 => 0.9504, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.23% (1.3780 => 1.3059, std. dev.: 0.0038) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9622, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -4.02% (2.5089 => 2.4081, std. dev.: 0.0018) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.68% (1.9762 => 1.9034, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/richards_benchmark: -2.12% (1.1560 => 1.1315, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -2.04% (6.3560 => 6.2263, std. dev.: 0.0071) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.91% (6.6320 => 6.5056, std. dev.: 0.0024) MultiSource/Benchmarks/mafft/pairlocalalign: -1.85% (28.2225 => 27.7004, std. dev.: 0.0026) MultiSource/Applications/minisat/minisat: -1.82% (9.3358 => 9.1658, std. dev.: 0.0061) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.63% (20.3410 => 20.0094, std. dev.: 0.0308) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9959, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.36% (8.8259 => 8.7056, std. dev.: 0.0070) SingleSource/Benchmarks/Shootout/heapsort: -1.36% (3.9173 => 3.8640, std. dev.: 0.0125) MultiSource/Applications/lua/lua: -1.35% (26.5159 => 26.1585, std. dev.: 0.0198) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.81s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun May 27 19:53:21 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 27 May 2012 21:53:21 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120528025321.BB4982A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/820?compare_to=819&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 820, Order: 157552, Start Time: 2012-05-28 01:57:51, End Time: 2012-05-28 02:54:23 To: 819, Order: 157551, Start Time: 2012-05-28 00:35:08, End Time: 2012-05-28 01:31:57 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (58 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (790 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.49% (2.0176 => 2.2696, std. dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.26% (0.3130 => 0.3326, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.26% (0.2721 => 0.2837, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.22% (3.9660 => 4.0939, std. dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.87% (0.6959 => 0.7159, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.74% (0.9199 => 0.9451, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 2.68% (1.0594 => 1.0878, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.66% (0.5265 => 0.5405, std. dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: 2.60% (13.8202 => 14.1796, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 2.58% (0.8310 => 0.8524, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.44% (1.2193 => 1.2491, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.37% (1.1364 => 1.1633, std. dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.20% (1.3245 => 1.3537, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.08% (0.5637 => 0.5754, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.06% (13.2842 => 13.5576, std. dev.: 0.0090) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.94% (1.4563 => 1.4846, std. dev.: 0.0099) MultiSource/Applications/siod/siod: 1.78% (2.1791 => 2.2179, std. dev.: 0.0113) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.73% (0.7710 => 0.7843, std. dev.: 0.0025) MultiSource/Benchmarks/MallocBench/gs/gs: 1.72% (3.8646 => 3.9309, std. dev.: 0.0063) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.66% (0.7460 => 0.7584, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 1.61% (1.9270 => 1.9580, std. dev.: 0.0013) MultiSource/Applications/lambda-0_1_3/lambda: 1.58% (0.7038 => 0.7149, std. dev.: 0.0018) MultiSource/Applications/kimwitu++/kc: 1.58% (16.6129 => 16.8746, std. dev.: 0.0174) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.56% (1.3819 => 1.4035, std. dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: 1.54% (16.2614 => 16.5119, std. dev.: 0.0208) MultiSource/Applications/Burg/burg: 1.54% (1.1061 => 1.1231, std. dev.: 0.0035) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.51% (1.3813 => 1.4022, std. dev.: 0.0010) MultiSource/Applications/hbd/hbd: 1.48% (1.3693 => 1.3896, std. dev.: 0.0006) MultiSource/Applications/JM/lencod/lencod: 1.43% (14.8535 => 15.0655, std. dev.: 0.0057) MultiSource/Applications/SIBsim4/SIBsim4: 1.35% (1.2749 => 1.2921, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.16% (3.6692 => 3.7119, std. dev.: 0.0134) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 23.68% (1.8175 => 2.2479, std. dev.: 0.0565) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6754, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel-2: 5.41% (1.2998 => 1.3701, std. dev.: 0.0206) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-5: 3.88% (1.9144 => 1.9887, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.69% (1.7688 => 1.8341, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: 3.61% (7.4271 => 7.6953, std. dev.: 0.0083) MultiSource/Applications/hexxagon/hexxagon: 3.01% (12.0921 => 12.4565, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: 2.88% (1.9199 => 1.9752, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 2.79% (11.2619 => 11.5761, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.76% (2.8606 => 2.9395, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.37% (7.9275 => 8.1157, std. dev.: 0.0086) MultiSource/Applications/sqlite3/sqlite3: 2.33% (4.5928 => 4.6996, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 1.72% (3.2729 => 3.3292, std. dev.: 0.0009) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/ffbench: 1.60% (0.8273 => 0.8405, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5091, std. dev.: 0.0007) MultiSource/Applications/lemon/lemon: 1.39% (1.4298 => 1.4497, std. dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.30% (2.0200 => 2.0462, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/flops: 1.14% (9.0760 => 9.1792, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.11% (1.9433 => 1.9649, std. dev.: 0.0011) SingleSource/Benchmarks/McGill/chomp: 1.02% (1.2308 => 1.2434, std. dev.: 0.0029) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -18.10% (0.4657 => 0.3814, std. dev.: 0.0088) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.11% (22.5627 => 20.9594, std. dev.: 0.0073) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.59% (0.2670 => 0.2494, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.21% (0.3511 => 0.3293, std. dev.: 0.0026) SingleSource/UnitTests/ObjC/exceptions-2: -3.94% (0.3601 => 0.3459, std. dev.: 0.0026) SingleSource/UnitTests/ObjC/exceptions-3: -3.89% (0.3623 => 0.3482, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -3.88% (0.3663 => 0.3521, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.86% (0.3650 => 0.3509, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: -3.80% (0.3578 => 0.3442, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -3.78% (0.3646 => 0.3508, std. dev.: 0.0053) SingleSource/UnitTests/ObjC/for-in: -3.35% (0.3789 => 0.3662, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -3.35% (0.3940 => 0.3808, std. dev.: 0.0023) SingleSource/UnitTests/ObjC/exceptions: -3.22% (0.3914 => 0.3788, std. dev.: 0.0016) SingleSource/UnitTests/ObjC/parameter-passing: -3.20% (0.4003 => 0.3875, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.13% (0.6576 => 0.6370, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: -2.59% (0.6250 => 0.6088, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.45% (0.8818 => 0.8602, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.64% (0.9108 => 0.8959, std. dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.14% (1.0460 => 0.9504, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.31% (0.3139 => 0.2941, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2641, std. dev.: 0.0004) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9624, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.45% (1.3780 => 1.3167, std. dev.: 0.0070) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -3.99% (2.5089 => 2.4089, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.63% (1.9762 => 1.9044, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/richards_benchmark: -2.15% (1.1560 => 1.1311, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -2.11% (6.3560 => 6.2220, std. dev.: 0.0059) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.93% (20.3410 => 19.9479, std. dev.: 0.0490) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.87% (6.6320 => 6.5077, std. dev.: 0.0018) MultiSource/Benchmarks/mafft/pairlocalalign: -1.84% (28.2225 => 27.7025, std. dev.: 0.0011) MultiSource/Applications/minisat/minisat: -1.80% (9.3358 => 9.1680, std. dev.: 0.0309) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.62% (8.8259 => 8.6830, std. dev.: 0.0274) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9955, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.56% (0.9692 => 0.9541, std. dev.: 0.0000) MultiSource/Applications/lua/lua: -1.52% (26.5159 => 26.1116, std. dev.: 0.0108) SingleSource/Benchmarks/Shootout/heapsort: -1.35% (3.9173 => 3.8646, std. dev.: 0.0023) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.57s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun May 27 21:15:55 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 27 May 2012 23:15:55 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120528041555.705452A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/821?compare_to=820&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 821, Order: 157557, Start Time: 2012-05-28 03:20:17, End Time: 2012-05-28 04:16:56 To: 820, Order: 157552, Start Time: 2012-05-28 01:57:51, End Time: 2012-05-28 02:54:23 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (57 on baseline) Performance Improvements: 0 (41 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 891 (790 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 2.34% (1.3701 => 1.4021, std. dev.: 0.0015) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.18% (2.0176 => 2.2633, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.42% (0.3130 => 0.3331, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.15% (0.2721 => 0.2834, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.05% (3.9660 => 4.0868, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.64% (0.6959 => 0.7143, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.62% (0.5265 => 0.5403, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.61% (0.9199 => 0.9439, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/football/football: 2.56% (0.8310 => 0.8523, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 2.56% (1.0594 => 1.0865, std. dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 2.29% (13.8202 => 14.1360, std. dev.: 0.0131) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.18% (1.2193 => 1.2459, std. dev.: 0.0033) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.14% (1.1364 => 1.1607, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.04% (0.5637 => 0.5752, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.02% (1.3245 => 1.3513, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.98% (1.4563 => 1.4852, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.90% (13.2842 => 13.5363, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.85% (0.5577 => 0.5680, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 1.80% (2.1791 => 2.2183, std. dev.: 0.0019) MultiSource/Applications/treecc/treecc: 1.64% (1.9270 => 1.9586, std. dev.: 0.0047) MultiSource/Benchmarks/MallocBench/gs/gs: 1.61% (3.8646 => 3.9267, std. dev.: 0.0026) MultiSource/Applications/lambda-0_1_3/lambda: 1.58% (0.7038 => 0.7149, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.56% (1.3813 => 1.4028, std. dev.: 0.0014) MultiSource/Applications/Burg/burg: 1.53% (1.1061 => 1.1230, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.48% (1.3819 => 1.4023, std. dev.: 0.0038) MultiSource/Applications/kimwitu++/kc: 1.46% (16.6129 => 16.8550, std. dev.: 0.0132) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.43% (0.7460 => 0.7567, std. dev.: 0.0014) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.36% (0.7710 => 0.7815, std. dev.: 0.0015) MultiSource/Applications/sqlite3/sqlite3: 1.23% (16.2614 => 16.4613, std. dev.: 0.0200) MultiSource/Applications/JM/lencod/lencod: 1.17% (14.8535 => 15.0268, std. dev.: 0.0144) MultiSource/Applications/SIBsim4/SIBsim4: 1.13% (1.2749 => 1.2893, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.03% (3.6692 => 3.7070, std. dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: 24.25% (1.8175 => 2.2583, std. dev.: 0.0112) SingleSource/Benchmarks/Misc/mandel-2: 7.87% (1.2998 => 1.4021, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.86% (1.5824 => 1.6751, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9877, std. dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.69% (1.7688 => 1.8341, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: 3.61% (7.4271 => 7.6949, std. dev.: 0.0045) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4533, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-6: 2.91% (1.9199 => 1.9758, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 2.82% (11.2619 => 11.5790, std. dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.76% (2.8606 => 2.9395, std. dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.46% (7.9275 => 8.1227, std. dev.: 0.0118) MultiSource/Applications/sqlite3/sqlite3: 2.34% (4.5928 => 4.7001, std. dev.: 0.0085) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 1.72% (3.2729 => 3.3292, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/ffbench: 1.56% (0.8273 => 0.8402, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5103, std. dev.: 0.0007) MultiSource/Applications/lemon/lemon: 1.38% (1.4298 => 1.4495, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.26% (2.0200 => 2.0454, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.23% (1.9433 => 1.9672, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1773, std. dev.: 0.0007) MultiSource/Benchmarks/sim/sim: 1.03% (5.0168 => 5.0686, std. dev.: 0.0035) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.10% (22.5627 => 20.9618, std. dev.: 0.0098) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.67% (0.2670 => 0.2492, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.15% (0.3511 => 0.3295, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: -4.69% (0.3623 => 0.3453, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.60% (0.3650 => 0.3482, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-2: -4.58% (0.3601 => 0.3436, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -4.53% (0.3578 => 0.3416, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -4.50% (0.3663 => 0.3498, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -4.47% (0.3646 => 0.3483, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -4.21% (0.3940 => 0.3774, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -4.04% (0.3789 => 0.3636, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -3.96% (0.3914 => 0.3759, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -3.85% (0.4003 => 0.3849, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.95% (0.6576 => 0.6382, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/bigfib: -2.77% (0.6250 => 0.6077, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.76% (0.8818 => 0.8575, std. dev.: 0.0018) SingleSource/UnitTests/ObjC++/Hello: -1.93% (0.5748 => 0.5637, std. dev.: 0.0032) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.76% (0.9108 => 0.8948, std. dev.: 0.0046) MultiSource/Applications/lua/lua: -1.01% (3.7467 => 3.7088, std. dev.: 0.0036) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.13% (1.0460 => 0.9505, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.50% (0.3139 => 0.2935, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.16% (1.3780 => 1.3069, std. dev.: 0.0046) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9624, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/dry: -4.08% (2.5089 => 2.4066, std. dev.: 0.0015) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.67% (0.3458 => 0.3331, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.66% (1.9762 => 1.9039, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout/lists: -2.19% (6.3560 => 6.2165, std. dev.: 0.0078) SingleSource/Benchmarks/Misc/richards_benchmark: -2.11% (1.1560 => 1.1316, std. dev.: 0.0000) MultiSource/Applications/minisat/minisat: -2.05% (9.3358 => 9.1448, std. dev.: 0.0058) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.93% (6.6320 => 6.5042, std. dev.: 0.0064) MultiSource/Benchmarks/mafft/pairlocalalign: -1.85% (28.2225 => 27.7004, std. dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.75% (20.3410 => 19.9846, std. dev.: 0.0647) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.64% (3.9173 => 3.8529, std. dev.: 0.0218) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9955, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0001) MultiSource/Applications/lua/lua: -1.55% (26.5159 => 26.1049, std. dev.: 0.0330) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.28% (8.8259 => 8.7125, std. dev.: 0.0097) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.61s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun May 27 22:38:25 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 28 May 2012 00:38:25 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120528053825.C93152A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/822?compare_to=821&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 822, Order: 157561, Start Time: 2012-05-28 04:42:55, End Time: 2012-05-28 05:39:27 To: 821, Order: 157557, Start Time: 2012-05-28 03:20:17, End Time: 2012-05-28 04:16:56 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (57 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (791 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.13% (2.0176 => 2.2624, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.61% (0.3130 => 0.3337, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.12% (0.2721 => 0.2833, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.03% (3.9660 => 4.0861, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.70% (0.5265 => 0.5407, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.58% (0.9199 => 0.9436, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.56% (0.6959 => 0.7137, std. dev.: 0.0033) MultiSource/Benchmarks/nbench/nbench: 2.52% (1.0594 => 1.0861, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/football/football: 2.48% (0.8310 => 0.8516, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 2.24% (13.8202 => 14.1302, std. dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.17% (1.2193 => 1.2457, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.14% (1.1364 => 1.1607, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.08% (1.3245 => 1.3521, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.00% (0.5637 => 0.5750, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.97% (1.4563 => 1.4850, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.93% (13.2842 => 13.5400, std. dev.: 0.0123) MultiSource/Applications/siod/siod: 1.82% (2.1791 => 2.2188, std. dev.: 0.0017) MultiSource/Applications/lambda-0_1_3/lambda: 1.63% (0.7038 => 0.7153, std. dev.: 0.0007) MultiSource/Applications/treecc/treecc: 1.61% (1.9270 => 1.9580, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.57% (1.3819 => 1.4036, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: 1.55% (3.8646 => 3.9244, std. dev.: 0.0140) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.50% (0.7460 => 0.7572, std. dev.: 0.0009) MultiSource/Applications/kimwitu++/kc: 1.48% (16.6129 => 16.8592, std. dev.: 0.0225) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.48% (0.7710 => 0.7824, std. dev.: 0.0027) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.46% (1.3813 => 1.4015, std. dev.: 0.0024) MultiSource/Applications/hbd/hbd: 1.31% (1.3693 => 1.3872, std. dev.: 0.0026) MultiSource/Applications/sqlite3/sqlite3: 1.23% (16.2614 => 16.4607, std. dev.: 0.0137) MultiSource/Applications/JM/lencod/lencod: 1.18% (14.8535 => 15.0283, std. dev.: 0.0057) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.02% (3.6692 => 3.7068, std. dev.: 0.0014) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/fbench: 23.85% (1.8175 => 2.2510, std. dev.: 0.0363) SingleSource/Benchmarks/Misc/mandel-2: 6.78% (1.2998 => 1.3879, std. dev.: 0.0144) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.91% (1.5824 => 1.6759, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8143, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9879, std. dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.71% (1.7688 => 1.8344, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/salsa20: 3.59% (7.4271 => 7.6939, std. dev.: 0.0054) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4545, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: 2.89% (1.9199 => 1.9753, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 2.80% (11.2619 => 11.5774, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9393, std. dev.: 0.0018) MultiSource/Applications/sqlite3/sqlite3: 2.40% (4.5928 => 4.7032, std. dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.26% (7.9275 => 8.1064, std. dev.: 0.0071) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 1.73% (3.2729 => 3.3294, std. dev.: 0.0024) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.58% (0.8273 => 0.8404, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.45% (1.4298 => 1.4505, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5085, std. dev.: 0.0078) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.28% (2.0200 => 2.0458, std. dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 1.23% (5.0168 => 5.0787, std. dev.: 0.0071) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.18% (1.9433 => 1.9662, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1777, std. dev.: 0.0006) SingleSource/Benchmarks/McGill/chomp: 1.07% (1.2308 => 1.2440, std. dev.: 0.0027) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.16% (22.5627 => 20.9464, std. dev.: 0.0052) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.63% (0.2670 => 0.2493, std. dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.15% (0.3511 => 0.3295, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-2: -4.61% (0.3601 => 0.3435, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: -4.61% (0.3623 => 0.3456, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.58% (0.3650 => 0.3483, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -4.53% (0.3663 => 0.3497, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: -4.50% (0.3646 => 0.3482, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: -4.44% (0.3578 => 0.3419, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -4.14% (0.3940 => 0.3777, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -4.04% (0.3789 => 0.3636, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -3.91% (0.3914 => 0.3761, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -3.90% (0.4003 => 0.3847, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.00% (0.6576 => 0.6379, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.68% (0.8818 => 0.8582, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/bigfib: -2.56% (0.6250 => 0.6090, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.68% (0.9108 => 0.8955, std. dev.: 0.0002) MultiSource/Applications/lua/lua: -1.02% (3.7467 => 3.7085, std. dev.: 0.0078) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.13% (1.0460 => 0.9505, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.47% (0.3139 => 0.2936, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0003) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9624, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.37% (1.3780 => 1.3178, std. dev.: 0.0013) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0009) SingleSource/Benchmarks/Dhrystone/dry: -4.09% (2.5089 => 2.4062, std. dev.: 0.0014) MultiSource/Benchmarks/Olden/bh/bh: -3.66% (1.9762 => 1.9039, std. dev.: 0.0097) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.64% (0.3458 => 0.3332, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -2.24% (6.3560 => 6.2135, std. dev.: 0.0109) SingleSource/Benchmarks/Misc/richards_benchmark: -2.13% (1.1560 => 1.1314, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.90% (6.6320 => 6.5063, std. dev.: 0.0030) MultiSource/Benchmarks/mafft/pairlocalalign: -1.84% (28.2225 => 27.7024, std. dev.: 0.0017) MultiSource/Applications/minisat/minisat: -1.84% (9.3358 => 9.1639, std. dev.: 0.0396) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.65% (20.3410 => 20.0048, std. dev.: 0.0301) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9953, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.48% (3.9173 => 3.8593, std. dev.: 0.0039) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.39% (8.8259 => 8.7028, std. dev.: 0.0183) MultiSource/Applications/lua/lua: -1.38% (26.5159 => 26.1488, std. dev.: 0.0020) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.36s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon May 28 04:41:15 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 28 May 2012 06:41:15 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120528114115.1F6CF2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/823?compare_to=822&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 823, Order: 157575, Start Time: 2012-05-28 10:45:14, End Time: 2012-05-28 11:42:16 To: 822, Order: 157561, Start Time: 2012-05-28 04:42:55, End Time: 2012-05-28 05:39:27 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (56 on baseline) Performance Improvements: 0 (41 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 891 (791 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 1.74% (1.3879 => 1.4120, std. dev.: 0.0059) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.34% (2.0176 => 2.2666, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.23% (0.3130 => 0.3325, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.30% (0.2721 => 0.2838, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.08% (3.9660 => 4.0881, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.82% (0.6959 => 0.7155, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.68% (0.5265 => 0.5406, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 2.58% (1.0594 => 1.0867, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.58% (0.9199 => 0.9436, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 2.52% (0.8310 => 0.8519, std. dev.: 0.0014) MultiSource/Applications/SPASS/SPASS: 2.31% (13.8202 => 14.1390, std. dev.: 0.0077) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.31% (1.1364 => 1.1626, std. dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.24% (1.2193 => 1.2466, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.13% (0.5637 => 0.5757, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.04% (1.4563 => 1.4860, std. dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.02% (1.3245 => 1.3513, std. dev.: 0.0096) MultiSource/Applications/siod/siod: 2.01% (2.1791 => 2.2229, std. dev.: 0.0111) MultiSource/Applications/lambda-0_1_3/lambda: 1.89% (0.7038 => 0.7171, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.71% (13.2842 => 13.5112, std. dev.: 0.0173) MultiSource/Applications/kimwitu++/kc: 1.62% (16.6129 => 16.8812, std. dev.: 0.0072) MultiSource/Benchmarks/MallocBench/gs/gs: 1.60% (3.8646 => 3.9265, std. dev.: 0.0033) MultiSource/Applications/treecc/treecc: 1.55% (1.9270 => 1.9568, std. dev.: 0.0010) MultiSource/Applications/Burg/burg: 1.54% (1.1061 => 1.1231, std. dev.: 0.0033) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.53% (1.3819 => 1.4030, std. dev.: 0.0038) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.49% (1.3813 => 1.4019, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.41% (0.7460 => 0.7565, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.39% (0.7710 => 0.7817, std. dev.: 0.0027) MultiSource/Applications/JM/lencod/lencod: 1.36% (14.8535 => 15.0557, std. dev.: 0.0072) MultiSource/Applications/sqlite3/sqlite3: 1.26% (16.2614 => 16.4655, std. dev.: 0.0180) MultiSource/Applications/SIBsim4/SIBsim4: 1.20% (1.2749 => 1.2902, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.07% (3.6692 => 3.7083, std. dev.: 0.0045) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 24.29% (1.8175 => 2.2589, std. dev.: 0.0165) SingleSource/Benchmarks/Misc/mandel-2: 8.63% (1.2998 => 1.4120, std. dev.: 0.0059) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6754, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8143, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9882, std. dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.69% (1.7688 => 1.8341, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: 3.51% (7.4271 => 7.6879, std. dev.: 0.0106) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4540, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-6: 2.91% (1.9199 => 1.9758, std. dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 2.79% (11.2619 => 11.5763, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9392, std. dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.45% (7.9275 => 8.1221, std. dev.: 0.0041) MultiSource/Applications/sqlite3/sqlite3: 2.38% (4.5928 => 4.7023, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 1.65% (3.2729 => 3.3270, std. dev.: 0.0013) SingleSource/Benchmarks/Dhrystone/fldry: 1.60% (1.9290 => 1.9599, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 1.56% (0.8273 => 0.8402, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.48% (1.4298 => 1.4510, std. dev.: 0.0010) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5088, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.27% (2.0200 => 2.0456, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.22% (1.9433 => 1.9670, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1781, std. dev.: 0.0010) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.05% (22.5627 => 20.9716, std. dev.: 0.0036) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.52% (0.2670 => 0.2496, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.12% (0.3511 => 0.3296, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-3: -4.72% (0.3623 => 0.3452, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.60% (0.3650 => 0.3482, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/synchronized: -4.50% (0.3663 => 0.3498, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -4.50% (0.3601 => 0.3439, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -4.50% (0.3646 => 0.3482, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -4.42% (0.3578 => 0.3420, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -4.14% (0.3940 => 0.3777, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -3.96% (0.3789 => 0.3639, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -3.93% (0.3914 => 0.3760, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -3.87% (0.4003 => 0.3848, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.57% (0.6576 => 0.6407, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.49% (0.8818 => 0.8598, std. dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/bigfib: -2.45% (0.6250 => 0.6097, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.56% (0.9108 => 0.8966, std. dev.: 0.0006) MultiSource/Applications/lua/lua: -1.09% (3.7467 => 3.7060, std. dev.: 0.0047) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.14% (1.0460 => 0.9504, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.01% (1.3780 => 1.3090, std. dev.: 0.0049) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9624, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -3.98% (2.5089 => 2.4090, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.73% (0.3458 => 0.3329, std. dev.: 0.0008) MultiSource/Benchmarks/Olden/bh/bh: -3.66% (1.9762 => 1.9038, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -2.27% (6.3560 => 6.2120, std. dev.: 0.0110) SingleSource/Benchmarks/Misc/richards_benchmark: -2.14% (1.1560 => 1.1313, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: -1.99% (9.3358 => 9.1497, std. dev.: 0.0023) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.88% (6.6320 => 6.5075, std. dev.: 0.0029) MultiSource/Benchmarks/mafft/pairlocalalign: -1.85% (28.2225 => 27.7016, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.83% (20.3410 => 19.9688, std. dev.: 0.0263) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9960, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) MultiSource/Applications/lua/lua: -1.53% (26.5159 => 26.1106, std. dev.: 0.0218) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.26% (8.8259 => 8.7147, std. dev.: 0.0053) SingleSource/Benchmarks/Shootout/heapsort: -1.16% (3.9173 => 3.8717, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.05% (3.8887 => 3.8479, std. dev.: 0.0051) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.35s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon May 28 07:10:38 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 28 May 2012 09:10:38 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120528141038.CA58E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/824?compare_to=823&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 824, Order: 157576, Start Time: 2012-05-28 13:15:05, End Time: 2012-05-28 14:11:38 To: 823, Order: 157575, Start Time: 2012-05-28 10:45:14, End Time: 2012-05-28 11:42:16 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (44 on baseline) Performance Improvements: 0 (47 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 891 (797 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 1.10% (7.9595 => 8.0471, std. dev.: 0.0088) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 11.62% (2.0176 => 2.2520, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.62% (0.3130 => 0.3306, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.49% (3.9660 => 4.0648, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.17% (0.6959 => 0.7110, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.13% (0.5265 => 0.5377, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.02% (0.9199 => 0.9385, std. dev.: 0.0046) MultiSource/Applications/SPASS/SPASS: 1.91% (13.8202 => 14.0845, std. dev.: 0.0100) MultiSource/Benchmarks/nbench/nbench: 1.85% (1.0594 => 1.0790, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 1.82% (0.8310 => 0.8461, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.67% (1.2193 => 1.2397, std. dev.: 0.0045) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.60% (1.1364 => 1.1546, std. dev.: 0.0019) MultiSource/Applications/siod/siod: 1.55% (2.1791 => 2.2129, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.35% (1.3245 => 1.3424, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.32% (1.4563 => 1.4755, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.13% (13.2842 => 13.4338, std. dev.: 0.0177) MultiSource/Benchmarks/MallocBench/gs/gs: 1.09% (3.8646 => 3.9066, std. dev.: 0.0088) MultiSource/Applications/hbd/hbd: 1.07% (1.3693 => 1.3839, std. dev.: 0.0036) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.02% (1.3819 => 1.3960, std. dev.: 0.0019) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 23.94% (1.8175 => 2.2526, std. dev.: 0.0267) SingleSource/Benchmarks/Misc/mandel-2: 7.52% (1.2998 => 1.3976, std. dev.: 0.0058) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.52% (2.5629 => 2.7299, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.90% (1.5824 => 1.6757, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 3.86% (1.9144 => 1.9883, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.75% (1.7688 => 1.8352, std. dev.: 0.0060) SingleSource/Benchmarks/Misc/salsa20: 3.65% (7.4271 => 7.6981, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 2.98% (12.0921 => 12.4526, std. dev.: 0.0014) MultiSource/Benchmarks/nbench/nbench: 2.80% (11.2619 => 11.5770, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: 2.79% (1.9199 => 1.9734, std. dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.76% (2.8606 => 2.9395, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.37% (7.9275 => 8.1154, std. dev.: 0.0143) MultiSource/Applications/sqlite3/sqlite3: 2.30% (4.5928 => 4.6985, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 1.73% (3.2729 => 3.3296, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/ffbench: 1.57% (0.8273 => 0.8403, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.45% (1.4298 => 1.4506, std. dev.: 0.0018) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5090, std. dev.: 0.0073) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.26% (2.0200 => 2.0455, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/bisort/bisort: 1.21% (0.8239 => 0.8339, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.13% (1.9433 => 1.9653, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/flops: 1.13% (9.0760 => 9.1782, std. dev.: 0.0006) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.63% (22.5627 => 20.8419, std. dev.: 0.0180) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.89% (0.3511 => 0.3269, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.78% (0.2670 => 0.2489, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: -6.18% (0.3623 => 0.3399, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.16% (0.3650 => 0.3425, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -6.09% (0.3578 => 0.3360, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: -6.05% (0.3601 => 0.3383, std. dev.: 0.0031) SingleSource/UnitTests/ObjC/synchronized: -5.98% (0.3663 => 0.3444, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -5.92% (0.3646 => 0.3430, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -5.61% (0.3940 => 0.3719, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -5.41% (0.3789 => 0.3584, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -5.34% (0.3914 => 0.3705, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -5.20% (0.4003 => 0.3795, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.09% (0.6576 => 0.6373, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.07% (0.8818 => 0.8547, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/bigfib: -3.07% (0.6250 => 0.6058, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: -2.63% (0.5748 => 0.5597, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: -2.30% (0.5818 => 0.5684, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -2.17% (0.9108 => 0.8910, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: -1.87% (0.7061 => 0.6929, std. dev.: 0.0009) MultiSource/Applications/lua/lua: -1.62% (3.7467 => 3.6860, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.33% (1.9828 => 1.9565, std. dev.: 0.0007) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.31% (6.2785 => 6.1962, std. dev.: 0.0030) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.13% (1.0460 => 0.9505, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.31% (0.3139 => 0.2941, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.79% (1.3780 => 1.3120, std. dev.: 0.0104) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9624, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0010) SingleSource/Benchmarks/Dhrystone/dry: -4.01% (2.5089 => 2.4083, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.62% (1.9762 => 1.9046, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -2.29% (6.3560 => 6.2107, std. dev.: 0.0210) SingleSource/Benchmarks/Misc/richards_benchmark: -2.13% (1.1560 => 1.1314, std. dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.05% (0.4867 => 0.4767, std. dev.: 0.0016) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -2.02% (6.6320 => 6.4978, std. dev.: 0.0084) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.00% (20.3410 => 19.9339, std. dev.: 0.0636) MultiSource/Applications/minisat/minisat: -1.92% (9.3358 => 9.1566, std. dev.: 0.0433) MultiSource/Benchmarks/mafft/pairlocalalign: -1.84% (28.2225 => 27.7033, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3446, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9960, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) MultiSource/Applications/lua/lua: -1.53% (26.5159 => 26.1100, std. dev.: 0.0215) SingleSource/Benchmarks/Shootout/heapsort: -1.46% (3.9173 => 3.8603, std. dev.: 0.0212) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.40% (8.8259 => 8.7023, std. dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.02% (3.8887 => 3.8489, std. dev.: 0.0049) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.51s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon May 28 08:40:43 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 28 May 2012 10:40:43 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120528154043.98D2E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/825?compare_to=824&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 825, Order: 157577, Start Time: 2012-05-28 14:44:59, End Time: 2012-05-28 15:41:44 To: 824, Order: 157576, Start Time: 2012-05-28 13:15:05, End Time: 2012-05-28 14:11:38 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (52 on baseline) Performance Improvements: 0 (44 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 890 (792 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 6.59% (0.4035 => 0.4301, std. dev.: 0.0065) MultiSource/Benchmarks/PAQ8p/paq8p: 1.01% (2.2520 => 2.2748, std. dev.: 0.0013) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.75% (2.0176 => 2.2748, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.94% (0.3130 => 0.3316, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.68% (0.2721 => 0.2821, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.95% (3.9660 => 4.0831, std. dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.62% (0.6959 => 0.7141, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.55% (0.5265 => 0.5399, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.41% (0.9199 => 0.9421, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 2.34% (1.0594 => 1.0842, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/football/football: 2.32% (0.8310 => 0.8503, std. dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 2.27% (13.8202 => 14.1341, std. dev.: 0.0104) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.02% (1.1364 => 1.1594, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.02% (1.2193 => 1.2439, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.97% (0.5637 => 0.5748, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.87% (0.7710 => 0.7854, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.62% (1.4563 => 1.4799, std. dev.: 0.0068) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.60% (13.2842 => 13.4971, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.56% (1.3819 => 1.4034, std. dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: 1.55% (0.7038 => 0.7147, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.54% (1.3245 => 1.3449, std. dev.: 0.0026) MultiSource/Applications/siod/siod: 1.52% (2.1791 => 2.2123, std. dev.: 0.0110) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.38% (0.7460 => 0.7563, std. dev.: 0.0009) MultiSource/Applications/kimwitu++/kc: 1.29% (16.6129 => 16.8276, std. dev.: 0.0083) MultiSource/Benchmarks/MallocBench/gs/gs: 1.25% (3.8646 => 3.9131, std. dev.: 0.0035) MultiSource/Applications/treecc/treecc: 1.24% (1.9270 => 1.9509, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.22% (1.3813 => 1.3982, std. dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: 1.04% (16.2614 => 16.4301, std. dev.: 0.0021) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 24.23% (1.8175 => 2.2579, std. dev.: 0.0366) SingleSource/Benchmarks/Misc/mandel-2: 8.59% (1.2998 => 1.4114, std. dev.: 0.0119) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7298, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.91% (1.5824 => 1.6759, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9876, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.66% (1.7688 => 1.8336, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/salsa20: 3.65% (7.4271 => 7.6979, std. dev.: 0.0052) MultiSource/Applications/hexxagon/hexxagon: 2.98% (12.0921 => 12.4530, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/flops-6: 2.85% (1.9199 => 1.9747, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 2.80% (11.2619 => 11.5775, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9394, std. dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.42% (7.9275 => 8.1197, std. dev.: 0.0064) MultiSource/Applications/sqlite3/sqlite3: 2.36% (4.5928 => 4.7012, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 1.67% (3.2729 => 3.3276, std. dev.: 0.0015) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9600, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 1.60% (0.8273 => 0.8405, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.45% (1.4298 => 1.4505, std. dev.: 0.0013) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5090, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.27% (2.0200 => 2.0456, std. dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 1.21% (5.0168 => 5.0773, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 1.13% (9.0760 => 9.1782, std. dev.: 0.0009) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -7.64% (0.4657 => 0.4301, std. dev.: 0.0065) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.35% (22.5627 => 20.9049, std. dev.: 0.0090) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.74% (0.2670 => 0.2490, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.15% (0.3511 => 0.3295, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -5.93% (0.3623 => 0.3408, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -5.86% (0.3601 => 0.3390, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.84% (0.3650 => 0.3437, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/trivial-interface: -5.79% (0.3578 => 0.3371, std. dev.: 0.0030) SingleSource/UnitTests/ObjC/synchronized: -5.76% (0.3663 => 0.3452, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -5.65% (0.3646 => 0.3440, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -5.36% (0.3940 => 0.3729, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -5.23% (0.3789 => 0.3591, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -5.19% (0.3914 => 0.3711, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -5.05% (0.4003 => 0.3801, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: -2.96% (0.6250 => 0.6065, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: -2.73% (0.5748 => 0.5591, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.49% (0.6576 => 0.6412, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: -2.48% (0.5818 => 0.5674, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: -2.07% (0.7061 => 0.6915, std. dev.: 0.0014) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.91% (0.9108 => 0.8934, std. dev.: 0.0003) MultiSource/Applications/lua/lua: -1.46% (3.7467 => 3.6919, std. dev.: 0.0042) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.14% (1.0460 => 0.9504, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.50% (0.3139 => 0.2935, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2650, std. dev.: 0.0003) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.63% (1.3780 => 1.3142, std. dev.: 0.0059) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9622, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0014) SingleSource/Benchmarks/Dhrystone/dry: -4.03% (2.5089 => 2.4079, std. dev.: 0.0017) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.73% (0.3458 => 0.3329, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.61% (1.9762 => 1.9049, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout/lists: -2.12% (6.3560 => 6.2211, std. dev.: 0.0115) SingleSource/Benchmarks/Misc/richards_benchmark: -2.12% (1.1560 => 1.1315, std. dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.10% (0.4867 => 0.4765, std. dev.: 0.0017) MultiSource/Applications/minisat/minisat: -1.96% (9.3358 => 9.1526, std. dev.: 0.0051) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.90% (6.6320 => 6.5063, std. dev.: 0.0053) MultiSource/Benchmarks/mafft/pairlocalalign: -1.84% (28.2225 => 27.7023, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.62% (20.3410 => 20.0114, std. dev.: 0.0260) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9953, std. dev.: 0.0003) MultiSource/Applications/lua/lua: -1.58% (26.5159 => 26.0974, std. dev.: 0.0291) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.53% (3.9173 => 3.8575, std. dev.: 0.0036) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.47% (8.8259 => 8.6959, std. dev.: 0.0119) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.42s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon May 28 10:14:52 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 28 May 2012 12:14:52 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120528171452.871A12A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/826?compare_to=825&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 826, Order: 157581, Start Time: 2012-05-28 16:19:20, End Time: 2012-05-28 17:15:54 To: 825, Order: 157577, Start Time: 2012-05-28 14:44:59, End Time: 2012-05-28 15:41:44 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (56 on baseline) Performance Improvements: 0 (45 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (787 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.42% (2.0176 => 2.2681, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.97% (0.3130 => 0.3317, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.08% (0.2721 => 0.2832, std. dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.96% (3.9660 => 4.0833, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.54% (0.6959 => 0.7136, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.45% (0.9199 => 0.9424, std. dev.: 0.0065) MultiSource/Benchmarks/nbench/nbench: 2.44% (1.0594 => 1.0853, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.41% (0.5265 => 0.5392, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/football/football: 2.39% (0.8310 => 0.8509, std. dev.: 0.0028) MultiSource/Applications/SPASS/SPASS: 2.36% (13.8202 => 14.1464, std. dev.: 0.0135) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.18% (1.1364 => 1.1612, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.05% (1.2193 => 1.2443, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.95% (0.5637 => 0.5747, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.80% (1.3245 => 1.3483, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.76% (0.7710 => 0.7846, std. dev.: 0.0013) MultiSource/Applications/lambda-0_1_3/lambda: 1.73% (0.7038 => 0.7160, std. dev.: 0.0016) MultiSource/Applications/siod/siod: 1.71% (2.1791 => 2.2163, std. dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.62% (13.2842 => 13.4998, std. dev.: 0.0054) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.61% (1.4563 => 1.4798, std. dev.: 0.0029) MultiSource/Applications/kimwitu++/kc: 1.60% (16.6129 => 16.8790, std. dev.: 0.0124) MultiSource/Applications/treecc/treecc: 1.57% (1.9270 => 1.9573, std. dev.: 0.0111) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.53% (0.7460 => 0.7574, std. dev.: 0.0038) MultiSource/Benchmarks/MallocBench/gs/gs: 1.47% (3.8646 => 3.9215, std. dev.: 0.0051) MultiSource/Applications/Burg/burg: 1.43% (1.1061 => 1.1219, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.33% (1.3819 => 1.4003, std. dev.: 0.0020) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.32% (1.3813 => 1.3995, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 1.26% (1.3693 => 1.3865, std. dev.: 0.0066) MultiSource/Applications/SIBsim4/SIBsim4: 1.19% (1.2749 => 1.2901, std. dev.: 0.0015) MultiSource/Applications/JM/lencod/lencod: 1.19% (14.8535 => 15.0299, std. dev.: 0.0089) MultiSource/Applications/sqlite3/sqlite3: 1.08% (16.2614 => 16.4368, std. dev.: 0.0058) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.89% (0.4846 => 0.6973, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: 24.13% (1.8175 => 2.2560, std. dev.: 0.0062) SingleSource/Benchmarks/Misc/mandel-2: 8.46% (1.2998 => 1.4098, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7298, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.90% (1.5824 => 1.6757, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9876, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.66% (1.7688 => 1.8336, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/salsa20: 3.58% (7.4271 => 7.6931, std. dev.: 0.0058) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4546, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-6: 2.92% (1.9199 => 1.9759, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 2.80% (11.2619 => 11.5775, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9392, std. dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 2.38% (4.5928 => 4.7019, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.24% (7.9275 => 8.1051, std. dev.: 0.0127) MultiSource/Applications/siod/siod: 1.74% (3.2729 => 3.3297, std. dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.60% (0.8273 => 0.8405, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.46% (1.4298 => 1.4507, std. dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5091, std. dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.28% (2.0200 => 2.0459, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.16% (1.9433 => 1.9658, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: 1.10% (9.0760 => 9.1762, std. dev.: 0.0017) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -21.22% (0.4657 => 0.3669, std. dev.: 0.0279) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.82% (22.5627 => 21.0249, std. dev.: 0.0079) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.48% (0.2670 => 0.2497, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.90% (0.3511 => 0.3304, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -5.60% (0.3623 => 0.3420, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.56% (0.3650 => 0.3447, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -5.45% (0.3578 => 0.3383, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -5.43% (0.3663 => 0.3464, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -5.42% (0.3601 => 0.3406, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -5.27% (0.3646 => 0.3454, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -4.95% (0.3940 => 0.3745, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -4.85% (0.3914 => 0.3724, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -4.72% (0.3789 => 0.3610, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -4.70% (0.4003 => 0.3815, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.97% (0.6576 => 0.6381, std. dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/bigfib: -2.56% (0.6250 => 0.6090, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.35% (0.8818 => 0.8611, std. dev.: 0.0013) SingleSource/UnitTests/ObjC++/Hello: -2.26% (0.5748 => 0.5618, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference-object: -2.01% (0.5818 => 0.5701, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: -1.64% (0.7061 => 0.6945, std. dev.: 0.0027) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.55% (0.9108 => 0.8967, std. dev.: 0.0004) MultiSource/Applications/lua/lua: -1.24% (3.7467 => 3.7003, std. dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.15% (1.9828 => 1.9599, std. dev.: 0.0064) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.14% (1.0460 => 0.9504, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.92% (1.3780 => 1.3102, std. dev.: 0.0011) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9623, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -4.06% (2.5089 => 2.4070, std. dev.: 0.0013) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.73% (0.3458 => 0.3329, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -3.68% (1.9762 => 1.9035, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: -2.12% (1.1560 => 1.1315, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: -2.01% (9.3358 => 9.1485, std. dev.: 0.0057) SingleSource/Benchmarks/Shootout/lists: -1.89% (6.3560 => 6.2358, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.86% (6.6320 => 6.5085, std. dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.86% (20.3410 => 19.9629, std. dev.: 0.0382) MultiSource/Benchmarks/mafft/pairlocalalign: -1.85% (28.2225 => 27.7016, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9958, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.56% (0.9692 => 0.9541, std. dev.: 0.0000) MultiSource/Applications/lua/lua: -1.43% (26.5159 => 26.1365, std. dev.: 0.0115) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.37% (8.8259 => 8.7053, std. dev.: 0.0045) SingleSource/Benchmarks/Shootout/heapsort: -1.12% (3.9173 => 3.8734, std. dev.: 0.0105) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.21s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon May 28 11:37:53 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 28 May 2012 13:37:53 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120528183753.C51DB2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/827?compare_to=826&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 827, Order: 157583, Start Time: 2012-05-28 17:42:04, End Time: 2012-05-28 18:38:55 To: 826, Order: 157581, Start Time: 2012-05-28 16:19:20, End Time: 2012-05-28 17:15:54 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (55 on baseline) Performance Improvements: 0 (44 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (789 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.23% (2.0176 => 2.2644, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.04% (0.3130 => 0.3319, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.12% (0.2721 => 0.2833, std. dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.92% (3.9660 => 4.0817, std. dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.85% (0.5265 => 0.5415, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.60% (0.6959 => 0.7140, std. dev.: 0.0024) MultiSource/Applications/SPASS/SPASS: 2.52% (13.8202 => 14.1680, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.48% (0.9199 => 0.9427, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/football/football: 2.44% (0.8310 => 0.8513, std. dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 2.43% (1.0594 => 1.0851, std. dev.: 0.0022) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.13% (1.1364 => 1.1606, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.05% (1.2193 => 1.2443, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.97% (0.5637 => 0.5748, std. dev.: 0.0027) MultiSource/Applications/siod/siod: 1.83% (2.1791 => 2.2189, std. dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.82% (1.3245 => 1.3486, std. dev.: 0.0015) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.80% (0.7710 => 0.7849, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 1.72% (0.7038 => 0.7159, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.67% (1.4563 => 1.4806, std. dev.: 0.0018) MultiSource/Applications/kimwitu++/kc: 1.60% (16.6129 => 16.8779, std. dev.: 0.0154) MultiSource/Applications/hbd/hbd: 1.57% (1.3693 => 1.3908, std. dev.: 0.0071) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.57% (13.2842 => 13.4922, std. dev.: 0.0104) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.53% (1.3819 => 1.4031, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/gs/gs: 1.48% (3.8646 => 3.9219, std. dev.: 0.0066) MultiSource/Applications/treecc/treecc: 1.43% (1.9270 => 1.9545, std. dev.: 0.0022) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.42% (0.7460 => 0.7566, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.38% (1.3813 => 1.4004, std. dev.: 0.0007) MultiSource/Applications/Burg/burg: 1.34% (1.1061 => 1.1209, std. dev.: 0.0049) MultiSource/Applications/SIBsim4/SIBsim4: 1.15% (1.2749 => 1.2896, std. dev.: 0.0038) MultiSource/Applications/JM/lencod/lencod: 1.08% (14.8535 => 15.0139, std. dev.: 0.0087) MultiSource/Applications/sqlite3/sqlite3: 1.07% (16.2614 => 16.4357, std. dev.: 0.0027) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0055) SingleSource/Benchmarks/Misc/fbench: 24.24% (1.8175 => 2.2581, std. dev.: 0.0416) SingleSource/Benchmarks/Misc/mandel-2: 7.33% (1.2998 => 1.3951, std. dev.: 0.0087) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.93% (1.5824 => 1.6762, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9880, std. dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.66% (1.7688 => 1.8335, std. dev.: 0.0060) SingleSource/Benchmarks/Misc/salsa20: 3.63% (7.4271 => 7.6964, std. dev.: 0.0026) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4544, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-6: 2.94% (1.9199 => 1.9763, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 2.80% (11.2619 => 11.5770, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9392, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.55% (7.9275 => 8.1298, std. dev.: 0.0082) MultiSource/Applications/sqlite3/sqlite3: 2.35% (4.5928 => 4.7006, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 1.74% (3.2729 => 3.3300, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: 1.60% (1.9290 => 1.9599, std. dev.: 0.0082) MultiSource/Applications/lemon/lemon: 1.45% (1.4298 => 1.4506, std. dev.: 0.0018) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5095, std. dev.: 0.0034) MultiSource/Benchmarks/Olden/bisort/bisort: 1.26% (0.8239 => 0.8343, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.26% (2.0200 => 2.0454, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1773, std. dev.: 0.0012) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.87% (22.5627 => 21.0124, std. dev.: 0.0101) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.55% (0.2670 => 0.2495, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.70% (0.3511 => 0.3311, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: -5.63% (0.3623 => 0.3419, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.53% (0.3650 => 0.3448, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-2: -5.53% (0.3601 => 0.3402, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -5.49% (0.3646 => 0.3446, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -5.41% (0.3663 => 0.3465, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: -5.39% (0.3578 => 0.3385, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/for-in: -4.96% (0.3789 => 0.3601, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/property: -4.95% (0.3940 => 0.3745, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -4.83% (0.3914 => 0.3725, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -4.70% (0.4003 => 0.3815, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.01% (0.6576 => 0.6378, std. dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/bigfib: -2.74% (0.6250 => 0.6079, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: -2.35% (0.5748 => 0.5613, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.29% (0.8818 => 0.8616, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference-object: -2.08% (0.5818 => 0.5697, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: -1.61% (0.7061 => 0.6947, std. dev.: 0.0021) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.55% (0.9108 => 0.8967, std. dev.: 0.0007) MultiSource/Applications/lua/lua: -1.32% (3.7467 => 3.6973, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.04% (1.9828 => 1.9621, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.13% (1.0460 => 0.9505, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.70% (1.3780 => 1.3132, std. dev.: 0.0041) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9622, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0009) SingleSource/Benchmarks/Dhrystone/dry: -4.03% (2.5089 => 2.4077, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.73% (0.3458 => 0.3329, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -3.68% (1.9762 => 1.9035, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: -2.14% (1.1560 => 1.1313, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout/lists: -2.11% (6.3560 => 6.2221, std. dev.: 0.0052) MultiSource/Applications/minisat/minisat: -1.94% (9.3358 => 9.1544, std. dev.: 0.0115) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.91% (6.6320 => 6.5056, std. dev.: 0.0016) MultiSource/Benchmarks/mafft/pairlocalalign: -1.84% (28.2225 => 27.7024, std. dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.76% (20.3410 => 19.9830, std. dev.: 0.0493) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9954, std. dev.: 0.0002) MultiSource/Applications/lua/lua: -1.57% (26.5159 => 26.1007, std. dev.: 0.0190) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.56% (0.9692 => 0.9541, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.40% (3.9173 => 3.8625, std. dev.: 0.0143) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.35% (8.8259 => 8.7071, std. dev.: 0.0058) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.19s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon May 28 13:00:42 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 28 May 2012 15:00:42 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120528200042.8F9032A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/828?compare_to=827&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 828, Order: 157586, Start Time: 2012-05-28 19:05:03, End Time: 2012-05-28 20:01:44 To: 827, Order: 157583, Start Time: 2012-05-28 17:42:04, End Time: 2012-05-28 18:38:55 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (57 on baseline) Performance Improvements: 1 (43 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 891 (788 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -15.25% (0.4393 => 0.3723, std. dev.: 0.0195) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.27% (2.0176 => 2.2651, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.88% (0.3130 => 0.3314, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.01% (0.2721 => 0.2830, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.92% (3.9660 => 4.0817, std. dev.: 0.0104) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.62% (0.6959 => 0.7141, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.53% (0.9199 => 0.9432, std. dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 2.39% (1.0594 => 1.0847, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/football/football: 2.38% (0.8310 => 0.8508, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 2.34% (13.8202 => 14.1441, std. dev.: 0.0118) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.34% (0.5265 => 0.5388, std. dev.: 0.0025) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.24% (1.1364 => 1.1619, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.11% (1.2193 => 1.2450, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.08% (0.5637 => 0.5754, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.78% (0.7460 => 0.7593, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.74% (1.3245 => 1.3475, std. dev.: 0.0008) MultiSource/Applications/siod/siod: 1.71% (2.1791 => 2.2164, std. dev.: 0.0054) MultiSource/Applications/kimwitu++/kc: 1.67% (16.6129 => 16.8897, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.63% (13.2842 => 13.5003, std. dev.: 0.0080) MultiSource/Applications/lambda-0_1_3/lambda: 1.62% (0.7038 => 0.7152, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.58% (1.4563 => 1.4793, std. dev.: 0.0051) MultiSource/Benchmarks/MallocBench/gs/gs: 1.46% (3.8646 => 3.9210, std. dev.: 0.0042) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.43% (0.7710 => 0.7820, std. dev.: 0.0037) MultiSource/Applications/treecc/treecc: 1.42% (1.9270 => 1.9543, std. dev.: 0.0005) MultiSource/Applications/Burg/burg: 1.38% (1.1061 => 1.1214, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.36% (1.3819 => 1.4007, std. dev.: 0.0028) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.34% (1.3813 => 1.3998, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.27% (3.2742 => 3.3158, std. dev.: 0.0114) MultiSource/Applications/SIBsim4/SIBsim4: 1.21% (1.2749 => 1.2903, std. dev.: 0.0017) MultiSource/Applications/hbd/hbd: 1.20% (1.3693 => 1.3858, std. dev.: 0.0045) MultiSource/Applications/JM/lencod/lencod: 1.07% (14.8535 => 15.0124, std. dev.: 0.0093) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 24.01% (1.8175 => 2.2538, std. dev.: 0.0057) SingleSource/Benchmarks/Misc/mandel-2: 7.56% (1.2998 => 1.3981, std. dev.: 0.0155) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7298, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6755, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8146, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9880, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.67% (1.7688 => 1.8338, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: 3.61% (7.4271 => 7.6955, std. dev.: 0.0070) MultiSource/Applications/hexxagon/hexxagon: 2.98% (12.0921 => 12.4528, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-6: 2.86% (1.9199 => 1.9749, std. dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 2.78% (11.2619 => 11.5753, std. dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9393, std. dev.: 0.0019) MultiSource/Applications/sqlite3/sqlite3: 2.34% (4.5928 => 4.7003, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.26% (7.9275 => 8.1070, std. dev.: 0.0137) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 1.65% (3.2729 => 3.3270, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/ffbench: 1.58% (0.8273 => 0.8404, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.47% (1.4298 => 1.4508, std. dev.: 0.0018) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5082, std. dev.: 0.0019) SingleSource/Benchmarks/Dhrystone/fldry: 1.39% (1.9290 => 1.9558, std. dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.29% (2.0200 => 2.0461, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.19% (1.9433 => 1.9664, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1781, std. dev.: 0.0019) MultiSource/Benchmarks/sim/sim: 1.10% (5.0168 => 5.0719, std. dev.: 0.0098) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -20.06% (0.4657 => 0.3723, std. dev.: 0.0195) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.96% (22.5627 => 20.9929, std. dev.: 0.0167) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.52% (0.2670 => 0.2496, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.92% (0.3511 => 0.3303, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-3: -5.55% (0.3623 => 0.3422, std. dev.: 0.0021) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.45% (0.3650 => 0.3451, std. dev.: 0.0023) SingleSource/UnitTests/ObjC/exceptions-2: -5.44% (0.3601 => 0.3405, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-4: -5.40% (0.3646 => 0.3449, std. dev.: 0.0033) SingleSource/UnitTests/ObjC/trivial-interface: -5.39% (0.3578 => 0.3385, std. dev.: 0.0033) SingleSource/UnitTests/ObjC/synchronized: -5.38% (0.3663 => 0.3466, std. dev.: 0.0041) SingleSource/UnitTests/ObjC/property: -5.03% (0.3940 => 0.3742, std. dev.: 0.0044) SingleSource/UnitTests/ObjC/exceptions: -4.83% (0.3914 => 0.3725, std. dev.: 0.0034) SingleSource/UnitTests/ObjC/for-in: -4.75% (0.3789 => 0.3609, std. dev.: 0.0035) SingleSource/UnitTests/ObjC/parameter-passing: -4.67% (0.4003 => 0.3816, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.01% (0.6576 => 0.6378, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: -2.74% (0.6250 => 0.6079, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.40% (0.8818 => 0.8606, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.58% (0.9108 => 0.8964, std. dev.: 0.0044) MultiSource/Applications/lua/lua: -1.28% (3.7467 => 3.6986, std. dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.06% (1.9828 => 1.9617, std. dev.: 0.0010) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.14% (1.0460 => 0.9504, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.96% (1.3780 => 1.3096, std. dev.: 0.0056) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9624, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.99% (2.5089 => 2.4089, std. dev.: 0.0038) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -3.67% (1.9762 => 1.9036, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/richards_benchmark: -2.15% (1.1560 => 1.1312, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -2.12% (6.3560 => 6.2213, std. dev.: 0.0082) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.94% (20.3410 => 19.9468, std. dev.: 0.0808) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.93% (6.6320 => 6.5038, std. dev.: 0.0025) MultiSource/Applications/minisat/minisat: -1.90% (9.3358 => 9.1587, std. dev.: 0.0092) MultiSource/Benchmarks/mafft/pairlocalalign: -1.84% (28.2225 => 27.7029, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9956, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) MultiSource/Applications/lua/lua: -1.54% (26.5159 => 26.1088, std. dev.: 0.0322) SingleSource/Benchmarks/Shootout/heapsort: -1.46% (3.9173 => 3.8603, std. dev.: 0.0162) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.40% (8.8259 => 8.7022, std. dev.: 0.0106) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.12% (3.8887 => 3.8453, std. dev.: 0.0089) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.40s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon May 28 14:23:17 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 28 May 2012 16:23:17 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120528212317.11CB72A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/829?compare_to=828&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 829, Order: 157588, Start Time: 2012-05-28 20:27:44, End Time: 2012-05-28 21:24:18 To: 828, Order: 157586, Start Time: 2012-05-28 19:05:03, End Time: 2012-05-28 20:01:44 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (51 on baseline) Performance Improvements: 0 (45 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 891 (792 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 1.03% (7.9625 => 8.0444, std. dev.: 0.0146) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.24% (2.0176 => 2.2646, std. dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.62% (0.3130 => 0.3306, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.04% (0.2721 => 0.2831, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.68% (3.9660 => 4.0723, std. dev.: 0.0079) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.41% (0.6959 => 0.7127, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 2.28% (1.0594 => 1.0836, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.28% (0.5265 => 0.5385, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/football/football: 2.26% (0.8310 => 0.8498, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.21% (0.9199 => 0.9402, std. dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 2.16% (13.8202 => 14.1183, std. dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.02% (1.2193 => 1.2439, std. dev.: 0.0077) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.90% (1.1364 => 1.1580, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.90% (0.5637 => 0.5744, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.62% (1.4563 => 1.4799, std. dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.60% (1.3245 => 1.3457, std. dev.: 0.0008) MultiSource/Applications/siod/siod: 1.50% (2.1791 => 2.2118, std. dev.: 0.0061) MultiSource/Applications/lambda-0_1_3/lambda: 1.44% (0.7038 => 0.7139, std. dev.: 0.0024) MultiSource/Applications/Burg/burg: 1.41% (1.1061 => 1.1217, std. dev.: 0.0040) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.35% (13.2842 => 13.4630, std. dev.: 0.0208) MultiSource/Applications/treecc/treecc: 1.32% (1.9270 => 1.9524, std. dev.: 0.0012) MultiSource/Applications/kimwitu++/kc: 1.29% (16.6129 => 16.8274, std. dev.: 0.0277) MultiSource/Benchmarks/MallocBench/gs/gs: 1.29% (3.8646 => 3.9144, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.19% (1.3819 => 1.3983, std. dev.: 0.0001) MultiSource/Applications/SIBsim4/SIBsim4: 1.13% (1.2749 => 1.2893, std. dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.05% (3.2742 => 3.3086, std. dev.: 0.0048) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: 24.36% (1.8175 => 2.2602, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/mandel-2: 7.49% (1.2998 => 1.3972, std. dev.: 0.0072) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7298, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.89% (1.5824 => 1.6756, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8147, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9877, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.71% (1.7688 => 1.8344, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/salsa20: 3.61% (7.4271 => 7.6955, std. dev.: 0.0046) MultiSource/Applications/hexxagon/hexxagon: 2.98% (12.0921 => 12.4522, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-6: 2.89% (1.9199 => 1.9753, std. dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 2.80% (11.2619 => 11.5768, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9394, std. dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.50% (7.9275 => 8.1253, std. dev.: 0.0048) MultiSource/Applications/sqlite3/sqlite3: 2.35% (4.5928 => 4.7009, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 1.67% (3.2729 => 3.3276, std. dev.: 0.0078) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.61% (0.8273 => 0.8406, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.51% (1.4298 => 1.4514, std. dev.: 0.0038) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5093, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.27% (2.0200 => 2.0456, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0048) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.16% (1.9433 => 1.9658, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 1.13% (9.0760 => 9.1782, std. dev.: 0.0012) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -18.06% (0.4657 => 0.3816, std. dev.: 0.0188) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.11% (22.5627 => 20.9591, std. dev.: 0.0049) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.29% (0.2670 => 0.2502, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.12% (0.3511 => 0.3296, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-3: -5.77% (0.3623 => 0.3414, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.73% (0.3650 => 0.3441, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/trivial-interface: -5.62% (0.3578 => 0.3377, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -5.61% (0.3601 => 0.3399, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -5.43% (0.3646 => 0.3448, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -5.41% (0.3663 => 0.3465, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -5.20% (0.3940 => 0.3735, std. dev.: 0.0053) SingleSource/UnitTests/ObjC/exceptions: -5.01% (0.3914 => 0.3718, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -4.96% (0.3789 => 0.3601, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -4.90% (0.4003 => 0.3807, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: -2.91% (0.6250 => 0.6068, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/Hello: -2.37% (0.5748 => 0.5612, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.25% (0.8818 => 0.8620, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: -2.22% (0.5818 => 0.5689, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: -1.76% (0.7061 => 0.6937, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.66% (0.9108 => 0.8957, std. dev.: 0.0005) MultiSource/Applications/lua/lua: -1.45% (3.7467 => 3.6925, std. dev.: 0.0113) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.31% (1.9828 => 1.9569, std. dev.: 0.0021) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.04% (6.2785 => 6.2133, std. dev.: 0.0052) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.14% (1.0460 => 0.9504, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.31% (0.3139 => 0.2941, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.76% (1.3780 => 1.3124, std. dev.: 0.0036) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9624, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.96% (2.5089 => 2.4096, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -3.65% (1.9762 => 1.9041, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: -2.23% (1.1560 => 1.1302, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -2.16% (6.3560 => 6.2186, std. dev.: 0.0144) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.96% (20.3410 => 19.9413, std. dev.: 0.0408) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.87% (6.6320 => 6.5079, std. dev.: 0.0034) MultiSource/Benchmarks/mafft/pairlocalalign: -1.84% (28.2225 => 27.7029, std. dev.: 0.0014) MultiSource/Applications/minisat/minisat: -1.82% (9.3358 => 9.1662, std. dev.: 0.0285) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9958, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.56% (0.9692 => 0.9541, std. dev.: 0.0000) MultiSource/Applications/lua/lua: -1.55% (26.5159 => 26.1044, std. dev.: 0.0107) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.39% (8.8259 => 8.7033, std. dev.: 0.0123) SingleSource/Benchmarks/Shootout/heapsort: -1.19% (3.9173 => 3.8705, std. dev.: 0.0027) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.52s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon May 28 15:45:44 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 28 May 2012 17:45:44 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120528224544.16FDC2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/830?compare_to=829&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 830, Order: 157593, Start Time: 2012-05-28 21:50:13, End Time: 2012-05-28 22:46:45 To: 829, Order: 157588, Start Time: 2012-05-28 20:27:44, End Time: 2012-05-28 21:24:18 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (47 on baseline) Performance Improvements: 1 (46 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 891 (795 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -4.40% (0.3816 => 0.3648, std. dev.: 0.0065) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.08% (2.0176 => 2.2614, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.65% (0.3130 => 0.3307, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.75% (0.2721 => 0.2823, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.65% (3.9660 => 4.0712, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.20% (0.9199 => 0.9401, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 2.14% (0.8310 => 0.8488, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.14% (0.6959 => 0.7108, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.13% (0.5265 => 0.5377, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 2.10% (1.0594 => 1.0816, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 2.07% (13.8202 => 14.1060, std. dev.: 0.0099) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.89% (1.1364 => 1.1579, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.85% (1.2193 => 1.2418, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.84% (0.5637 => 0.5741, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.56% (1.3245 => 1.3451, std. dev.: 0.0011) MultiSource/Applications/treecc/treecc: 1.33% (1.9270 => 1.9527, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.33% (13.2842 => 13.4608, std. dev.: 0.0102) MultiSource/Applications/siod/siod: 1.32% (2.1791 => 2.2079, std. dev.: 0.0043) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.30% (1.4563 => 1.4753, std. dev.: 0.0026) MultiSource/Benchmarks/MallocBench/gs/gs: 1.25% (3.8646 => 3.9129, std. dev.: 0.0034) MultiSource/Applications/kimwitu++/kc: 1.16% (16.6129 => 16.8048, std. dev.: 0.0122) MultiSource/Applications/Burg/burg: 1.06% (1.1061 => 1.1178, std. dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: 24.29% (1.8175 => 2.2589, std. dev.: 0.0311) SingleSource/Benchmarks/Misc/mandel-2: 7.05% (1.2998 => 1.3915, std. dev.: 0.0048) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.87% (1.5824 => 1.6753, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8147, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9881, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.74% (1.7688 => 1.8349, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: 3.65% (7.4271 => 7.6985, std. dev.: 0.0062) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4548, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: 2.85% (1.9199 => 1.9747, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 2.79% (11.2619 => 11.5761, std. dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9394, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.50% (7.9275 => 8.1257, std. dev.: 0.0114) MultiSource/Applications/sqlite3/sqlite3: 2.40% (4.5928 => 4.7031, std. dev.: 0.0043) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 1.74% (3.2729 => 3.3300, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9603, std. dev.: 0.0044) MultiSource/Applications/lemon/lemon: 1.45% (1.4298 => 1.4505, std. dev.: 0.0006) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5096, std. dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.26% (2.0200 => 2.0455, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.20% (1.9433 => 1.9666, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 1.11% (9.0760 => 9.1771, std. dev.: 0.0014) MultiSource/Benchmarks/sim/sim: 1.06% (5.0168 => 5.0698, std. dev.: 0.0149) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -21.67% (0.4657 => 0.3648, std. dev.: 0.0065) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.33% (22.5627 => 20.9094, std. dev.: 0.0188) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.33% (0.2670 => 0.2501, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.92% (0.3511 => 0.3303, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-3: -5.44% (0.3623 => 0.3426, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -5.42% (0.3601 => 0.3406, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -5.32% (0.3646 => 0.3452, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -5.30% (0.3663 => 0.3469, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.26% (0.3650 => 0.3458, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: -5.23% (0.3578 => 0.3391, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -4.95% (0.3940 => 0.3745, std. dev.: 0.0031) SingleSource/UnitTests/ObjC/for-in: -4.78% (0.3789 => 0.3608, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: -4.65% (0.4003 => 0.3817, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -4.62% (0.3914 => 0.3733, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: -2.96% (0.6250 => 0.6065, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.83% (0.6576 => 0.6390, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.38% (0.8818 => 0.8608, std. dev.: 0.0013) SingleSource/UnitTests/ObjC++/Hello: -2.33% (0.5748 => 0.5614, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference-object: -2.13% (0.5818 => 0.5694, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.80% (0.9108 => 0.8944, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: -1.63% (0.7061 => 0.6946, std. dev.: 0.0030) MultiSource/Applications/lua/lua: -1.62% (3.7467 => 3.6861, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.21% (1.9828 => 1.9588, std. dev.: 0.0040) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.13% (1.0460 => 0.9505, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2650, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.28% (1.3780 => 1.3052, std. dev.: 0.0100) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9624, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -4.06% (2.5089 => 2.4071, std. dev.: 0.0013) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -3.63% (1.9762 => 1.9044, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: -2.11% (1.1560 => 1.1316, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -2.03% (6.3560 => 6.2270, std. dev.: 0.0086) MultiSource/Applications/minisat/minisat: -1.91% (9.3358 => 9.1578, std. dev.: 0.0095) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.89% (6.6320 => 6.5069, std. dev.: 0.0016) MultiSource/Benchmarks/mafft/pairlocalalign: -1.84% (28.2225 => 27.7020, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9957, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.59% (20.3410 => 20.0166, std. dev.: 0.0121) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.56% (0.9692 => 0.9541, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.56% (8.8259 => 8.6885, std. dev.: 0.0111) MultiSource/Applications/lua/lua: -1.52% (26.5159 => 26.1125, std. dev.: 0.0170) SingleSource/Benchmarks/Shootout/heapsort: -1.27% (3.9173 => 3.8674, std. dev.: 0.0035) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.19% (2.5254 => 2.4953, std. dev.: 0.0054) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.36s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon May 28 17:08:17 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 28 May 2012 19:08:17 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120529000817.978592A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/831?compare_to=830&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 831, Order: 157594, Start Time: 2012-05-28 23:12:41, End Time: 2012-05-29 00:09:19 To: 830, Order: 157593, Start Time: 2012-05-28 21:50:13, End Time: 2012-05-28 22:46:45 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (51 on baseline) Performance Improvements: 0 (44 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (793 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 11.72% (2.0176 => 2.2540, std. dev.: 0.0149) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.59% (0.3130 => 0.3305, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.79% (3.9660 => 4.0766, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.36% (0.6959 => 0.7123, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.29% (0.9199 => 0.9410, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.22% (0.5265 => 0.5382, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/football/football: 2.15% (0.8310 => 0.8489, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 2.14% (1.0594 => 1.0821, std. dev.: 0.0077) MultiSource/Applications/SPASS/SPASS: 2.13% (13.8202 => 14.1144, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.91% (1.2193 => 1.2426, std. dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.88% (0.5637 => 0.5743, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.87% (1.1364 => 1.1577, std. dev.: 0.0007) MultiSource/Applications/siod/siod: 1.80% (2.1791 => 2.2183, std. dev.: 0.0094) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.56% (1.3245 => 1.3451, std. dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: 1.55% (0.7038 => 0.7147, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.53% (1.4563 => 1.4786, std. dev.: 0.0052) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.49% (13.2842 => 13.4825, std. dev.: 0.0141) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.38% (0.7460 => 0.7563, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/gs/gs: 1.32% (3.8646 => 3.9157, std. dev.: 0.0075) MultiSource/Applications/hbd/hbd: 1.27% (1.3693 => 1.3867, std. dev.: 0.0042) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.27% (1.3819 => 1.3994, std. dev.: 0.0012) MultiSource/Applications/treecc/treecc: 1.19% (1.9270 => 1.9500, std. dev.: 0.0040) MultiSource/Applications/kimwitu++/kc: 1.17% (16.6129 => 16.8073, std. dev.: 0.0139) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.04% (1.3813 => 1.3956, std. dev.: 0.0031) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 24.31% (1.8175 => 2.2593, std. dev.: 0.0123) SingleSource/Benchmarks/Misc/mandel-2: 7.59% (1.2998 => 1.3985, std. dev.: 0.0064) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6755, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8146, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 3.81% (1.9144 => 1.9874, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/salsa20: 3.59% (7.4271 => 7.6938, std. dev.: 0.0096) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.57% (1.7688 => 1.8319, std. dev.: 0.0019) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4542, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: 2.86% (1.9199 => 1.9748, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 2.79% (11.2619 => 11.5762, std. dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.74% (2.8606 => 2.9391, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 2.34% (4.5928 => 4.7002, std. dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.33% (7.9275 => 8.1120, std. dev.: 0.0151) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 1.67% (3.2729 => 3.3277, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/ffbench: 1.62% (0.8273 => 0.8407, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5096, std. dev.: 0.0036) MultiSource/Applications/lemon/lemon: 1.38% (1.4298 => 1.4496, std. dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.29% (2.0200 => 2.0460, std. dev.: 0.0001) MultiSource/Benchmarks/sim/sim: 1.25% (5.0168 => 5.0797, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout/sieve: 1.19% (5.1531 => 5.2145, std. dev.: 0.0033) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.17% (1.9433 => 1.9660, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1773, std. dev.: 0.0009) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -18.60% (0.4657 => 0.3791, std. dev.: 0.0182) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.33% (22.5627 => 20.9098, std. dev.: 0.0067) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.59% (0.2670 => 0.2494, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.12% (0.3511 => 0.3296, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -5.24% (0.3623 => 0.3433, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/trivial-interface: -5.06% (0.3578 => 0.3397, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -4.99% (0.3646 => 0.3464, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -4.97% (0.3601 => 0.3422, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -4.97% (0.3663 => 0.3481, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.88% (0.3650 => 0.3472, std. dev.: 0.0055) SingleSource/UnitTests/ObjC/property: -4.64% (0.3940 => 0.3757, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -4.52% (0.3914 => 0.3737, std. dev.: 0.0059) SingleSource/UnitTests/ObjC/for-in: -4.41% (0.3789 => 0.3622, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -4.35% (0.4003 => 0.3829, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.04% (0.6576 => 0.6376, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: -2.66% (0.6250 => 0.6084, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.61% (0.8818 => 0.8588, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/Hello: -1.93% (0.5748 => 0.5637, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.79% (0.9108 => 0.8945, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: -1.74% (0.5818 => 0.5717, std. dev.: 0.0004) MultiSource/Applications/lua/lua: -1.46% (3.7467 => 3.6920, std. dev.: 0.0007) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.07% (6.2785 => 6.2113, std. dev.: 0.0077) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.14% (1.0460 => 0.9504, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2650, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9624, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.01% (1.3780 => 1.3228, std. dev.: 0.0197) SingleSource/Benchmarks/Dhrystone/dry: -3.95% (2.5089 => 2.4098, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.67% (0.3458 => 0.3331, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.63% (1.9762 => 1.9044, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/richards_benchmark: -2.15% (1.1560 => 1.1312, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -2.04% (6.3560 => 6.2261, std. dev.: 0.0056) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -2.00% (6.6320 => 6.4994, std. dev.: 0.0057) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.85% (20.3410 => 19.9640, std. dev.: 0.0587) MultiSource/Benchmarks/mafft/pairlocalalign: -1.84% (28.2225 => 27.7018, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0008) MultiSource/Applications/minisat/minisat: -1.61% (9.3358 => 9.1856, std. dev.: 0.0246) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9955, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) MultiSource/Applications/lua/lua: -1.51% (26.5159 => 26.1144, std. dev.: 0.0161) SingleSource/Benchmarks/Shootout/heapsort: -1.45% (3.9173 => 3.8605, std. dev.: 0.0043) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.26% (8.8259 => 8.7148, std. dev.: 0.0138) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.41s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon May 28 19:03:45 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 28 May 2012 21:03:45 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120529020345.4E4652A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/832?compare_to=831&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 832, Order: 157596, Start Time: 2012-05-29 01:08:16, End Time: 2012-05-29 02:04:47 To: 831, Order: 157594, Start Time: 2012-05-28 23:12:41, End Time: 2012-05-29 00:09:19 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (48 on baseline) Performance Improvements: 1 (44 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 891 (796 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.55% (1.3228 => 1.3023, std. dev.: 0.0078) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 11.67% (2.0176 => 2.2530, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.59% (0.3130 => 0.3305, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.67% (3.9660 => 4.0717, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.20% (0.5265 => 0.5381, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.19% (0.9199 => 0.9400, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 2.10% (1.0594 => 1.0817, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/football/football: 2.06% (0.8310 => 0.8481, std. dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 2.03% (13.8202 => 14.1006, std. dev.: 0.0142) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.92% (0.5637 => 0.5745, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.87% (1.2193 => 1.2421, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.80% (1.1364 => 1.1568, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.55% (1.3245 => 1.3450, std. dev.: 0.0009) MultiSource/Applications/siod/siod: 1.36% (2.1791 => 2.2088, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.35% (13.2842 => 13.4630, std. dev.: 0.0063) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.33% (1.4563 => 1.4756, std. dev.: 0.0021) MultiSource/Benchmarks/MallocBench/gs/gs: 1.22% (3.8646 => 3.9119, std. dev.: 0.0042) MultiSource/Applications/kimwitu++/kc: 1.19% (16.6129 => 16.8110, std. dev.: 0.0090) MultiSource/Applications/Burg/burg: 1.15% (1.1061 => 1.1188, std. dev.: 0.0008) MultiSource/Applications/treecc/treecc: 1.13% (1.9270 => 1.9488, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.06% (1.3813 => 1.3960, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.03% (1.3819 => 1.3962, std. dev.: 0.0021) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/fbench: 24.15% (1.8175 => 2.2565, std. dev.: 0.0525) SingleSource/Benchmarks/Misc/mandel-2: 8.22% (1.2998 => 1.4067, std. dev.: 0.0064) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7298, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.85% (1.5824 => 1.6750, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8147, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 3.80% (1.9144 => 1.9872, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/salsa20: 3.70% (7.4271 => 7.7022, std. dev.: 0.0029) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.66% (1.7688 => 1.8335, std. dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4544, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-6: 2.93% (1.9199 => 1.9762, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 2.80% (11.2619 => 11.5770, std. dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9392, std. dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 2.35% (4.5928 => 4.7008, std. dev.: 0.0097) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.30% (7.9275 => 8.1096, std. dev.: 0.0087) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 1.74% (3.2729 => 3.3297, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0081) SingleSource/Benchmarks/Misc/ffbench: 1.55% (0.8273 => 0.8401, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.48% (1.4298 => 1.4510, std. dev.: 0.0015) MultiSource/Benchmarks/NPB-serial/is/is: 1.43% (8.3908 => 8.5106, std. dev.: 0.0016) MultiSource/Benchmarks/sim/sim: 1.43% (5.0168 => 5.0883, std. dev.: 0.0037) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.30% (2.0200 => 2.0462, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 1.13% (9.0760 => 9.1783, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.10% (1.9433 => 1.9646, std. dev.: 0.0015) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.34% (22.5627 => 20.9057, std. dev.: 0.0114) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.63% (0.2670 => 0.2493, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.21% (0.3511 => 0.3293, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions-3: -5.27% (0.3623 => 0.3432, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.26% (0.3650 => 0.3458, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -5.17% (0.3601 => 0.3415, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -5.13% (0.3663 => 0.3475, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -5.07% (0.3646 => 0.3461, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -5.03% (0.3578 => 0.3398, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -4.59% (0.3940 => 0.3759, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -4.55% (0.3914 => 0.3736, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -4.54% (0.3789 => 0.3617, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -4.47% (0.4003 => 0.3824, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.93% (0.6576 => 0.6383, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: -2.80% (0.6250 => 0.6075, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.67% (0.8818 => 0.8583, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: -1.97% (0.5748 => 0.5635, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.83% (0.9108 => 0.8941, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: -1.79% (0.5818 => 0.5714, std. dev.: 0.0029) MultiSource/Applications/lua/lua: -1.56% (3.7467 => 3.6882, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference: -1.43% (0.7061 => 0.6960, std. dev.: 0.0031) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.09% (6.2785 => 6.2100, std. dev.: 0.0017) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.14% (1.0460 => 0.9504, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.47% (0.3139 => 0.2936, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.49% (1.3780 => 1.3023, std. dev.: 0.0078) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9622, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.96% (2.5089 => 2.4095, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.67% (1.9762 => 1.9037, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout/lists: -2.35% (6.3560 => 6.2065, std. dev.: 0.0060) SingleSource/Benchmarks/Misc/richards_benchmark: -2.12% (1.1560 => 1.1315, std. dev.: 0.0015) MultiSource/Applications/minisat/minisat: -2.10% (9.3358 => 9.1400, std. dev.: 0.0206) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.95% (20.3410 => 19.9451, std. dev.: 0.0592) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.87% (6.6320 => 6.5081, std. dev.: 0.0017) MultiSource/Benchmarks/mafft/pairlocalalign: -1.85% (28.2225 => 27.7013, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9954, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) MultiSource/Applications/lua/lua: -1.45% (26.5159 => 26.1320, std. dev.: 0.0116) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.44% (8.8259 => 8.6992, std. dev.: 0.0075) SingleSource/Benchmarks/Shootout/heapsort: -1.36% (3.9173 => 3.8642, std. dev.: 0.0049) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.41s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue May 29 01:30:44 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 29 May 2012 03:30:44 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120529083044.55BE42A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/833?compare_to=832&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 833, Order: 157601, Start Time: 2012-05-29 07:34:43, End Time: 2012-05-29 08:31:45 To: 832, Order: 157596, Start Time: 2012-05-29 01:08:16, End Time: 2012-05-29 02:04:47 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (53 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 891 (795 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/McGill/chomp: 1.05% (1.2298 => 1.2427, std. dev.: 0.0032) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.45% (2.0176 => 2.2687, std. dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.85% (0.3130 => 0.3313, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.97% (0.2721 => 0.2829, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.90% (3.9660 => 4.0810, std. dev.: 0.0133) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.67% (0.6959 => 0.7145, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.49% (0.5265 => 0.5396, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.45% (0.9199 => 0.9424, std. dev.: 0.0034) MultiSource/Benchmarks/nbench/nbench: 2.35% (1.0594 => 1.0843, std. dev.: 0.0021) MultiSource/Applications/SPASS/SPASS: 2.31% (13.8202 => 14.1394, std. dev.: 0.0112) MultiSource/Benchmarks/Prolangs-C/football/football: 2.27% (0.8310 => 0.8499, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.22% (0.7710 => 0.7881, std. dev.: 0.0023) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.09% (1.1364 => 1.1601, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.03% (1.2193 => 1.2440, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.99% (0.5637 => 0.5749, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.98% (1.4563 => 1.4851, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.71% (1.3245 => 1.3471, std. dev.: 0.0017) MultiSource/Applications/lambda-0_1_3/lambda: 1.66% (0.7038 => 0.7155, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.56% (1.3819 => 1.4035, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.56% (13.2842 => 13.4915, std. dev.: 0.0033) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.49% (0.7460 => 0.7571, std. dev.: 0.0031) MultiSource/Applications/siod/siod: 1.48% (2.1791 => 2.2113, std. dev.: 0.0044) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.42% (1.3813 => 1.4009, std. dev.: 0.0019) MultiSource/Benchmarks/MallocBench/gs/gs: 1.37% (3.8646 => 3.9175, std. dev.: 0.0064) MultiSource/Applications/treecc/treecc: 1.33% (1.9270 => 1.9526, std. dev.: 0.0014) MultiSource/Applications/kimwitu++/kc: 1.33% (16.6129 => 16.8334, std. dev.: 0.0106) MultiSource/Applications/SIBsim4/SIBsim4: 1.12% (1.2749 => 1.2892, std. dev.: 0.0028) MultiSource/Applications/JM/lencod/lencod: 1.06% (14.8535 => 15.0113, std. dev.: 0.0081) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/fbench: 24.25% (1.8175 => 2.2583, std. dev.: 0.0458) SingleSource/Benchmarks/Misc/mandel-2: 8.23% (1.2998 => 1.4068, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6755, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.74% (1.9144 => 1.9860, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/salsa20: 3.71% (7.4271 => 7.7023, std. dev.: 0.0054) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.67% (1.7688 => 1.8338, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4549, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: 2.93% (1.9199 => 1.9761, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 2.81% (11.2619 => 11.5785, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.76% (2.8606 => 2.9395, std. dev.: 0.0032) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.43% (7.9275 => 8.1203, std. dev.: 0.0125) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 1.73% (3.2729 => 3.3296, std. dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9601, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/ffbench: 1.57% (0.8273 => 0.8403, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.49% (1.4298 => 1.4511, std. dev.: 0.0059) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5087, std. dev.: 0.0032) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.27% (2.0200 => 2.0456, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.21% (1.9433 => 1.9668, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 1.13% (9.0760 => 9.1783, std. dev.: 0.0016) MultiSource/Benchmarks/sim/sim: 1.00% (5.0168 => 5.0670, std. dev.: 0.0096) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.24% (22.5627 => 20.9288, std. dev.: 0.0129) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.40% (0.2670 => 0.2499, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.15% (0.3511 => 0.3295, std. dev.: 0.0047) SingleSource/UnitTests/ObjC/exceptions-3: -5.02% (0.3623 => 0.3441, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -4.94% (0.3601 => 0.3423, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -4.86% (0.3578 => 0.3404, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -4.83% (0.3646 => 0.3470, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -4.78% (0.3663 => 0.3488, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.74% (0.3650 => 0.3477, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/property: -4.44% (0.3940 => 0.3765, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -4.30% (0.3789 => 0.3626, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions: -4.27% (0.3914 => 0.3747, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -4.17% (0.4003 => 0.3836, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: -2.77% (0.6250 => 0.6077, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.42% (0.6576 => 0.6417, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.26% (0.8818 => 0.8619, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: -1.91% (0.5748 => 0.5638, std. dev.: 0.0003) MultiSource/Applications/lua/lua: -1.23% (3.7467 => 3.7008, std. dev.: 0.0011) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.14% (1.0460 => 0.9504, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.91% (1.3780 => 1.3104, std. dev.: 0.0071) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9623, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -4.01% (2.5089 => 2.4083, std. dev.: 0.0014) MultiSource/Benchmarks/Olden/bh/bh: -3.70% (1.9762 => 1.9031, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.64% (0.3458 => 0.3332, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.45% (20.3410 => 19.8429, std. dev.: 0.0543) SingleSource/Benchmarks/Shootout/lists: -2.13% (6.3560 => 6.2207, std. dev.: 0.0096) SingleSource/Benchmarks/Misc/richards_benchmark: -2.13% (1.1560 => 1.1314, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: -2.05% (9.3358 => 9.1443, std. dev.: 0.0128) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.94% (6.6320 => 6.5033, std. dev.: 0.0049) MultiSource/Benchmarks/mafft/pairlocalalign: -1.84% (28.2225 => 27.7031, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3446, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9952, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) MultiSource/Applications/lua/lua: -1.50% (26.5159 => 26.1175, std. dev.: 0.0093) SingleSource/Benchmarks/Shootout/heapsort: -1.49% (3.9173 => 3.8589, std. dev.: 0.0054) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.40% (8.8259 => 8.7023, std. dev.: 0.0029) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.38s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue May 29 02:53:23 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 29 May 2012 04:53:23 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120529095323.686532A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/834?compare_to=833&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 834, Order: 157602, Start Time: 2012-05-29 08:57:51, End Time: 2012-05-29 09:54:25 To: 833, Order: 157601, Start Time: 2012-05-29 07:34:43, End Time: 2012-05-29 08:31:45 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (56 on baseline) Performance Improvements: 0 (41 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (791 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.35% (2.0176 => 2.2668, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.72% (0.3130 => 0.3309, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.26% (0.2721 => 0.2837, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.02% (3.9660 => 4.0856, std. dev.: 0.0029) MultiSource/Benchmarks/nbench/nbench: 2.78% (1.0594 => 1.0888, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.57% (0.6959 => 0.7138, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.50% (0.9199 => 0.9429, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.32% (0.5265 => 0.5387, std. dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 2.29% (13.8202 => 14.1363, std. dev.: 0.0096) MultiSource/Benchmarks/Prolangs-C/football/football: 2.24% (0.8310 => 0.8496, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.12% (1.2193 => 1.2452, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.04% (0.5637 => 0.5752, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.02% (1.1364 => 1.1593, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.01% (0.7710 => 0.7865, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.77% (1.3245 => 1.3479, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.76% (1.4563 => 1.4819, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.65% (13.2842 => 13.5034, std. dev.: 0.0030) MultiSource/Applications/siod/siod: 1.55% (2.1791 => 2.2129, std. dev.: 0.0050) MultiSource/Applications/lambda-0_1_3/lambda: 1.51% (0.7038 => 0.7144, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.50% (0.7460 => 0.7572, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/gs/gs: 1.44% (3.8646 => 3.9204, std. dev.: 0.0033) MultiSource/Applications/treecc/treecc: 1.39% (1.9270 => 1.9538, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.36% (1.3813 => 1.4001, std. dev.: 0.0015) MultiSource/Applications/kimwitu++/kc: 1.34% (16.6129 => 16.8357, std. dev.: 0.0065) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.34% (1.3819 => 1.4004, std. dev.: 0.0014) MultiSource/Applications/Burg/burg: 1.32% (1.1061 => 1.1207, std. dev.: 0.0049) MultiSource/Applications/hbd/hbd: 1.29% (1.3693 => 1.3870, std. dev.: 0.0066) MultiSource/Applications/SIBsim4/SIBsim4: 1.18% (1.2749 => 1.2899, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.11% (3.6692 => 3.7098, std. dev.: 0.0084) MultiSource/Applications/JM/lencod/lencod: 1.08% (14.8535 => 15.0134, std. dev.: 0.0044) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.71% (0.4846 => 0.6964, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: 24.95% (1.8175 => 2.2709, std. dev.: 0.0398) SingleSource/Benchmarks/Misc/mandel-2: 7.44% (1.2998 => 1.3965, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.86% (1.5824 => 1.6751, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8146, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.79% (1.9144 => 1.9870, std. dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.67% (1.7688 => 1.8337, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: 3.59% (7.4271 => 7.6934, std. dev.: 0.0072) MultiSource/Applications/hexxagon/hexxagon: 2.98% (12.0921 => 12.4529, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/flops-6: 2.83% (1.9199 => 1.9743, std. dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 2.80% (11.2619 => 11.5776, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.76% (2.8606 => 2.9395, std. dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.53% (7.9275 => 8.1278, std. dev.: 0.0077) MultiSource/Applications/sqlite3/sqlite3: 2.35% (4.5928 => 4.7007, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 1.73% (3.2729 => 3.3296, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.58% (0.8273 => 0.8404, std. dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.43% (8.3908 => 8.5105, std. dev.: 0.0006) MultiSource/Applications/lemon/lemon: 1.40% (1.4298 => 1.4498, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.31% (2.0200 => 2.0464, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.21% (1.9433 => 1.9668, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 1.11% (9.0760 => 9.1768, std. dev.: 0.0009) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -21.92% (0.4657 => 0.3636, std. dev.: 0.0230) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.30% (22.5627 => 20.9167, std. dev.: 0.0088) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.40% (0.2670 => 0.2499, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.04% (0.3511 => 0.3299, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-3: -4.91% (0.3623 => 0.3445, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -4.86% (0.3601 => 0.3426, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.79% (0.3650 => 0.3475, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -4.70% (0.3663 => 0.3491, std. dev.: 0.0022) SingleSource/UnitTests/ObjC/trivial-interface: -4.70% (0.3578 => 0.3410, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-4: -4.69% (0.3646 => 0.3475, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -4.42% (0.3940 => 0.3766, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -4.22% (0.3914 => 0.3749, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -4.20% (0.3789 => 0.3630, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -4.10% (0.4003 => 0.3839, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.80% (0.6576 => 0.6392, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: -2.58% (0.6250 => 0.6089, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.47% (0.8818 => 0.8600, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.72% (0.9108 => 0.8951, std. dev.: 0.0016) MultiSource/Applications/lua/lua: -1.30% (3.7467 => 3.6979, std. dev.: 0.0079) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.14% (1.0460 => 0.9504, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2641, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.14% (1.3780 => 1.3072, std. dev.: 0.0093) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9624, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -4.03% (2.5089 => 2.4077, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.69% (1.9762 => 1.9032, std. dev.: 0.0067) SingleSource/Benchmarks/Shootout/lists: -2.18% (6.3560 => 6.2173, std. dev.: 0.0112) SingleSource/Benchmarks/Misc/richards_benchmark: -2.13% (1.1560 => 1.1314, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: -1.99% (9.3358 => 9.1501, std. dev.: 0.0037) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.90% (6.6320 => 6.5061, std. dev.: 0.0044) MultiSource/Benchmarks/mafft/pairlocalalign: -1.84% (28.2225 => 27.7025, std. dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.81% (20.3410 => 19.9734, std. dev.: 0.0544) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3444, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9953, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.56% (0.9692 => 0.9541, std. dev.: 0.0000) MultiSource/Applications/lua/lua: -1.52% (26.5159 => 26.1141, std. dev.: 0.0121) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.45% (8.8259 => 8.6980, std. dev.: 0.0129) SingleSource/Benchmarks/Shootout/heapsort: -1.33% (3.9173 => 3.8653, std. dev.: 0.0051) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.48s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue May 29 06:54:23 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 29 May 2012 08:54:23 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120529135423.541C92A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/835?compare_to=834&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 835, Order: 157612, Start Time: 2012-05-29 12:58:57, End Time: 2012-05-29 13:55:26 To: 834, Order: 157602, Start Time: 2012-05-29 08:57:51, End Time: 2012-05-29 09:54:25 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (55 on baseline) Performance Improvements: 0 (43 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (790 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.39% (2.0176 => 2.2675, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.13% (0.3130 => 0.3322, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.97% (0.2721 => 0.2829, std. dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.97% (3.9660 => 4.0839, std. dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.67% (0.6959 => 0.7145, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.42% (0.9199 => 0.9422, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.37% (0.5265 => 0.5390, std. dev.: 0.0015) MultiSource/Benchmarks/nbench/nbench: 2.31% (1.0594 => 1.0839, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 2.25% (13.8202 => 14.1307, std. dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/football/football: 2.13% (0.8310 => 0.8487, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.13% (1.1364 => 1.1606, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.13% (0.5637 => 0.5757, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.07% (1.2193 => 1.2446, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.65% (1.3245 => 1.3463, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.62% (1.4563 => 1.4799, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.60% (13.2842 => 13.4972, std. dev.: 0.0157) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.53% (0.7460 => 0.7574, std. dev.: 0.0037) MultiSource/Applications/lambda-0_1_3/lambda: 1.49% (0.7038 => 0.7143, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 1.42% (2.1791 => 2.2101, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/gs/gs: 1.42% (3.8646 => 3.9194, std. dev.: 0.0044) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.36% (1.3819 => 1.4007, std. dev.: 0.0017) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.35% (1.3813 => 1.3999, std. dev.: 0.0005) MultiSource/Applications/treecc/treecc: 1.30% (1.9270 => 1.9520, std. dev.: 0.0053) MultiSource/Applications/hbd/hbd: 1.21% (1.3693 => 1.3859, std. dev.: 0.0019) MultiSource/Applications/kimwitu++/kc: 1.18% (16.6129 => 16.8093, std. dev.: 0.0225) MultiSource/Applications/SIBsim4/SIBsim4: 1.14% (1.2749 => 1.2894, std. dev.: 0.0043) MultiSource/Applications/JM/lencod/lencod: 1.11% (14.8535 => 15.0184, std. dev.: 0.0021) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 23.92% (1.8175 => 2.2522, std. dev.: 0.0191) SingleSource/Benchmarks/Misc/mandel-2: 7.95% (1.2998 => 1.4031, std. dev.: 0.0068) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.91% (1.5824 => 1.6759, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.86% (1.9144 => 1.9883, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: 3.62% (7.4271 => 7.6963, std. dev.: 0.0014) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.56% (1.7688 => 1.8317, std. dev.: 0.0014) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4544, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/flops-6: 2.86% (1.9199 => 1.9748, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 2.79% (11.2619 => 11.5762, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9393, std. dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 2.36% (4.5928 => 4.7014, std. dev.: 0.0022) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.35% (7.9275 => 8.1140, std. dev.: 0.0103) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 1.64% (3.2729 => 3.3266, std. dev.: 0.0015) SingleSource/Benchmarks/Dhrystone/fldry: 1.59% (1.9290 => 1.9597, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/ffbench: 1.58% (0.8273 => 0.8404, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5084, std. dev.: 0.0008) MultiSource/Applications/lemon/lemon: 1.39% (1.4298 => 1.4497, std. dev.: 0.0007) MultiSource/Benchmarks/Olden/bisort/bisort: 1.34% (0.8239 => 0.8349, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 1.31% (5.0168 => 5.0824, std. dev.: 0.0064) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.29% (2.0200 => 2.0461, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.25% (1.9433 => 1.9676, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2135, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 1.13% (9.0760 => 9.1786, std. dev.: 0.0005) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -23.04% (0.4657 => 0.3584, std. dev.: 0.0070) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.30% (22.5627 => 20.9160, std. dev.: 0.0065) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.48% (0.2670 => 0.2497, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.15% (0.3511 => 0.3295, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -5.00% (0.3623 => 0.3442, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.96% (0.3650 => 0.3469, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -4.94% (0.3601 => 0.3423, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -4.83% (0.3663 => 0.3486, std. dev.: 0.0028) SingleSource/UnitTests/ObjC/exceptions-4: -4.83% (0.3646 => 0.3470, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -4.72% (0.3578 => 0.3409, std. dev.: 0.0015) SingleSource/UnitTests/ObjC/property: -4.44% (0.3940 => 0.3765, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -4.33% (0.3789 => 0.3625, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -4.32% (0.3914 => 0.3745, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -4.12% (0.4003 => 0.3838, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.78% (0.6576 => 0.6393, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: -2.67% (0.6250 => 0.6083, std. dev.: 0.0041) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.47% (0.8818 => 0.8600, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: -1.86% (0.5748 => 0.5641, std. dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.67% (0.9108 => 0.8956, std. dev.: 0.0002) MultiSource/Applications/lua/lua: -1.34% (3.7467 => 3.6965, std. dev.: 0.0160) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.14% (1.0460 => 0.9504, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2640, std. dev.: 0.0005) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9624, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.33% (1.3780 => 1.3184, std. dev.: 0.0036) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -4.04% (2.5089 => 2.4076, std. dev.: 0.0008) MultiSource/Benchmarks/Olden/bh/bh: -3.63% (1.9762 => 1.9044, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.59% (0.3458 => 0.3334, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -2.22% (6.3560 => 6.2151, std. dev.: 0.0193) SingleSource/Benchmarks/Misc/richards_benchmark: -2.15% (1.1560 => 1.1311, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: -1.97% (9.3358 => 9.1517, std. dev.: 0.0132) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.95% (20.3410 => 19.9449, std. dev.: 0.0812) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.90% (6.6320 => 6.5058, std. dev.: 0.0053) MultiSource/Benchmarks/mafft/pairlocalalign: -1.85% (28.2225 => 27.7014, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9957, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) MultiSource/Applications/lua/lua: -1.47% (26.5159 => 26.1269, std. dev.: 0.0059) SingleSource/Benchmarks/Shootout/heapsort: -1.46% (3.9173 => 3.8601, std. dev.: 0.0052) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.34% (8.8259 => 8.7080, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.01% (3.8887 => 3.8496, std. dev.: 0.0078) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.17s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue May 29 09:34:26 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 29 May 2012 11:34:26 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120529163426.508A62A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/836?compare_to=835&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 836, Order: 157624, Start Time: 2012-05-29 15:38:56, End Time: 2012-05-29 16:35:27 To: 835, Order: 157612, Start Time: 2012-05-29 12:58:57, End Time: 2012-05-29 13:55:26 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (56 on baseline) Performance Improvements: 0 (44 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 891 (788 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 1.01% (7.9772 => 8.0578, std. dev.: 0.0151) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.41% (2.0176 => 2.2680, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.88% (0.3130 => 0.3314, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.82% (0.2721 => 0.2825, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.97% (3.9660 => 4.0837, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.46% (0.6959 => 0.7130, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.40% (0.9199 => 0.9420, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.34% (0.5265 => 0.5388, std. dev.: 0.0016) MultiSource/Benchmarks/nbench/nbench: 2.28% (1.0594 => 1.0836, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 2.25% (13.8202 => 14.1312, std. dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/football/football: 2.20% (0.8310 => 0.8493, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.10% (1.2193 => 1.2449, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.02% (1.1364 => 1.1594, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.99% (0.5637 => 0.5749, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.71% (1.3245 => 1.3471, std. dev.: 0.0064) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.63% (1.4563 => 1.4801, std. dev.: 0.0029) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.63% (0.7710 => 0.7836, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.61% (13.2842 => 13.4981, std. dev.: 0.0095) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.59% (1.3813 => 1.4033, std. dev.: 0.0027) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.51% (0.7460 => 0.7573, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/gs/gs: 1.50% (3.8646 => 3.9225, std. dev.: 0.0075) MultiSource/Applications/lambda-0_1_3/lambda: 1.48% (0.7038 => 0.7142, std. dev.: 0.0009) MultiSource/Applications/siod/siod: 1.47% (2.1791 => 2.2111, std. dev.: 0.0013) MultiSource/Applications/treecc/treecc: 1.33% (1.9270 => 1.9526, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.32% (1.3819 => 1.4002, std. dev.: 0.0031) MultiSource/Applications/hbd/hbd: 1.26% (1.3693 => 1.3865, std. dev.: 0.0000) MultiSource/Applications/Burg/burg: 1.23% (1.1061 => 1.1197, std. dev.: 0.0008) MultiSource/Applications/kimwitu++/kc: 1.14% (16.6129 => 16.8016, std. dev.: 0.0167) MultiSource/Applications/SIBsim4/SIBsim4: 1.07% (1.2749 => 1.2885, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.06% (3.6692 => 3.7080, std. dev.: 0.0079) MultiSource/Applications/JM/lencod/lencod: 1.05% (14.8535 => 15.0088, std. dev.: 0.0083) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 24.32% (1.8175 => 2.2595, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel-2: 8.72% (1.2998 => 1.4131, std. dev.: 0.0085) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6754, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9877, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.66% (1.7688 => 1.8336, std. dev.: 0.0160) SingleSource/Benchmarks/Misc/salsa20: 3.59% (7.4271 => 7.6937, std. dev.: 0.0034) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4543, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-6: 2.84% (1.9199 => 1.9745, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 2.78% (11.2619 => 11.5755, std. dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.76% (2.8606 => 2.9395, std. dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.44% (7.9275 => 8.1210, std. dev.: 0.0016) MultiSource/Applications/sqlite3/sqlite3: 2.32% (4.5928 => 4.6993, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 1.72% (3.2729 => 3.3291, std. dev.: 0.0021) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.61% (0.8273 => 0.8406, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.41% (1.4298 => 1.4499, std. dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: 1.39% (8.3908 => 8.5077, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.28% (2.0200 => 2.0459, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.21% (1.9433 => 1.9668, std. dev.: 0.0083) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0054) SingleSource/Benchmarks/Misc/flops: 1.11% (9.0760 => 9.1769, std. dev.: 0.0016) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -20.79% (0.4657 => 0.3689, std. dev.: 0.0093) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.32% (22.5627 => 20.9121, std. dev.: 0.0092) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.48% (0.2670 => 0.2497, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.92% (0.3511 => 0.3303, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: -5.02% (0.3623 => 0.3441, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.96% (0.3650 => 0.3469, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-2: -4.94% (0.3601 => 0.3423, std. dev.: 0.0033) SingleSource/UnitTests/ObjC/exceptions-4: -4.80% (0.3646 => 0.3471, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -4.78% (0.3578 => 0.3407, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -4.61% (0.3663 => 0.3494, std. dev.: 0.0058) SingleSource/UnitTests/ObjC/property: -4.47% (0.3940 => 0.3764, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -4.30% (0.3789 => 0.3626, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -4.27% (0.3914 => 0.3747, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -4.17% (0.4003 => 0.3836, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: -2.78% (0.6250 => 0.6076, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.74% (0.6576 => 0.6396, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.46% (0.8818 => 0.8601, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: -1.83% (0.5748 => 0.5643, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.65% (0.9108 => 0.8958, std. dev.: 0.0002) MultiSource/Applications/lua/lua: -1.25% (3.7467 => 3.6999, std. dev.: 0.0154) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.01% (1.9828 => 1.9627, std. dev.: 0.0019) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.13% (1.0460 => 0.9505, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.47% (0.3139 => 0.2936, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.88% (1.3780 => 1.3108, std. dev.: 0.0120) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9623, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.97% (2.5089 => 2.4092, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: -3.63% (1.9762 => 1.9044, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.59% (0.3458 => 0.3334, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -2.12% (1.1560 => 1.1315, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.98% (6.3560 => 6.2300, std. dev.: 0.0049) MultiSource/Applications/minisat/minisat: -1.88% (9.3358 => 9.1599, std. dev.: 0.0364) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.88% (6.6320 => 6.5074, std. dev.: 0.0057) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.84% (20.3410 => 19.9672, std. dev.: 0.0402) MultiSource/Benchmarks/mafft/pairlocalalign: -1.84% (28.2225 => 27.7040, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9953, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) MultiSource/Applications/lua/lua: -1.53% (26.5159 => 26.1102, std. dev.: 0.0190) SingleSource/Benchmarks/Shootout/heapsort: -1.47% (3.9173 => 3.8598, std. dev.: 0.0025) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.28% (8.8259 => 8.7126, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.01% (3.8887 => 3.8494, std. dev.: 0.0052) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.39s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue May 29 10:57:01 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 29 May 2012 12:57:01 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120529175701.52DC42A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/837?compare_to=836&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 837, Order: 157626, Start Time: 2012-05-29 17:01:28, End Time: 2012-05-29 17:58:04 To: 836, Order: 157624, Start Time: 2012-05-29 15:38:56, End Time: 2012-05-29 16:35:27 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (54 on baseline) Performance Improvements: 0 (41 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (793 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.37% (2.0176 => 2.2671, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.81% (0.3130 => 0.3312, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.82% (0.2721 => 0.2825, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.96% (3.9660 => 4.0833, std. dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.79% (0.5265 => 0.5412, std. dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.51% (0.6959 => 0.7134, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.49% (0.9199 => 0.9428, std. dev.: 0.0073) MultiSource/Benchmarks/nbench/nbench: 2.36% (1.0594 => 1.0844, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 2.32% (13.8202 => 14.1411, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/football/football: 2.21% (0.8310 => 0.8494, std. dev.: 0.0018) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.05% (1.1364 => 1.1597, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.03% (1.2193 => 1.2441, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.00% (0.5637 => 0.5750, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.77% (1.3245 => 1.3479, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.58% (1.4563 => 1.4793, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.52% (13.2842 => 13.4855, std. dev.: 0.0168) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.50% (1.3819 => 1.4026, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 1.48% (2.1791 => 2.2114, std. dev.: 0.0059) MultiSource/Applications/lambda-0_1_3/lambda: 1.48% (0.7038 => 0.7142, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.46% (0.7460 => 0.7569, std. dev.: 0.0016) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.44% (1.3813 => 1.4012, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/gs/gs: 1.42% (3.8646 => 3.9193, std. dev.: 0.0022) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.37% (0.7710 => 0.7816, std. dev.: 0.0040) MultiSource/Applications/treecc/treecc: 1.29% (1.9270 => 1.9519, std. dev.: 0.0047) MultiSource/Applications/Burg/burg: 1.24% (1.1061 => 1.1198, std. dev.: 0.0035) MultiSource/Applications/JM/lencod/lencod: 1.21% (14.8535 => 15.0325, std. dev.: 0.0090) MultiSource/Applications/SIBsim4/SIBsim4: 1.17% (1.2749 => 1.2898, std. dev.: 0.0013) MultiSource/Applications/kimwitu++/kc: 1.14% (16.6129 => 16.8030, std. dev.: 0.0041) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/fbench: 23.97% (1.8175 => 2.2532, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/mandel-2: 7.79% (1.2998 => 1.4010, std. dev.: 0.0126) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.92% (1.5824 => 1.6761, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8143, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9881, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.69% (1.7688 => 1.8340, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: 3.54% (7.4271 => 7.6903, std. dev.: 0.0045) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4552, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-6: 2.81% (1.9199 => 1.9739, std. dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 2.80% (11.2619 => 11.5775, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.77% (2.8606 => 2.9397, std. dev.: 0.0018) MultiSource/Applications/sqlite3/sqlite3: 2.38% (4.5928 => 4.7023, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.23% (7.9275 => 8.1041, std. dev.: 0.0072) MultiSource/Applications/siod/siod: 1.74% (3.2729 => 3.3297, std. dev.: 0.0063) SingleSource/Benchmarks/Misc/ffbench: 1.61% (0.8273 => 0.8406, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.60% (1.9290 => 1.9599, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5098, std. dev.: 0.0029) MultiSource/Applications/lemon/lemon: 1.37% (1.4298 => 1.4494, std. dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.28% (1.9433 => 1.9682, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.28% (2.0200 => 2.0458, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1780, std. dev.: 0.0009) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.27% (22.5627 => 20.9232, std. dev.: 0.0196) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.44% (0.2670 => 0.2498, std. dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.18% (0.3511 => 0.3294, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -4.92% (0.3601 => 0.3424, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.85% (0.3650 => 0.3473, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: -4.84% (0.3578 => 0.3405, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: -4.83% (0.3623 => 0.3448, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -4.78% (0.3663 => 0.3488, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-4: -4.74% (0.3646 => 0.3473, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: -4.47% (0.3940 => 0.3764, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -4.30% (0.3789 => 0.3626, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: -4.16% (0.3914 => 0.3751, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/parameter-passing: -3.97% (0.4003 => 0.3844, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.89% (0.6576 => 0.6386, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/bigfib: -2.64% (0.6250 => 0.6085, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.51% (0.8818 => 0.8597, std. dev.: 0.0015) SingleSource/UnitTests/ObjC++/Hello: -1.93% (0.5748 => 0.5637, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.78% (0.9108 => 0.8946, std. dev.: 0.0004) MultiSource/Applications/lua/lua: -1.33% (3.7467 => 3.6967, std. dev.: 0.0028) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.14% (1.0460 => 0.9504, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2650, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.93% (1.3780 => 1.3100, std. dev.: 0.0044) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9623, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -4.01% (2.5089 => 2.4083, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.66% (1.9762 => 1.9039, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: -2.14% (1.1560 => 1.1313, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -2.04% (6.3560 => 6.2264, std. dev.: 0.0026) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.87% (6.6320 => 6.5082, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: -1.85% (9.3358 => 9.1629, std. dev.: 0.0105) MultiSource/Benchmarks/mafft/pairlocalalign: -1.85% (28.2225 => 27.7012, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3446, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.66% (20.3410 => 20.0028, std. dev.: 0.0133) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9954, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.60% (8.8259 => 8.6847, std. dev.: 0.0266) SingleSource/Benchmarks/Shootout/heapsort: -1.58% (3.9173 => 3.8554, std. dev.: 0.0065) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) MultiSource/Applications/lua/lua: -1.46% (26.5159 => 26.1284, std. dev.: 0.0065) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.39s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue May 29 12:19:52 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 29 May 2012 14:19:52 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120529191952.1D89B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/838?compare_to=837&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 838, Order: 157630, Start Time: 2012-05-29 18:24:04, End Time: 2012-05-29 19:20:54 To: 837, Order: 157626, Start Time: 2012-05-29 17:01:28, End Time: 2012-05-29 17:58:04 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (52 on baseline) Performance Improvements: 0 (43 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 891 (793 on baseline) Total Tests: 892 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 1.29% (7.9494 => 8.0517, std. dev.: 0.0053) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 11.62% (2.0176 => 2.2521, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.65% (0.3130 => 0.3307, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.71% (0.2721 => 0.2822, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.71% (3.9660 => 4.0735, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.31% (0.6959 => 0.7120, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.22% (0.9199 => 0.9403, std. dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.15% (0.5265 => 0.5378, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 2.11% (0.8310 => 0.8485, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 2.08% (1.0594 => 1.0814, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 2.01% (13.8202 => 14.0984, std. dev.: 0.0135) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.95% (1.1364 => 1.1586, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.90% (1.2193 => 1.2425, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.81% (0.5637 => 0.5739, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.53% (1.3245 => 1.3447, std. dev.: 0.0067) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.52% (0.7710 => 0.7827, std. dev.: 0.0036) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.50% (1.4563 => 1.4782, std. dev.: 0.0015) MultiSource/Applications/siod/siod: 1.44% (2.1791 => 2.2105, std. dev.: 0.0039) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.34% (0.7460 => 0.7560, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.30% (13.2842 => 13.4571, std. dev.: 0.0059) MultiSource/Benchmarks/MallocBench/gs/gs: 1.24% (3.8646 => 3.9127, std. dev.: 0.0019) MultiSource/Applications/treecc/treecc: 1.19% (1.9270 => 1.9499, std. dev.: 0.0010) MultiSource/Applications/Burg/burg: 1.18% (1.1061 => 1.1192, std. dev.: 0.0044) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.15% (1.3819 => 1.3978, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.14% (1.3813 => 1.3971, std. dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: 1.08% (16.6129 => 16.7918, std. dev.: 0.0094) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 24.27% (1.8175 => 2.2586, std. dev.: 0.0490) SingleSource/Benchmarks/Misc/mandel-2: 8.58% (1.2998 => 1.4113, std. dev.: 0.0043) SingleSource/Benchmarks/Misc/flops-4: 6.52% (1.0640 => 1.1334, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6754, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8143, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.87% (1.9144 => 1.9885, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: 3.64% (7.4271 => 7.6975, std. dev.: 0.0069) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.63% (1.7688 => 1.8330, std. dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 2.98% (12.0921 => 12.4519, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/flops-6: 2.86% (1.9199 => 1.9748, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 2.79% (11.2619 => 11.5762, std. dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9392, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.59% (7.9275 => 8.1326, std. dev.: 0.0050) MultiSource/Applications/sqlite3/sqlite3: 2.31% (4.5928 => 4.6987, std. dev.: 0.0069) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 1.70% (3.2729 => 3.3284, std. dev.: 0.0017) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/ffbench: 1.58% (0.8273 => 0.8404, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.41% (1.4298 => 1.4500, std. dev.: 0.0015) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5086, std. dev.: 0.0025) MultiSource/Benchmarks/Olden/bisort/bisort: 1.26% (0.8239 => 0.8343, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.25% (2.0200 => 2.0453, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.21% (1.9433 => 1.9668, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1780, std. dev.: 0.0017) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.44% (22.5627 => 20.8840, std. dev.: 0.0184) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.67% (0.2670 => 0.2492, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.12% (0.3511 => 0.3296, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -5.35% (0.3623 => 0.3429, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.26% (0.3650 => 0.3458, std. dev.: 0.0022) SingleSource/UnitTests/ObjC/trivial-interface: -5.14% (0.3578 => 0.3394, std. dev.: 0.0027) SingleSource/UnitTests/ObjC/synchronized: -5.11% (0.3663 => 0.3476, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: -5.07% (0.3646 => 0.3461, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -5.05% (0.3601 => 0.3419, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/property: -4.62% (0.3940 => 0.3758, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -4.55% (0.3914 => 0.3736, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: -4.50% (0.4003 => 0.3823, std. dev.: 0.0015) SingleSource/UnitTests/ObjC/for-in: -4.49% (0.3789 => 0.3619, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: -2.88% (0.6250 => 0.6070, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.72% (0.6576 => 0.6397, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.62% (0.8818 => 0.8587, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: -1.88% (0.5748 => 0.5640, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.82% (0.9108 => 0.8942, std. dev.: 0.0001) MultiSource/Applications/lua/lua: -1.55% (3.7467 => 3.6888, std. dev.: 0.0058) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.12% (6.2785 => 6.2080, std. dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.04% (1.9828 => 1.9621, std. dev.: 0.0013) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.14% (1.0460 => 0.9504, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.32% (1.3780 => 1.3047, std. dev.: 0.0063) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9624, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -4.00% (2.5089 => 2.4085, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: -3.68% (1.9762 => 1.9034, std. dev.: 0.0040) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.59% (0.3458 => 0.3334, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -2.16% (1.1560 => 1.1310, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -2.16% (6.3560 => 6.2186, std. dev.: 0.0143) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.94% (6.6320 => 6.5034, std. dev.: 0.0057) MultiSource/Applications/minisat/minisat: -1.89% (9.3358 => 9.1594, std. dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: -1.84% (28.2225 => 27.7026, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9955, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.60% (20.3410 => 20.0164, std. dev.: 0.0346) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) MultiSource/Applications/lua/lua: -1.52% (26.5159 => 26.1126, std. dev.: 0.0593) SingleSource/Benchmarks/Shootout/heapsort: -1.51% (3.9173 => 3.8581, std. dev.: 0.0151) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.28% (8.8259 => 8.7126, std. dev.: 0.0063) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.54s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue May 29 13:42:41 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 29 May 2012 15:42:41 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120529204241.36B322A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/839?compare_to=838&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 839, Order: 157638, Start Time: 2012-05-29 19:47:02, End Time: 2012-05-29 20:43:44 To: 838, Order: 157630, Start Time: 2012-05-29 18:24:04, End Time: 2012-05-29 19:20:54 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== New Failures: 1 (1 on baseline) Performance Regressions: 0 (43 on baseline) Performance Improvements: 0 (42 on baseline) Added Tests: 1 (5 on baseline) Unchanged Tests: 892 (803 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/tscp181/tscp181 Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/tscp181/tscp181 ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/tscp181/tscp181 Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 11.93% (2.0176 => 2.2584, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.34% (0.3130 => 0.3297, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.61% (3.9660 => 4.0697, std. dev.: 0.0068) MultiSource/Benchmarks/nbench/nbench: 2.09% (1.0594 => 1.0815, std. dev.: 0.0033) MultiSource/Applications/SPASS/SPASS: 2.09% (13.8202 => 14.1084, std. dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.08% (0.9199 => 0.9390, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 1.98% (0.5265 => 0.5369, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.97% (0.6959 => 0.7096, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.86% (1.2193 => 1.2420, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 1.83% (0.8310 => 0.8462, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.81% (1.1364 => 1.1570, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.62% (0.7710 => 0.7835, std. dev.: 0.0037) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.44% (1.4563 => 1.4772, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.38% (1.3245 => 1.3428, std. dev.: 0.0063) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.33% (1.3819 => 1.4003, std. dev.: 0.0017) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.27% (1.3813 => 1.3988, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.18% (13.2842 => 13.4404, std. dev.: 0.0093) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 23.89% (1.8175 => 2.2517, std. dev.: 0.0052) SingleSource/Benchmarks/Misc/mandel-2: 8.34% (1.2998 => 1.4082, std. dev.: 0.0110) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.85% (1.5824 => 1.6749, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8148, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.79% (1.9144 => 1.9870, std. dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.54% (1.7688 => 1.8315, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/salsa20: 3.46% (7.4271 => 7.6838, std. dev.: 0.0088) MultiSource/Applications/hexxagon/hexxagon: 3.01% (12.0921 => 12.4565, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: 2.93% (1.9199 => 1.9762, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 2.80% (11.2619 => 11.5767, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9394, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.43% (7.9275 => 8.1199, std. dev.: 0.0121) MultiSource/Applications/sqlite3/sqlite3: 2.38% (4.5928 => 4.7021, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 1.77% (3.2729 => 3.3307, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/ffbench: 1.63% (0.8273 => 0.8408, std. dev.: 0.0014) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0009) MultiSource/Applications/lemon/lemon: 1.45% (1.4298 => 1.4506, std. dev.: 0.0007) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5095, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.30% (2.0200 => 2.0463, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.21% (1.9433 => 1.9668, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2135, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 1.11% (9.0760 => 9.1763, std. dev.: 0.0011) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -17.44% (0.4657 => 0.3845, std. dev.: 0.0277) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.63% (22.5627 => 20.8409, std. dev.: 0.0133) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.74% (0.2670 => 0.2490, std. dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.58% (0.3511 => 0.3280, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-3: -4.58% (0.3623 => 0.3457, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.49% (0.3650 => 0.3486, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -4.42% (0.3601 => 0.3442, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -4.33% (0.3578 => 0.3423, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: -4.31% (0.3646 => 0.3489, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -4.21% (0.3940 => 0.3774, std. dev.: 0.0021) SingleSource/UnitTests/ObjC/synchronized: -4.20% (0.3663 => 0.3509, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -3.93% (0.3914 => 0.3760, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/parameter-passing: -3.92% (0.4003 => 0.3846, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: -3.91% (0.3789 => 0.3641, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.42% (0.6576 => 0.6351, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.78% (0.8818 => 0.8573, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/bigfib: -2.74% (0.6250 => 0.6079, std. dev.: 0.0013) MultiSource/Applications/lua/lua: -1.80% (3.7467 => 3.6794, std. dev.: 0.0054) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.11% (6.2785 => 6.2090, std. dev.: 0.0048) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.13% (1.0460 => 0.9505, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.97% (1.3780 => 1.3095, std. dev.: 0.0024) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9624, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -4.05% (2.5089 => 2.4074, std. dev.: 0.0013) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.73% (0.3458 => 0.3329, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: -3.64% (1.9762 => 1.9042, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -2.17% (6.3560 => 6.2180, std. dev.: 0.0143) SingleSource/Benchmarks/Misc/richards_benchmark: -2.12% (1.1560 => 1.1315, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.00% (20.3410 => 19.9340, std. dev.: 0.0395) MultiSource/Applications/minisat/minisat: -1.95% (9.3358 => 9.1536, std. dev.: 0.0177) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.87% (6.6320 => 6.5077, std. dev.: 0.0046) MultiSource/Benchmarks/mafft/pairlocalalign: -1.84% (28.2225 => 27.7028, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9953, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.44% (3.9173 => 3.8607, std. dev.: 0.0177) MultiSource/Applications/lua/lua: -1.43% (26.5159 => 26.1358, std. dev.: 0.0127) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.38% (8.8259 => 8.7045, std. dev.: 0.0138) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.06% (3.8887 => 3.8473, std. dev.: 0.0015) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/tscp181/tscp181 SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.49s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue May 29 15:05:15 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 29 May 2012 17:05:15 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120529220515.E92552A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/840?compare_to=839&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 840, Order: 157644, Start Time: 2012-05-29 21:09:42, End Time: 2012-05-29 22:06:19 To: 839, Order: 157638, Start Time: 2012-05-29 19:47:02, End Time: 2012-05-29 20:43:44 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== New Failures: 0 (1 on baseline) Performance Regressions: 0 (44 on baseline) Performance Improvements: 0 (43 on baseline) Added Tests: 0 (5 on baseline) Existing Failures: 1 (0 on baseline) Unchanged Tests: 893 (801 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Execution Time ---------------------------------- MultiSource/Benchmarks/tscp181/tscp181 ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/tscp181/tscp181 Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 11.98% (2.0176 => 2.2593, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.34% (0.3130 => 0.3297, std. dev.: 0.0016) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.64% (3.9660 => 4.0709, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.10% (0.9199 => 0.9392, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 2.08% (1.0594 => 1.0814, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 1.95% (13.8202 => 14.0896, std. dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.94% (0.6959 => 0.7094, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 1.88% (0.8310 => 0.8466, std. dev.: 0.0032) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.85% (1.1364 => 1.1574, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.85% (1.2193 => 1.2418, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.79% (0.5637 => 0.5738, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.43% (1.3245 => 1.3435, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.34% (13.2842 => 13.4617, std. dev.: 0.0157) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.28% (1.4563 => 1.4749, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.17% (1.3813 => 1.3974, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.13% (1.3819 => 1.3975, std. dev.: 0.0015) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 23.83% (1.8175 => 2.2506, std. dev.: 0.0297) SingleSource/Benchmarks/Misc/mandel-2: 7.62% (1.2998 => 1.3989, std. dev.: 0.0066) SingleSource/Benchmarks/Misc/flops-4: 6.52% (1.0640 => 1.1334, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6755, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8143, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9882, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.74% (1.7688 => 1.8350, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/salsa20: 3.66% (7.4271 => 7.6986, std. dev.: 0.0044) MultiSource/Applications/hexxagon/hexxagon: 2.98% (12.0921 => 12.4528, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-6: 2.88% (1.9199 => 1.9751, std. dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 2.81% (11.2619 => 11.5784, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9392, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.60% (7.9275 => 8.1334, std. dev.: 0.0052) MultiSource/Applications/sqlite3/sqlite3: 2.35% (4.5928 => 4.7006, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 1.72% (3.2729 => 3.3292, std. dev.: 0.0072) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.60% (0.8273 => 0.8405, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5093, std. dev.: 0.0006) MultiSource/Applications/lemon/lemon: 1.38% (1.4298 => 1.4495, std. dev.: 0.0017) MultiSource/Benchmarks/sim/sim: 1.28% (5.0168 => 5.0812, std. dev.: 0.0053) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.27% (2.0200 => 2.0457, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.20% (1.9433 => 1.9666, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/flops: 1.13% (9.0760 => 9.1788, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 1.10% (1.2308 => 1.2443, std. dev.: 0.0009) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -21.69% (0.4657 => 0.3647, std. dev.: 0.0122) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.65% (22.5627 => 20.8359, std. dev.: 0.0069) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.70% (0.2670 => 0.2491, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.35% (0.3511 => 0.3288, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-2: -5.19% (0.3601 => 0.3414, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.18% (0.3650 => 0.3461, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-3: -5.16% (0.3623 => 0.3436, std. dev.: 0.0027) SingleSource/UnitTests/ObjC/trivial-interface: -5.03% (0.3578 => 0.3398, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -5.02% (0.3646 => 0.3463, std. dev.: 0.0069) SingleSource/UnitTests/ObjC/synchronized: -4.97% (0.3663 => 0.3481, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -4.80% (0.3940 => 0.3751, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -4.52% (0.3914 => 0.3737, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -4.47% (0.4003 => 0.3824, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -4.43% (0.3789 => 0.3621, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.25% (0.6576 => 0.6362, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: -2.75% (0.6250 => 0.6078, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.70% (0.8818 => 0.8580, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -2.05% (0.9108 => 0.8921, std. dev.: 0.0008) MultiSource/Applications/lua/lua: -1.80% (3.7467 => 3.6794, std. dev.: 0.0062) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.15% (6.2785 => 6.2062, std. dev.: 0.0017) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.13% (1.0460 => 0.9505, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.44% (0.3139 => 0.2937, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.79% (1.3780 => 1.3120, std. dev.: 0.0051) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9621, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0010) SingleSource/Benchmarks/Dhrystone/dry: -4.00% (2.5089 => 2.4086, std. dev.: 0.0012) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.76% (0.3458 => 0.3328, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -3.70% (1.9762 => 1.9030, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/richards_benchmark: -2.16% (1.1560 => 1.1310, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -2.15% (6.3560 => 6.2192, std. dev.: 0.0061) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.12% (20.3410 => 19.9103, std. dev.: 0.0519) MultiSource/Applications/minisat/minisat: -2.01% (9.3358 => 9.1478, std. dev.: 0.0445) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.97% (6.6320 => 6.5015, std. dev.: 0.0038) MultiSource/Benchmarks/mafft/pairlocalalign: -1.85% (28.2225 => 27.7007, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3446, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9952, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/heapsort: -1.59% (3.9173 => 3.8550, std. dev.: 0.0045) MultiSource/Applications/lua/lua: -1.59% (26.5159 => 26.0956, std. dev.: 0.0178) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.55% (8.8259 => 8.6888, std. dev.: 0.0282) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.01% (3.8887 => 3.8495, std. dev.: 0.0050) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/tscp181/tscp181 SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.50s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue May 29 16:27:38 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 29 May 2012 18:27:38 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120529232738.5C7092A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/841?compare_to=840&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 841, Order: 157646, Start Time: 2012-05-29 22:32:14, End Time: 2012-05-29 23:28:41 To: 840, Order: 157644, Start Time: 2012-05-29 21:09:42, End Time: 2012-05-29 22:06:19 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== New Passes: 1 (0 on baseline) Performance Regressions: 0 (46 on baseline) Performance Improvements: 0 (42 on baseline) Removed Tests: 1 (0 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (802 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== New Passes - Execution Time --------------------------- MultiSource/Benchmarks/tscp181/tscp181 Removed Tests - Compile Time ---------------------------- MultiSource/Benchmarks/tscp181/tscp181 ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 11.96% (2.0176 => 2.2589, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.43% (0.3130 => 0.3300, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.64% (3.9660 => 4.0706, std. dev.: 0.0109) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.56% (0.5265 => 0.5400, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.52% (0.9199 => 0.9431, std. dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.27% (0.6959 => 0.7117, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 2.03% (1.0594 => 1.0809, std. dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 1.98% (13.8202 => 14.0940, std. dev.: 0.0143) MultiSource/Benchmarks/Prolangs-C/football/football: 1.96% (0.8310 => 0.8473, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.90% (1.2193 => 1.2425, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.88% (1.1364 => 1.1578, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.84% (0.5637 => 0.5741, std. dev.: 0.0015) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.56% (0.7710 => 0.7830, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.43% (1.3245 => 1.3434, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.35% (1.4563 => 1.4759, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.25% (13.2842 => 13.4504, std. dev.: 0.0064) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.21% (1.3813 => 1.3980, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.13% (1.3819 => 1.3975, std. dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 24.47% (1.8175 => 2.2623, std. dev.: 0.0455) SingleSource/Benchmarks/Misc/mandel-2: 8.37% (1.2998 => 1.4086, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7295, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.90% (1.5824 => 1.6757, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.81% (1.9144 => 1.9873, std. dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.75% (1.7688 => 1.8352, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/salsa20: 3.63% (7.4271 => 7.6968, std. dev.: 0.0017) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4548, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-6: 2.89% (1.9199 => 1.9753, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 2.80% (11.2619 => 11.5775, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.76% (2.8606 => 2.9395, std. dev.: 0.0025) MultiSource/Applications/sqlite3/sqlite3: 2.36% (4.5928 => 4.7014, std. dev.: 0.0085) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.08% (7.9275 => 8.0923, std. dev.: 0.0173) MultiSource/Applications/siod/siod: 1.73% (3.2729 => 3.3296, std. dev.: 0.0024) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9603, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/ffbench: 1.55% (0.8273 => 0.8401, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: 1.43% (1.4298 => 1.4502, std. dev.: 0.0009) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5090, std. dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.34% (2.0200 => 2.0470, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.26% (1.9433 => 1.9678, std. dev.: 0.0027) SingleSource/Benchmarks/McGill/chomp: 1.23% (1.2308 => 1.2460, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1772, std. dev.: 0.0017) MultiSource/Benchmarks/sim/sim: 1.01% (5.0168 => 5.0677, std. dev.: 0.0139) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -21.43% (0.4657 => 0.3659, std. dev.: 0.0098) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.59% (22.5627 => 20.8503, std. dev.: 0.0151) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.78% (0.2670 => 0.2489, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.55% (0.3511 => 0.3281, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.63% (0.3650 => 0.3481, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -4.61% (0.3623 => 0.3456, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: -4.44% (0.3578 => 0.3419, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -4.39% (0.3646 => 0.3486, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -4.33% (0.3601 => 0.3445, std. dev.: 0.0019) SingleSource/UnitTests/ObjC/synchronized: -4.31% (0.3663 => 0.3505, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -4.14% (0.3940 => 0.3777, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -4.02% (0.4003 => 0.3842, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -3.99% (0.3914 => 0.3758, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -3.80% (0.3789 => 0.3645, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.30% (0.6576 => 0.6359, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.76% (0.8818 => 0.8575, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: -2.59% (0.6250 => 0.6088, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: -2.00% (0.9108 => 0.8926, std. dev.: 0.0001) MultiSource/Applications/lua/lua: -1.75% (3.7467 => 3.6812, std. dev.: 0.0042) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.15% (6.2785 => 6.2063, std. dev.: 0.0088) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.13% (1.0460 => 0.9505, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-3: -6.21% (2.4152 => 2.2653, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.99% (1.3780 => 1.3093, std. dev.: 0.0079) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9622, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.99% (2.5089 => 2.4087, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.73% (0.3458 => 0.3329, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.68% (1.9762 => 1.9035, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/richards_benchmark: -2.15% (1.1560 => 1.1311, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -2.13% (6.3560 => 6.2203, std. dev.: 0.0113) MultiSource/Applications/minisat/minisat: -2.00% (9.3358 => 9.1492, std. dev.: 0.0127) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.91% (6.6320 => 6.5056, std. dev.: 0.0018) MultiSource/Benchmarks/mafft/pairlocalalign: -1.84% (28.2225 => 27.7018, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9959, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) MultiSource/Applications/lua/lua: -1.54% (26.5159 => 26.1064, std. dev.: 0.0153) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.52% (20.3410 => 20.0328, std. dev.: 0.0067) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.47% (8.8259 => 8.6962, std. dev.: 0.0171) SingleSource/Benchmarks/Shootout/heapsort: -1.32% (3.9173 => 3.8654, std. dev.: 0.0169) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.44s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue May 29 17:50:12 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 29 May 2012 19:50:12 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120530005012.2A1A72A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/842?compare_to=841&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 842, Order: 157649, Start Time: 2012-05-29 23:54:37, End Time: 2012-05-30 00:51:15 To: 841, Order: 157646, Start Time: 2012-05-29 22:32:14, End Time: 2012-05-29 23:28:41 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (48 on baseline) Performance Improvements: 0 (42 on baseline) Added Tests: 2 (6 on baseline) Unchanged Tests: 892 (798 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/tscp181/tscp181 Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/tscp181/tscp181 ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 11.50% (2.0176 => 2.2496, std. dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.34% (0.3130 => 0.3297, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.68% (0.2721 => 0.2821, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.67% (3.9660 => 4.0717, std. dev.: 0.0039) MultiSource/Benchmarks/nbench/nbench: 2.17% (1.0594 => 1.0824, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.13% (0.6959 => 0.7107, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.10% (0.9199 => 0.9392, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.07% (0.5265 => 0.5374, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 2.07% (0.8310 => 0.8482, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 2.01% (13.8202 => 14.0983, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.89% (1.2193 => 1.2424, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.79% (0.5637 => 0.5738, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.79% (1.1364 => 1.1567, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.46% (1.3245 => 1.3438, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.20% (13.2842 => 13.4438, std. dev.: 0.0199) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.19% (1.4563 => 1.4736, std. dev.: 0.0014) MultiSource/Applications/siod/siod: 1.10% (2.1791 => 2.2030, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: 1.09% (3.8646 => 3.9067, std. dev.: 0.0026) MultiSource/Applications/kimwitu++/kc: 1.05% (16.6129 => 16.7874, std. dev.: 0.0039) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.03% (1.3819 => 1.3962, std. dev.: 0.0005) MultiSource/Applications/treecc/treecc: 1.03% (1.9270 => 1.9469, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.01% (1.3813 => 1.3953, std. dev.: 0.0030) MultiSource/Applications/Burg/burg: 1.01% (1.1061 => 1.1173, std. dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 23.74% (1.8175 => 2.2489, std. dev.: 0.0497) SingleSource/Benchmarks/Misc/mandel-2: 8.04% (1.2998 => 1.4043, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7298, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6754, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8143, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.79% (1.9144 => 1.9869, std. dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.61% (1.7688 => 1.8327, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: 3.52% (7.4271 => 7.6887, std. dev.: 0.0073) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4533, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-6: 2.89% (1.9199 => 1.9753, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 2.81% (11.2619 => 11.5785, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.76% (2.8606 => 2.9395, std. dev.: 0.0017) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.44% (7.9275 => 8.1207, std. dev.: 0.0148) MultiSource/Applications/sqlite3/sqlite3: 2.36% (4.5928 => 4.7012, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 1.66% (3.2729 => 3.3273, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/ffbench: 1.56% (0.8273 => 0.8402, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: 1.41% (1.4298 => 1.4500, std. dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5084, std. dev.: 0.0037) SingleSource/Benchmarks/Dhrystone/fldry: 1.36% (1.9290 => 1.9552, std. dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.28% (2.0200 => 2.0459, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/flops: 1.10% (9.0760 => 9.1762, std. dev.: 0.0010) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.58% (22.5627 => 20.8535, std. dev.: 0.0066) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.58% (0.3511 => 0.3280, std. dev.: 0.0065) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.55% (0.2670 => 0.2495, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -5.08% (0.3623 => 0.3439, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.07% (0.3650 => 0.3465, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -4.97% (0.3601 => 0.3422, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -4.89% (0.3578 => 0.3403, std. dev.: 0.0035) SingleSource/UnitTests/ObjC/synchronized: -4.89% (0.3663 => 0.3484, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -4.85% (0.3646 => 0.3469, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -4.52% (0.3940 => 0.3762, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -4.41% (0.3789 => 0.3622, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -4.39% (0.3914 => 0.3742, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -4.27% (0.4003 => 0.3832, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.10% (0.6576 => 0.6372, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: -2.75% (0.6250 => 0.6078, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.55% (0.8818 => 0.8593, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.75% (0.9108 => 0.8949, std. dev.: 0.0002) MultiSource/Applications/lua/lua: -1.66% (3.7467 => 3.6846, std. dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.17% (6.2785 => 6.2048, std. dev.: 0.0052) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.13% (1.0460 => 0.9505, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.44% (0.3139 => 0.2937, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.15% (1.3780 => 1.3070, std. dev.: 0.0055) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9622, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -4.01% (2.5089 => 2.4084, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.64% (1.9762 => 1.9043, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/lists: -2.21% (6.3560 => 6.2155, std. dev.: 0.0094) SingleSource/Benchmarks/Misc/richards_benchmark: -2.15% (1.1560 => 1.1311, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.97% (20.3410 => 19.9412, std. dev.: 0.0445) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.93% (6.6320 => 6.5041, std. dev.: 0.0063) MultiSource/Applications/minisat/minisat: -1.89% (9.3358 => 9.1591, std. dev.: 0.0331) MultiSource/Benchmarks/mafft/pairlocalalign: -1.85% (28.2225 => 27.7016, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9950, std. dev.: 0.0004) MultiSource/Applications/lua/lua: -1.59% (26.5159 => 26.0948, std. dev.: 0.0053) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.54% (8.8259 => 8.6896, std. dev.: 0.0252) SingleSource/Benchmarks/Shootout/heapsort: -1.26% (3.9173 => 3.8679, std. dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.08% (3.8887 => 3.8466, std. dev.: 0.0040) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/tscp181/tscp181 SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/tscp181/tscp181 SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.57s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue May 29 19:12:46 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 29 May 2012 21:12:46 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120530021246.AF9CB2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/843?compare_to=842&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 843, Order: 157663, Start Time: 2012-05-30 01:17:19, End Time: 2012-05-30 02:13:49 To: 842, Order: 157649, Start Time: 2012-05-29 23:54:37, End Time: 2012-05-30 00:51:15 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (51 on baseline) Performance Improvements: 0 (40 on baseline) Removed Tests: 2 (0 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (799 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Removed Tests - Compile Time ---------------------------- MultiSource/Benchmarks/tscp181/tscp181 Removed Tests - Execution Time ------------------------------ MultiSource/Benchmarks/tscp181/tscp181 ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.01% (2.0176 => 2.2599, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.17% (0.3130 => 0.3323, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.12% (3.9660 => 4.0898, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.67% (0.6959 => 0.7145, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.65% (0.9199 => 0.9443, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 2.57% (1.0594 => 1.0866, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 2.48% (13.8202 => 14.1625, std. dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.45% (0.5265 => 0.5394, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/football/football: 2.42% (0.8310 => 0.8511, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.39% (1.2193 => 1.2485, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.04% (1.1364 => 1.1596, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.02% (0.5637 => 0.5751, std. dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: 1.82% (0.7038 => 0.7166, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.70% (13.2842 => 13.5099, std. dev.: 0.0010) MultiSource/Applications/siod/siod: 1.68% (2.1791 => 2.2157, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.65% (1.4563 => 1.4803, std. dev.: 0.0017) MultiSource/Benchmarks/MallocBench/gs/gs: 1.63% (3.8646 => 3.9275, std. dev.: 0.0016) MultiSource/Applications/kimwitu++/kc: 1.62% (16.6129 => 16.8815, std. dev.: 0.0096) MultiSource/Applications/treecc/treecc: 1.59% (1.9270 => 1.9576, std. dev.: 0.0093) MultiSource/Applications/hbd/hbd: 1.55% (1.3693 => 1.3905, std. dev.: 0.0036) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.45% (0.7460 => 0.7568, std. dev.: 0.0014) MultiSource/Applications/Burg/burg: 1.45% (1.1061 => 1.1221, std. dev.: 0.0006) MultiSource/Applications/JM/lencod/lencod: 1.30% (14.8535 => 15.0463, std. dev.: 0.0224) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.22% (1.3819 => 1.3988, std. dev.: 0.0036) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.20% (3.6692 => 3.7131, std. dev.: 0.0027) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.93% (0.4846 => 0.6975, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: 24.07% (1.8175 => 2.2550, std. dev.: 0.0248) SingleSource/Benchmarks/Misc/mandel-2: 8.44% (1.2998 => 1.4095, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6754, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8143, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9879, std. dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.67% (1.7688 => 1.8338, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/salsa20: 3.59% (7.4271 => 7.6940, std. dev.: 0.0055) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4537, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: 2.90% (1.9199 => 1.9755, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 2.80% (11.2619 => 11.5776, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.76% (2.8606 => 2.9395, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.55% (7.9275 => 8.1293, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 2.37% (4.5928 => 4.7015, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 1.74% (3.2729 => 3.3300, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/ffbench: 1.56% (0.8273 => 0.8402, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.49% (1.4298 => 1.4511, std. dev.: 0.0048) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5094, std. dev.: 0.0019) SingleSource/Benchmarks/Dhrystone/fldry: 1.38% (1.9290 => 1.9556, std. dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.25% (2.0200 => 2.0453, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.17% (1.9433 => 1.9661, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: 1.11% (9.0760 => 9.1767, std. dev.: 0.0012) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -21.75% (0.4657 => 0.3644, std. dev.: 0.0109) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.12% (0.2670 => 0.2480, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.09% (22.5627 => 20.9627, std. dev.: 0.0166) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.75% (0.3511 => 0.3274, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.44% (0.3650 => 0.3488, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -4.42% (0.3623 => 0.3463, std. dev.: 0.0029) SingleSource/UnitTests/ObjC/exceptions-2: -4.30% (0.3601 => 0.3446, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -4.26% (0.3663 => 0.3507, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -4.22% (0.3578 => 0.3427, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: -4.17% (0.3646 => 0.3494, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -3.91% (0.3940 => 0.3786, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -3.75% (0.3789 => 0.3647, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -3.73% (0.3914 => 0.3768, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: -3.62% (0.4003 => 0.3858, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.55% (0.6576 => 0.6408, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: -2.14% (0.6250 => 0.6116, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.42% (0.9108 => 0.8979, std. dev.: 0.0004) MultiSource/Applications/lua/lua: -1.19% (3.7467 => 3.7021, std. dev.: 0.0030) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.14% (1.0460 => 0.9504, std. dev.: 0.0008) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9625, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.43% (1.3780 => 1.3170, std. dev.: 0.0064) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -4.00% (2.5089 => 2.4086, std. dev.: 0.0010) MultiSource/Benchmarks/Olden/bh/bh: -3.62% (1.9762 => 1.9046, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.59% (0.3458 => 0.3334, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -2.25% (6.3560 => 6.2130, std. dev.: 0.0153) SingleSource/Benchmarks/Misc/richards_benchmark: -2.13% (1.1560 => 1.1314, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.93% (6.6320 => 6.5043, std. dev.: 0.0045) MultiSource/Benchmarks/mafft/pairlocalalign: -1.85% (28.2225 => 27.7006, std. dev.: 0.0016) MultiSource/Applications/minisat/minisat: -1.78% (9.3358 => 9.1699, std. dev.: 0.0083) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.76% (20.3410 => 19.9823, std. dev.: 0.0439) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9953, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.57% (8.8259 => 8.6876, std. dev.: 0.0053) SingleSource/Benchmarks/Shootout/heapsort: -1.49% (3.9173 => 3.8588, std. dev.: 0.0035) MultiSource/Applications/lua/lua: -1.45% (26.5159 => 26.1316, std. dev.: 0.0019) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.60s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue May 29 20:35:11 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 29 May 2012 22:35:11 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120530033511.9EBDC2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/844?compare_to=843&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 844, Order: 157667, Start Time: 2012-05-30 02:39:46, End Time: 2012-05-30 03:36:15 To: 843, Order: 157663, Start Time: 2012-05-30 01:17:19, End Time: 2012-05-30 02:13:49 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (59 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 893 (792 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 1.18% (3.7657 => 3.8101, std. dev.: 0.0157) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.38% (2.0176 => 2.2674, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.20% (0.3130 => 0.3324, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.32% (3.9660 => 4.0978, std. dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.80% (0.6959 => 0.7154, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.77% (0.5265 => 0.5411, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 2.76% (13.8202 => 14.2013, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.75% (0.9199 => 0.9452, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 2.58% (1.0594 => 1.0867, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: 2.52% (0.8310 => 0.8519, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.39% (1.2193 => 1.2485, std. dev.: 0.0006) MultiSource/Applications/Burg/burg: 2.28% (1.1061 => 1.1313, std. dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.24% (0.5637 => 0.5763, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.22% (1.1364 => 1.1616, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.03% (1.3245 => 1.3514, std. dev.: 0.0028) MultiSource/Applications/lambda-0_1_3/lambda: 1.90% (0.7038 => 0.7172, std. dev.: 0.0007) MultiSource/Applications/siod/siod: 1.86% (2.1791 => 2.2196, std. dev.: 0.0030) MultiSource/Applications/kimwitu++/kc: 1.81% (16.6129 => 16.9136, std. dev.: 0.0108) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.81% (1.4563 => 1.4826, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.80% (13.2842 => 13.5234, std. dev.: 0.0088) MultiSource/Applications/hbd/hbd: 1.69% (1.3693 => 1.3925, std. dev.: 0.0028) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.67% (0.7710 => 0.7839, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/gs/gs: 1.65% (3.8646 => 3.9283, std. dev.: 0.0047) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.62% (0.7460 => 0.7581, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 1.56% (1.9270 => 1.9571, std. dev.: 0.0029) MultiSource/Applications/JM/lencod/lencod: 1.32% (14.8535 => 15.0498, std. dev.: 0.0117) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.31% (1.3819 => 1.4000, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.27% (3.6692 => 3.7158, std. dev.: 0.0061) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.24% (1.3813 => 1.3984, std. dev.: 0.0021) MultiSource/Applications/SIBsim4/SIBsim4: 1.22% (1.2749 => 1.2905, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.09% (3.2742 => 3.3100, std. dev.: 0.0045) MultiSource/Applications/sqlite3/sqlite3: 1.07% (16.2614 => 16.4347, std. dev.: 0.0166) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/fbench: 24.08% (1.8175 => 2.2552, std. dev.: 0.0336) SingleSource/Benchmarks/Misc/mandel-2: 7.39% (1.2998 => 1.3959, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6755, std. dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8147, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 3.86% (1.9144 => 1.9883, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.65% (1.7688 => 1.8334, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: 3.58% (7.4271 => 7.6927, std. dev.: 0.0058) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4531, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-6: 2.92% (1.9199 => 1.9759, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 2.80% (11.2619 => 11.5771, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9394, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.50% (7.9275 => 8.1257, std. dev.: 0.0085) MultiSource/Applications/sqlite3/sqlite3: 2.36% (4.5928 => 4.7012, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 1.75% (3.2729 => 3.3302, std. dev.: 0.0063) SingleSource/Benchmarks/Misc/ffbench: 1.62% (0.8273 => 0.8407, std. dev.: 0.0014) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0009) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5094, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 1.36% (5.0168 => 5.0850, std. dev.: 0.0027) MultiSource/Applications/lemon/lemon: 1.34% (1.4298 => 1.4489, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.28% (2.0200 => 2.0459, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.19% (1.9433 => 1.9664, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1776, std. dev.: 0.0011) SingleSource/Benchmarks/McGill/chomp: 1.05% (1.2308 => 1.2437, std. dev.: 0.0029) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.19% (0.2670 => 0.2478, std. dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.85% (22.5627 => 21.0166, std. dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.69% (0.3511 => 0.3276, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.42% (0.3650 => 0.3525, std. dev.: 0.0027) SingleSource/UnitTests/ObjC/exceptions-3: -3.39% (0.3623 => 0.3500, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -3.39% (0.3601 => 0.3479, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -3.24% (0.3578 => 0.3462, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -3.21% (0.3646 => 0.3529, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -2.99% (0.3940 => 0.3822, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -2.80% (0.3789 => 0.3683, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -2.78% (0.3914 => 0.3805, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.78% (0.6576 => 0.6393, std. dev.: 0.0069) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.69% (0.8818 => 0.8581, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: -2.67% (0.4003 => 0.3896, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: -2.08% (0.6250 => 0.6120, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.45% (0.9108 => 0.8976, std. dev.: 0.0004) MultiSource/Applications/lua/lua: -1.12% (3.7467 => 3.7049, std. dev.: 0.0102) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.14% (1.0460 => 0.9504, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.92% (1.3780 => 1.3102, std. dev.: 0.0085) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9623, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -3.99% (2.5089 => 2.4088, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.73% (0.3458 => 0.3329, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.57% (1.9762 => 1.9057, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout/lists: -2.16% (6.3560 => 6.2188, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/richards_benchmark: -2.13% (1.1560 => 1.1314, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: -1.98% (9.3358 => 9.1512, std. dev.: 0.0135) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.92% (20.3410 => 19.9510, std. dev.: 0.0482) MultiSource/Benchmarks/mafft/pairlocalalign: -1.84% (28.2225 => 27.7019, std. dev.: 0.0021) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.82% (6.6320 => 6.5116, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9954, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) MultiSource/Applications/lua/lua: -1.56% (26.5159 => 26.1028, std. dev.: 0.0102) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.39% (8.8259 => 8.7036, std. dev.: 0.0094) SingleSource/Benchmarks/Shootout/heapsort: -1.36% (3.9173 => 3.8639, std. dev.: 0.0026) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.34s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue May 29 22:04:12 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 30 May 2012 00:04:12 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120530050412.D22BB2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/845?compare_to=844&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 845, Order: 157673, Start Time: 2012-05-30 04:08:47, End Time: 2012-05-30 05:05:15 To: 844, Order: 157667, Start Time: 2012-05-30 02:39:46, End Time: 2012-05-30 03:36:15 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (56 on baseline) Performance Improvements: 0 (41 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (793 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.09% (2.0176 => 2.2616, std. dev.: 0.0144) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.13% (0.3130 => 0.3322, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.04% (3.9660 => 4.0867, std. dev.: 0.0099) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.57% (0.6959 => 0.7138, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.57% (0.9199 => 0.9435, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.51% (0.5265 => 0.5397, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 2.48% (13.8202 => 14.1627, std. dev.: 0.0078) MultiSource/Benchmarks/nbench/nbench: 2.40% (1.0594 => 1.0848, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 2.38% (0.8310 => 0.8508, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.11% (0.5637 => 0.5756, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.11% (1.2193 => 1.2450, std. dev.: 0.0087) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.09% (1.1364 => 1.1602, std. dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: 1.92% (0.7038 => 0.7173, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.89% (1.3245 => 1.3495, std. dev.: 0.0048) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.66% (1.4563 => 1.4805, std. dev.: 0.0017) MultiSource/Applications/siod/siod: 1.64% (2.1791 => 2.2149, std. dev.: 0.0015) MultiSource/Applications/kimwitu++/kc: 1.61% (16.6129 => 16.8804, std. dev.: 0.0165) MultiSource/Applications/Burg/burg: 1.61% (1.1061 => 1.1239, std. dev.: 0.0038) MultiSource/Benchmarks/MallocBench/gs/gs: 1.60% (3.8646 => 3.9263, std. dev.: 0.0034) MultiSource/Applications/hbd/hbd: 1.58% (1.3693 => 1.3909, std. dev.: 0.0036) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.51% (13.2842 => 13.4852, std. dev.: 0.0228) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.50% (0.7460 => 0.7572, std. dev.: 0.0008) MultiSource/Applications/treecc/treecc: 1.44% (1.9270 => 1.9547, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.41% (0.7710 => 0.7819, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.31% (1.3819 => 1.4000, std. dev.: 0.0017) MultiSource/Applications/JM/lencod/lencod: 1.15% (14.8535 => 15.0237, std. dev.: 0.0111) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.13% (3.6692 => 3.7107, std. dev.: 0.0094) MultiSource/Applications/SIBsim4/SIBsim4: 1.12% (1.2749 => 1.2892, std. dev.: 0.0007) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 24.06% (1.8175 => 2.2547, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/mandel-2: 6.64% (1.2998 => 1.3861, std. dev.: 0.0128) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6754, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9877, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.64% (1.7688 => 1.8332, std. dev.: 0.0066) SingleSource/Benchmarks/Misc/salsa20: 3.61% (7.4271 => 7.6954, std. dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 3.01% (12.0921 => 12.4559, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: 2.86% (1.9199 => 1.9748, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 2.81% (11.2619 => 11.5780, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9394, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.44% (7.9275 => 8.1209, std. dev.: 0.0113) MultiSource/Applications/sqlite3/sqlite3: 2.38% (4.5928 => 4.7019, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 1.68% (3.2729 => 3.3279, std. dev.: 0.0098) SingleSource/Benchmarks/Misc/ffbench: 1.62% (0.8273 => 0.8407, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5082, std. dev.: 0.0011) MultiSource/Applications/lemon/lemon: 1.39% (1.4298 => 1.4497, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.24% (2.0200 => 2.0450, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.19% (1.9433 => 1.9665, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0036) MultiSource/Benchmarks/sim/sim: 1.12% (5.0168 => 5.0729, std. dev.: 0.0126) SingleSource/Benchmarks/Misc/flops: 1.11% (9.0760 => 9.1771, std. dev.: 0.0015) SingleSource/Benchmarks/McGill/chomp: 1.02% (1.2308 => 1.2433, std. dev.: 0.0016) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -21.99% (0.4657 => 0.3633, std. dev.: 0.0207) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.97% (0.2670 => 0.2484, std. dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.95% (22.5627 => 20.9940, std. dev.: 0.0045) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.69% (0.3511 => 0.3276, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-3: -3.95% (0.3623 => 0.3480, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.92% (0.3650 => 0.3507, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: -3.86% (0.3578 => 0.3440, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -3.77% (0.3663 => 0.3525, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -3.69% (0.3601 => 0.3468, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -3.65% (0.3646 => 0.3513, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -3.48% (0.3940 => 0.3803, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -3.37% (0.3914 => 0.3782, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -3.25% (0.3789 => 0.3666, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.72% (0.8818 => 0.8578, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.33% (0.6576 => 0.6423, std. dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/bigfib: -2.02% (0.6250 => 0.6124, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.53% (0.9108 => 0.8969, std. dev.: 0.0003) MultiSource/Applications/lua/lua: -1.25% (3.7467 => 3.6999, std. dev.: 0.0020) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.12% (1.0460 => 0.9506, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.24% (0.3139 => 0.2943, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.30% (1.3780 => 1.3049, std. dev.: 0.0097) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9622, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -3.98% (2.5089 => 2.4090, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.69% (1.9762 => 1.9032, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/richards_benchmark: -2.15% (1.1560 => 1.1312, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -2.04% (6.3560 => 6.2262, std. dev.: 0.0021) MultiSource/Applications/minisat/minisat: -1.88% (9.3358 => 9.1600, std. dev.: 0.0397) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.86% (6.6320 => 6.5087, std. dev.: 0.0023) MultiSource/Benchmarks/mafft/pairlocalalign: -1.85% (28.2225 => 27.7017, std. dev.: 0.0031) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.72% (20.3410 => 19.9914, std. dev.: 0.0473) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3446, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9958, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) MultiSource/Applications/lua/lua: -1.51% (26.5159 => 26.1167, std. dev.: 0.0157) SingleSource/Benchmarks/Shootout/heapsort: -1.41% (3.9173 => 3.8621, std. dev.: 0.0057) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.35% (8.8259 => 8.7067, std. dev.: 0.0148) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.07% (3.8887 => 3.8472, std. dev.: 0.0055) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.60s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue May 29 23:26:47 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 30 May 2012 01:26:47 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120530062647.2226B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/846?compare_to=845&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 846, Order: 157676, Start Time: 2012-05-30 05:31:21, End Time: 2012-05-30 06:27:50 To: 845, Order: 157673, Start Time: 2012-05-30 04:08:47, End Time: 2012-05-30 05:05:15 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (56 on baseline) Performance Improvements: 0 (41 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (793 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 11.99% (2.0176 => 2.2596, std. dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.23% (0.3130 => 0.3325, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.07% (3.9660 => 4.0878, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.57% (0.6959 => 0.7138, std. dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 2.55% (13.8202 => 14.1732, std. dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.52% (0.9199 => 0.9431, std. dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.49% (0.5265 => 0.5396, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 2.38% (1.0594 => 1.0846, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 2.31% (0.8310 => 0.8502, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.17% (1.2193 => 1.2457, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.11% (1.1364 => 1.1604, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.09% (0.5637 => 0.5755, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.86% (1.3245 => 1.3491, std. dev.: 0.0080) MultiSource/Applications/lambda-0_1_3/lambda: 1.79% (0.7038 => 0.7164, std. dev.: 0.0006) MultiSource/Applications/siod/siod: 1.65% (2.1791 => 2.2151, std. dev.: 0.0014) MultiSource/Applications/kimwitu++/kc: 1.60% (16.6129 => 16.8788, std. dev.: 0.0115) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.58% (1.4563 => 1.4793, std. dev.: 0.0039) MultiSource/Applications/Burg/burg: 1.57% (1.1061 => 1.1235, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.57% (0.7710 => 0.7831, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.55% (13.2842 => 13.4903, std. dev.: 0.0067) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.53% (0.7460 => 0.7574, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 1.53% (1.3693 => 1.3902, std. dev.: 0.0073) MultiSource/Benchmarks/MallocBench/gs/gs: 1.43% (3.8646 => 3.9197, std. dev.: 0.0036) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.29% (3.6692 => 3.7165, std. dev.: 0.0040) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.23% (1.3819 => 1.3989, std. dev.: 0.0047) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.19% (1.3813 => 1.3978, std. dev.: 0.0019) MultiSource/Applications/JM/lencod/lencod: 1.18% (14.8535 => 15.0285, std. dev.: 0.0094) MultiSource/Applications/sqlite3/sqlite3: 1.04% (16.2614 => 16.4313, std. dev.: 0.0168) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.04% (3.2742 => 3.3082, std. dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 24.02% (1.8175 => 2.2541, std. dev.: 0.0567) SingleSource/Benchmarks/Misc/mandel-2: 7.44% (1.2998 => 1.3965, std. dev.: 0.0101) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.86% (1.5824 => 1.6751, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.88% (1.9144 => 1.9887, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.65% (1.7688 => 1.8333, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: 3.59% (7.4271 => 7.6940, std. dev.: 0.0056) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4537, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-6: 2.91% (1.9199 => 1.9758, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 2.79% (11.2619 => 11.5758, std. dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.74% (2.8606 => 2.9391, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.46% (7.9275 => 8.1225, std. dev.: 0.0084) MultiSource/Applications/sqlite3/sqlite3: 2.38% (4.5928 => 4.7022, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 1.73% (3.2729 => 3.3295, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/ffbench: 1.60% (0.8273 => 0.8405, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.57% (1.9290 => 1.9592, std. dev.: 0.0005) MultiSource/Benchmarks/sim/sim: 1.43% (5.0168 => 5.0885, std. dev.: 0.0022) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5084, std. dev.: 0.0010) MultiSource/Applications/lemon/lemon: 1.37% (1.4298 => 1.4494, std. dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.28% (2.0200 => 2.0458, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1775, std. dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.12% (1.9433 => 1.9650, std. dev.: 0.0005) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -21.39% (0.4657 => 0.3661, std. dev.: 0.0226) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.00% (0.2670 => 0.2483, std. dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.92% (22.5627 => 21.0009, std. dev.: 0.0125) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.75% (0.3511 => 0.3274, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-3: -4.11% (0.3623 => 0.3474, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.00% (0.3650 => 0.3504, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-2: -3.94% (0.3601 => 0.3459, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -3.87% (0.3646 => 0.3505, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -3.82% (0.3663 => 0.3523, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -3.80% (0.3578 => 0.3442, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -3.63% (0.3940 => 0.3797, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -3.43% (0.3789 => 0.3659, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -3.42% (0.3914 => 0.3780, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -3.25% (0.4003 => 0.3873, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.76% (0.8818 => 0.8575, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.74% (0.6576 => 0.6396, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: -2.08% (0.6250 => 0.6120, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.47% (0.9108 => 0.8974, std. dev.: 0.0001) MultiSource/Applications/lua/lua: -1.28% (3.7467 => 3.6986, std. dev.: 0.0012) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.14% (1.0460 => 0.9504, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.44% (0.3139 => 0.2937, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0004) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9625, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.58% (1.3780 => 1.3149, std. dev.: 0.0113) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0009) SingleSource/Benchmarks/Dhrystone/dry: -3.98% (2.5089 => 2.4091, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.64% (1.9762 => 1.9042, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/lists: -2.25% (6.3560 => 6.2130, std. dev.: 0.0140) SingleSource/Benchmarks/Misc/richards_benchmark: -2.15% (1.1560 => 1.1312, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.11% (20.3410 => 19.9119, std. dev.: 0.0859) MultiSource/Applications/minisat/minisat: -2.06% (9.3358 => 9.1439, std. dev.: 0.0200) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.87% (6.6320 => 6.5081, std. dev.: 0.0047) MultiSource/Benchmarks/mafft/pairlocalalign: -1.85% (28.2225 => 27.7013, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9955, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) MultiSource/Applications/lua/lua: -1.42% (26.5159 => 26.1398, std. dev.: 0.0231) SingleSource/Benchmarks/Shootout/heapsort: -1.40% (3.9173 => 3.8624, std. dev.: 0.0143) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.37% (8.8259 => 8.7050, std. dev.: 0.0061) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.63s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed May 30 01:35:54 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 30 May 2012 03:35:54 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120530083554.CFBD12A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/847?compare_to=846&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 847, Order: 157681, Start Time: 2012-05-30 07:40:04, End Time: 2012-05-30 08:36:57 To: 846, Order: 157676, Start Time: 2012-05-30 05:31:21, End Time: 2012-05-30 06:27:50 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (55 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (795 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.06% (2.0176 => 2.2610, std. dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.04% (0.3130 => 0.3319, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.00% (3.9660 => 4.0850, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.66% (0.6959 => 0.7144, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.54% (0.9199 => 0.9433, std. dev.: 0.0056) MultiSource/Applications/SPASS/SPASS: 2.52% (13.8202 => 14.1686, std. dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.49% (0.5265 => 0.5396, std. dev.: 0.0029) MultiSource/Benchmarks/nbench/nbench: 2.39% (1.0594 => 1.0847, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/football/football: 2.36% (0.8310 => 0.8506, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.13% (1.2193 => 1.2453, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.10% (1.1364 => 1.1603, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.06% (0.5637 => 0.5753, std. dev.: 0.0041) MultiSource/Applications/Burg/burg: 2.02% (1.1061 => 1.1284, std. dev.: 0.0022) MultiSource/Applications/lambda-0_1_3/lambda: 1.96% (0.7038 => 0.7176, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.81% (1.4563 => 1.4827, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.75% (0.7710 => 0.7845, std. dev.: 0.0008) MultiSource/Applications/siod/siod: 1.69% (2.1791 => 2.2160, std. dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.69% (1.3245 => 1.3469, std. dev.: 0.0014) MultiSource/Applications/hbd/hbd: 1.61% (1.3693 => 1.3913, std. dev.: 0.0080) MultiSource/Applications/kimwitu++/kc: 1.59% (16.6129 => 16.8770, std. dev.: 0.0051) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.49% (13.2842 => 13.4817, std. dev.: 0.0047) MultiSource/Benchmarks/MallocBench/gs/gs: 1.48% (3.8646 => 3.9219, std. dev.: 0.0036) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.46% (0.7460 => 0.7569, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.30% (1.3819 => 1.3999, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.19% (3.6692 => 3.7128, std. dev.: 0.0044) MultiSource/Applications/SIBsim4/SIBsim4: 1.17% (1.2749 => 1.2898, std. dev.: 0.0022) MultiSource/Applications/JM/lencod/lencod: 1.15% (14.8535 => 15.0246, std. dev.: 0.0052) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.08% (1.3813 => 1.3962, std. dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.04% (3.2742 => 3.3081, std. dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 23.99% (1.8175 => 2.2536, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/mandel-2: 8.06% (1.2998 => 1.4046, std. dev.: 0.0063) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6755, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9880, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.71% (1.7688 => 1.8344, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: 3.52% (7.4271 => 7.6884, std. dev.: 0.0045) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4539, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-6: 2.90% (1.9199 => 1.9756, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 2.81% (11.2619 => 11.5784, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9392, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 2.48% (4.5928 => 4.7066, std. dev.: 0.0032) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.42% (7.9275 => 8.1193, std. dev.: 0.0093) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 1.72% (3.2729 => 3.3291, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/ffbench: 1.62% (0.8273 => 0.8407, std. dev.: 0.0015) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0010) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5103, std. dev.: 0.0009) MultiSource/Applications/lemon/lemon: 1.36% (1.4298 => 1.4492, std. dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.29% (2.0200 => 2.0461, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.20% (1.9433 => 1.9666, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1775, std. dev.: 0.0011) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.00% (0.2670 => 0.2483, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.89% (0.3511 => 0.3269, std. dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.80% (22.5627 => 21.0289, std. dev.: 0.0125) SingleSource/UnitTests/ObjC/exceptions-3: -4.03% (0.3623 => 0.3477, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -3.94% (0.3601 => 0.3459, std. dev.: 0.0029) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.92% (0.3650 => 0.3507, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-4: -3.89% (0.3646 => 0.3504, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -3.88% (0.3663 => 0.3521, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -3.80% (0.3578 => 0.3442, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -3.55% (0.3940 => 0.3800, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -3.38% (0.3789 => 0.3661, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -3.30% (0.3914 => 0.3785, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -3.05% (0.4003 => 0.3881, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.70% (0.8818 => 0.8580, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.68% (0.6576 => 0.6400, std. dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/bigfib: -2.08% (0.6250 => 0.6120, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.49% (0.9108 => 0.8972, std. dev.: 0.0001) MultiSource/Applications/lua/lua: -1.20% (3.7467 => 3.7016, std. dev.: 0.0032) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.15% (1.0460 => 0.9503, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.30% (1.3780 => 1.3049, std. dev.: 0.0080) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9625, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -4.06% (2.5089 => 2.4070, std. dev.: 0.0033) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -3.59% (1.9762 => 1.9053, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/richards_benchmark: -2.13% (1.1560 => 1.1314, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -2.07% (6.3560 => 6.2244, std. dev.: 0.0049) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.06% (20.3410 => 19.9228, std. dev.: 0.0493) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.96% (6.6320 => 6.5022, std. dev.: 0.0062) MultiSource/Applications/minisat/minisat: -1.87% (9.3358 => 9.1616, std. dev.: 0.0131) MultiSource/Benchmarks/mafft/pairlocalalign: -1.85% (28.2225 => 27.7015, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9957, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.53% (3.9173 => 3.8575, std. dev.: 0.0181) MultiSource/Applications/lua/lua: -1.46% (26.5159 => 26.1283, std. dev.: 0.0267) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.45% (8.8259 => 8.6983, std. dev.: 0.0117) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.75s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed May 30 03:34:35 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 30 May 2012 05:34:35 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120530103435.0ECFE2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/848?compare_to=847&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 848, Order: 157683, Start Time: 2012-05-30 09:39:06, End Time: 2012-05-30 10:35:38 To: 847, Order: 157681, Start Time: 2012-05-30 07:40:04, End Time: 2012-05-30 08:36:57 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (54 on baseline) Performance Improvements: 0 (41 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (795 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 11.82% (2.0176 => 2.2560, std. dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.88% (0.3130 => 0.3314, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.90% (0.2721 => 0.2827, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.88% (3.9660 => 4.0802, std. dev.: 0.0046) MultiSource/Applications/SPASS/SPASS: 2.46% (13.8202 => 14.1599, std. dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.46% (0.9199 => 0.9425, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.41% (0.5265 => 0.5392, std. dev.: 0.0020) MultiSource/Benchmarks/nbench/nbench: 2.39% (1.0594 => 1.0847, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.39% (0.6959 => 0.7125, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 2.14% (0.8310 => 0.8488, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.07% (1.2193 => 1.2446, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.04% (1.1364 => 1.1596, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.86% (0.5637 => 0.5742, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.78% (0.7710 => 0.7847, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.73% (1.4563 => 1.4815, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.61% (1.3245 => 1.3458, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.56% (13.2842 => 13.4913, std. dev.: 0.0097) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.49% (0.7460 => 0.7571, std. dev.: 0.0012) MultiSource/Applications/siod/siod: 1.41% (2.1791 => 2.2098, std. dev.: 0.0014) MultiSource/Applications/kimwitu++/kc: 1.35% (16.6129 => 16.8371, std. dev.: 0.0275) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.33% (1.3819 => 1.4003, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/gs/gs: 1.32% (3.8646 => 3.9158, std. dev.: 0.0096) MultiSource/Applications/treecc/treecc: 1.26% (1.9270 => 1.9512, std. dev.: 0.0011) MultiSource/Applications/Burg/burg: 1.25% (1.1061 => 1.1199, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.19% (1.3813 => 1.3978, std. dev.: 0.0024) MultiSource/Applications/JM/lencod/lencod: 1.09% (14.8535 => 15.0150, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.05% (3.6692 => 3.7079, std. dev.: 0.0036) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 24.41% (1.8175 => 2.2611, std. dev.: 0.0074) SingleSource/Benchmarks/Misc/mandel-2: 7.52% (1.2998 => 1.3976, std. dev.: 0.0050) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.89% (1.5824 => 1.6756, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 3.80% (1.9144 => 1.9872, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.75% (1.7688 => 1.8351, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: 3.64% (7.4271 => 7.6977, std. dev.: 0.0014) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4548, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/flops-6: 2.93% (1.9199 => 1.9761, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 2.81% (11.2619 => 11.5780, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.74% (2.8606 => 2.9391, std. dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 2.29% (4.5928 => 4.6981, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.23% (7.9275 => 8.1046, std. dev.: 0.0110) MultiSource/Applications/siod/siod: 1.73% (3.2729 => 3.3295, std. dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.60% (0.8273 => 0.8405, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.46% (1.4298 => 1.4507, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5094, std. dev.: 0.0064) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.24% (2.0200 => 2.0450, std. dev.: 0.0020) MultiSource/Benchmarks/sim/sim: 1.20% (5.0168 => 5.0769, std. dev.: 0.0090) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.17% (1.9433 => 1.9660, std. dev.: 0.0065) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1774, std. dev.: 0.0024) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -19.05% (0.4657 => 0.3770, std. dev.: 0.0119) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.12% (0.3511 => 0.3261, std. dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.05% (22.5627 => 20.9711, std. dev.: 0.0203) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.04% (0.2670 => 0.2482, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: -4.17% (0.3623 => 0.3472, std. dev.: 0.0030) SingleSource/UnitTests/ObjC/synchronized: -4.07% (0.3663 => 0.3514, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -4.05% (0.3601 => 0.3455, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.03% (0.3650 => 0.3503, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-4: -4.00% (0.3646 => 0.3500, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: -3.94% (0.3578 => 0.3437, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -3.91% (0.3940 => 0.3786, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -3.80% (0.3789 => 0.3645, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: -3.52% (0.4003 => 0.3862, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -3.47% (0.3914 => 0.3778, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.06% (0.6576 => 0.6375, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.72% (0.8818 => 0.8578, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: -2.37% (0.6250 => 0.6102, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.61% (0.9108 => 0.8961, std. dev.: 0.0002) MultiSource/Applications/lua/lua: -1.45% (3.7467 => 3.6922, std. dev.: 0.0015) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.13% (1.0460 => 0.9505, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.72% (1.3780 => 1.3129, std. dev.: 0.0087) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9622, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0020) SingleSource/Benchmarks/Dhrystone/dry: -3.98% (2.5089 => 2.4090, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: -3.66% (1.9762 => 1.9039, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.64% (0.3458 => 0.3332, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: -2.11% (1.1560 => 1.1316, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -2.01% (6.3560 => 6.2281, std. dev.: 0.0058) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.99% (20.3410 => 19.9357, std. dev.: 0.0156) MultiSource/Applications/minisat/minisat: -1.90% (9.3358 => 9.1582, std. dev.: 0.0125) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.90% (6.6320 => 6.5061, std. dev.: 0.0021) MultiSource/Benchmarks/mafft/pairlocalalign: -1.85% (28.2225 => 27.7010, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9954, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.54% (8.8259 => 8.6902, std. dev.: 0.0080) MultiSource/Applications/lua/lua: -1.49% (26.5159 => 26.1203, std. dev.: 0.0302) SingleSource/Benchmarks/Shootout/heapsort: -1.46% (3.9173 => 3.8602, std. dev.: 0.0079) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.67s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed May 30 04:57:12 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 30 May 2012 06:57:12 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120530115712.CC6D32A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/849?compare_to=848&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 849, Order: 157686, Start Time: 2012-05-30 11:01:42, End Time: 2012-05-30 11:58:16 To: 848, Order: 157683, Start Time: 2012-05-30 09:39:06, End Time: 2012-05-30 10:35:38 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (55 on baseline) Performance Improvements: 0 (41 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (794 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 11.80% (2.0176 => 2.2556, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.69% (0.3130 => 0.3308, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.79% (0.2721 => 0.2824, std. dev.: 0.0025) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.91% (3.9660 => 4.0816, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.53% (0.5265 => 0.5398, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.46% (0.6959 => 0.7130, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 2.33% (13.8202 => 14.1426, std. dev.: 0.0136) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.33% (0.9199 => 0.9413, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 2.29% (1.0594 => 1.0837, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/football/football: 2.08% (0.8310 => 0.8483, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.06% (0.5637 => 0.5753, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.03% (1.2193 => 1.2440, std. dev.: 0.0089) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.02% (1.1364 => 1.1594, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.69% (0.7710 => 0.7840, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.64% (1.3245 => 1.3462, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.56% (13.2842 => 13.4909, std. dev.: 0.0179) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.51% (0.7460 => 0.7573, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.50% (1.4563 => 1.4782, std. dev.: 0.0021) MultiSource/Applications/siod/siod: 1.46% (2.1791 => 2.2109, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.37% (1.3819 => 1.4008, std. dev.: 0.0010) MultiSource/Applications/treecc/treecc: 1.29% (1.9270 => 1.9518, std. dev.: 0.0009) MultiSource/Applications/kimwitu++/kc: 1.29% (16.6129 => 16.8266, std. dev.: 0.0086) MultiSource/Benchmarks/MallocBench/gs/gs: 1.29% (3.8646 => 3.9143, std. dev.: 0.0092) MultiSource/Applications/Burg/burg: 1.23% (1.1061 => 1.1197, std. dev.: 0.0045) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.15% (1.3813 => 1.3972, std. dev.: 0.0040) MultiSource/Applications/hbd/hbd: 1.13% (1.3693 => 1.3848, std. dev.: 0.0058) MultiSource/Applications/JM/lencod/lencod: 1.10% (14.8535 => 15.0173, std. dev.: 0.0112) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 24.37% (1.8175 => 2.2604, std. dev.: 0.0315) SingleSource/Benchmarks/Misc/mandel-2: 8.57% (1.2998 => 1.4112, std. dev.: 0.0042) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.87% (1.5824 => 1.6753, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9878, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: 3.65% (7.4271 => 7.6981, std. dev.: 0.0033) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.64% (1.7688 => 1.8332, std. dev.: 0.0187) MultiSource/Applications/hexxagon/hexxagon: 2.98% (12.0921 => 12.4528, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/flops-6: 2.86% (1.9199 => 1.9748, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 2.79% (11.2619 => 11.5756, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9394, std. dev.: 0.0018) MultiSource/Applications/sqlite3/sqlite3: 2.33% (4.5928 => 4.7000, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.15% (7.9275 => 8.0981, std. dev.: 0.0202) MultiSource/Applications/siod/siod: 1.76% (3.2729 => 3.3305, std. dev.: 0.0066) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.52% (0.8273 => 0.8399, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: 1.41% (1.4298 => 1.4500, std. dev.: 0.0014) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5080, std. dev.: 0.0089) SingleSource/Benchmarks/McGill/chomp: 1.28% (1.2308 => 1.2466, std. dev.: 0.0041) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.26% (2.0200 => 2.0454, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.25% (1.9433 => 1.9675, std. dev.: 0.0068) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1774, std. dev.: 0.0016) MultiSource/Benchmarks/sim/sim: 1.05% (5.0168 => 5.0693, std. dev.: 0.0099) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -14.52% (0.4657 => 0.3981, std. dev.: 0.0238) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.12% (0.3511 => 0.3261, std. dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.08% (22.5627 => 20.9656, std. dev.: 0.0068) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.00% (0.2670 => 0.2483, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -4.06% (0.3623 => 0.3476, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.05% (0.3650 => 0.3502, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -4.03% (0.3601 => 0.3456, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: -4.00% (0.3646 => 0.3500, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -3.96% (0.3940 => 0.3784, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -3.86% (0.3578 => 0.3440, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -3.69% (0.3789 => 0.3649, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/parameter-passing: -3.57% (0.4003 => 0.3860, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -3.50% (0.3914 => 0.3777, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.01% (0.6576 => 0.6378, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.63% (0.8818 => 0.8586, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/bigfib: -2.18% (0.6250 => 0.6114, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.78% (0.9108 => 0.8946, std. dev.: 0.0003) MultiSource/Applications/lua/lua: -1.39% (3.7467 => 3.6947, std. dev.: 0.0105) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.13% (1.0460 => 0.9505, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.44% (0.3139 => 0.2937, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0004) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9623, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.31% (1.3780 => 1.3186, std. dev.: 0.0045) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -4.05% (2.5089 => 2.4074, std. dev.: 0.0015) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -3.63% (1.9762 => 1.9044, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -2.35% (6.3560 => 6.2069, std. dev.: 0.0139) SingleSource/Benchmarks/Misc/richards_benchmark: -2.15% (1.1560 => 1.1311, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.08% (20.3410 => 19.9182, std. dev.: 0.0736) MultiSource/Applications/minisat/minisat: -1.94% (9.3358 => 9.1545, std. dev.: 0.0422) MultiSource/Benchmarks/mafft/pairlocalalign: -1.84% (28.2225 => 27.7023, std. dev.: 0.0014) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.80% (6.6320 => 6.5129, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3446, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9953, std. dev.: 0.0001) MultiSource/Applications/lua/lua: -1.57% (26.5159 => 26.0986, std. dev.: 0.0242) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.46% (8.8259 => 8.6974, std. dev.: 0.0227) SingleSource/Benchmarks/Shootout/heapsort: -1.35% (3.9173 => 3.8643, std. dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.06% (3.8887 => 3.8474, std. dev.: 0.0051) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.44s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed May 30 06:40:05 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 30 May 2012 08:40:05 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120530134005.B83F72A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/850?compare_to=849&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 850, Order: 157687, Start Time: 2012-05-30 12:44:25, End Time: 2012-05-30 13:41:08 To: 849, Order: 157686, Start Time: 2012-05-30 11:01:42, End Time: 2012-05-30 11:58:16 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (55 on baseline) Performance Improvements: 0 (41 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (794 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 11.76% (2.0176 => 2.2548, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.85% (0.3130 => 0.3313, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.71% (0.2721 => 0.2822, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.90% (3.9660 => 4.0812, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.45% (0.5265 => 0.5394, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 2.44% (13.8202 => 14.1575, std. dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.42% (0.9199 => 0.9422, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 2.36% (1.0594 => 1.0844, std. dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.33% (0.6959 => 0.7121, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/football/football: 2.19% (0.8310 => 0.8492, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.09% (0.5637 => 0.5755, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.04% (1.2193 => 1.2442, std. dev.: 0.0041) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.97% (1.1364 => 1.1588, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.70% (0.7710 => 0.7841, std. dev.: 0.0022) MultiSource/Applications/siod/siod: 1.66% (2.1791 => 2.2153, std. dev.: 0.0131) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.64% (1.3245 => 1.3462, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.58% (0.7460 => 0.7578, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.54% (13.2842 => 13.4886, std. dev.: 0.0133) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.52% (1.4563 => 1.4784, std. dev.: 0.0033) MultiSource/Applications/Burg/burg: 1.47% (1.1061 => 1.1224, std. dev.: 0.0032) MultiSource/Applications/kimwitu++/kc: 1.37% (16.6129 => 16.8397, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/gs/gs: 1.34% (3.8646 => 3.9163, std. dev.: 0.0036) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.30% (1.3813 => 1.3993, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.26% (1.3819 => 1.3993, std. dev.: 0.0019) MultiSource/Applications/treecc/treecc: 1.22% (1.9270 => 1.9506, std. dev.: 0.0006) MultiSource/Applications/hbd/hbd: 1.20% (1.3693 => 1.3857, std. dev.: 0.0063) MultiSource/Applications/JM/lencod/lencod: 1.17% (14.8535 => 15.0279, std. dev.: 0.0052) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.10% (3.6692 => 3.7096, std. dev.: 0.0008) MultiSource/Applications/SIBsim4/SIBsim4: 1.01% (1.2749 => 1.2878, std. dev.: 0.0020) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 24.40% (1.8175 => 2.2610, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/mandel-2: 7.82% (1.2998 => 1.4015, std. dev.: 0.0062) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.87% (1.5824 => 1.6753, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9876, std. dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.70% (1.7688 => 1.8343, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/salsa20: 3.60% (7.4271 => 7.6944, std. dev.: 0.0014) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4538, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: 2.88% (1.9199 => 1.9752, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 2.79% (11.2619 => 11.5762, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9393, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.52% (7.9275 => 8.1275, std. dev.: 0.0083) MultiSource/Applications/sqlite3/sqlite3: 2.35% (4.5928 => 4.7009, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 1.75% (3.2729 => 3.3301, std. dev.: 0.0060) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.58% (0.8273 => 0.8404, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.47% (1.4298 => 1.4508, std. dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5096, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.29% (2.0200 => 2.0460, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.21% (1.9433 => 1.9668, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1775, std. dev.: 0.0013) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -19.71% (0.4657 => 0.3739, std. dev.: 0.0283) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.12% (0.3511 => 0.3261, std. dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.08% (0.2670 => 0.2481, std. dev.: 0.0023) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.04% (22.5627 => 20.9744, std. dev.: 0.0162) SingleSource/UnitTests/ObjC/exceptions-3: -4.14% (0.3623 => 0.3473, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -4.05% (0.3601 => 0.3455, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.03% (0.3650 => 0.3503, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/synchronized: -4.01% (0.3663 => 0.3516, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -3.98% (0.3646 => 0.3501, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -3.94% (0.3578 => 0.3437, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/property: -3.73% (0.3940 => 0.3793, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: -3.67% (0.3789 => 0.3650, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -3.58% (0.3914 => 0.3774, std. dev.: 0.0030) SingleSource/UnitTests/ObjC/parameter-passing: -3.55% (0.4003 => 0.3861, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.04% (0.6576 => 0.6376, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.76% (0.8818 => 0.8575, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: -2.26% (0.6250 => 0.6109, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.69% (0.9108 => 0.8954, std. dev.: 0.0003) MultiSource/Applications/lua/lua: -1.38% (3.7467 => 3.6951, std. dev.: 0.0021) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.14% (1.0460 => 0.9504, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.31% (0.3139 => 0.2941, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0003) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9624, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -4.01% (2.5089 => 2.4083, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.62% (1.9762 => 1.9046, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: -2.15% (1.1560 => 1.1311, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.07% (20.3410 => 19.9203, std. dev.: 0.0510) SingleSource/Benchmarks/Shootout/lists: -2.00% (6.3560 => 6.2289, std. dev.: 0.0060) MultiSource/Applications/minisat/minisat: -1.95% (9.3358 => 9.1539, std. dev.: 0.0160) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.87% (6.6320 => 6.5081, std. dev.: 0.0017) MultiSource/Benchmarks/mafft/pairlocalalign: -1.85% (28.2225 => 27.7010, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9958, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) MultiSource/Applications/lua/lua: -1.51% (26.5159 => 26.1155, std. dev.: 0.0195) SingleSource/Benchmarks/Shootout/heapsort: -1.45% (3.9173 => 3.8606, std. dev.: 0.0083) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.31% (8.8259 => 8.7099, std. dev.: 0.0125) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.03% (3.8887 => 3.8488, std. dev.: 0.0014) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.90s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed May 30 08:14:30 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 30 May 2012 10:14:30 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120530151430.F27442A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/851?compare_to=850&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 851, Order: 157688, Start Time: 2012-05-30 14:19:02, End Time: 2012-05-30 15:15:34 To: 850, Order: 157687, Start Time: 2012-05-30 12:44:25, End Time: 2012-05-30 13:41:08 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (53 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (797 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 11.79% (2.0176 => 2.2554, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.78% (0.3130 => 0.3311, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.75% (0.2721 => 0.2823, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.89% (3.9660 => 4.0806, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.41% (0.9199 => 0.9421, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.39% (0.5265 => 0.5391, std. dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 2.37% (13.8202 => 14.1483, std. dev.: 0.0131) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.30% (0.6959 => 0.7119, std. dev.: 0.0015) MultiSource/Benchmarks/nbench/nbench: 2.28% (1.0594 => 1.0836, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 2.09% (0.8310 => 0.8484, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.01% (1.2193 => 1.2438, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.00% (0.7710 => 0.7864, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.94% (1.1364 => 1.1584, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.86% (0.5637 => 0.5742, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.65% (1.3245 => 1.3464, std. dev.: 0.0038) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.57% (13.2842 => 13.4921, std. dev.: 0.0126) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.49% (1.4563 => 1.4780, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.47% (0.7460 => 0.7570, std. dev.: 0.0024) MultiSource/Applications/kimwitu++/kc: 1.44% (16.6129 => 16.8522, std. dev.: 0.0027) MultiSource/Applications/Burg/burg: 1.31% (1.1061 => 1.1206, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 1.27% (3.8646 => 3.9136, std. dev.: 0.0090) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.21% (1.3819 => 1.3986, std. dev.: 0.0031) MultiSource/Applications/siod/siod: 1.20% (2.1791 => 2.2053, std. dev.: 0.0033) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.20% (1.3813 => 1.3979, std. dev.: 0.0010) MultiSource/Applications/treecc/treecc: 1.18% (1.9270 => 1.9498, std. dev.: 0.0015) MultiSource/Applications/SIBsim4/SIBsim4: 1.05% (1.2749 => 1.2883, std. dev.: 0.0007) MultiSource/Applications/JM/lencod/lencod: 1.03% (14.8535 => 15.0065, std. dev.: 0.0080) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.81% (0.4846 => 0.6969, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/fbench: 24.28% (1.8175 => 2.2588, std. dev.: 0.0482) SingleSource/Benchmarks/Misc/mandel-2: 8.16% (1.2998 => 1.4059, std. dev.: 0.0072) SingleSource/Benchmarks/Misc/flops-4: 6.52% (1.0640 => 1.1334, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.52% (2.5629 => 2.7299, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.89% (1.5824 => 1.6756, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9880, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.60% (1.7688 => 1.8325, std. dev.: 0.0164) SingleSource/Benchmarks/Misc/salsa20: 3.55% (7.4271 => 7.6905, std. dev.: 0.0052) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4550, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: 2.89% (1.9199 => 1.9753, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 2.80% (11.2619 => 11.5775, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.76% (2.8606 => 2.9395, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.59% (7.9275 => 8.1325, std. dev.: 0.0089) MultiSource/Applications/sqlite3/sqlite3: 2.41% (4.5928 => 4.7036, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 1.76% (3.2729 => 3.3304, std. dev.: 0.0008) SingleSource/Benchmarks/Dhrystone/fldry: 1.60% (1.9290 => 1.9599, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/ffbench: 1.56% (0.8273 => 0.8402, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5083, std. dev.: 0.0109) MultiSource/Applications/lemon/lemon: 1.36% (1.4298 => 1.4493, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.31% (2.0200 => 2.0464, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.22% (1.9433 => 1.9670, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1776, std. dev.: 0.0010) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -21.22% (0.4657 => 0.3669, std. dev.: 0.0107) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.09% (0.3511 => 0.3262, std. dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.08% (0.2670 => 0.2481, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.02% (22.5627 => 20.9779, std. dev.: 0.0216) SingleSource/UnitTests/ObjC/exceptions-3: -4.20% (0.3623 => 0.3471, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -4.08% (0.3601 => 0.3454, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.08% (0.3650 => 0.3501, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -4.04% (0.3663 => 0.3515, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -4.03% (0.3646 => 0.3499, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -3.94% (0.3578 => 0.3437, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -3.93% (0.3940 => 0.3785, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: -3.75% (0.3789 => 0.3647, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -3.63% (0.3914 => 0.3772, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -3.60% (0.4003 => 0.3859, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.15% (0.6576 => 0.6369, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.64% (0.8818 => 0.8585, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: -2.18% (0.6250 => 0.6114, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.71% (0.9108 => 0.8952, std. dev.: 0.0006) MultiSource/Applications/lua/lua: -1.45% (3.7467 => 3.6925, std. dev.: 0.0018) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.13% (1.0460 => 0.9505, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.95% (1.3780 => 1.3098, std. dev.: 0.0052) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9622, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -4.11% (2.5089 => 2.4058, std. dev.: 0.0017) MultiSource/Benchmarks/Olden/bh/bh: -3.63% (1.9762 => 1.9044, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.59% (0.3458 => 0.3334, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -2.17% (6.3560 => 6.2181, std. dev.: 0.0115) SingleSource/Benchmarks/Misc/richards_benchmark: -2.13% (1.1560 => 1.1314, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.94% (6.6320 => 6.5033, std. dev.: 0.0051) MultiSource/Applications/minisat/minisat: -1.90% (9.3358 => 9.1583, std. dev.: 0.0244) MultiSource/Benchmarks/mafft/pairlocalalign: -1.84% (28.2225 => 27.7025, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9954, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.59% (20.3410 => 20.0185, std. dev.: 0.0279) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) MultiSource/Applications/lua/lua: -1.56% (26.5159 => 26.1031, std. dev.: 0.0147) SingleSource/Benchmarks/Shootout/heapsort: -1.51% (3.9173 => 3.8580, std. dev.: 0.0175) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.49% (8.8259 => 8.6943, std. dev.: 0.0097) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.05s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed May 30 10:33:52 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 30 May 2012 12:33:52 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120530173352.910962A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/852?compare_to=851&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 852, Order: 157694, Start Time: 2012-05-30 16:38:22, End Time: 2012-05-30 17:34:56 To: 851, Order: 157688, Start Time: 2012-05-30 14:19:02, End Time: 2012-05-30 15:15:34 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (53 on baseline) Performance Improvements: 0 (41 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (796 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 11.75% (2.0176 => 2.2547, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.78% (0.3130 => 0.3311, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.71% (0.2721 => 0.2822, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.96% (3.9660 => 4.0834, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.48% (0.9199 => 0.9427, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 2.38% (1.0594 => 1.0846, std. dev.: 0.0048) MultiSource/Applications/SPASS/SPASS: 2.34% (13.8202 => 14.1436, std. dev.: 0.0213) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.34% (0.5265 => 0.5388, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.30% (0.6959 => 0.7119, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 2.17% (0.8310 => 0.8490, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.97% (1.2193 => 1.2433, std. dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.93% (0.5637 => 0.5746, std. dev.: 0.0028) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.92% (1.1364 => 1.1582, std. dev.: 0.0059) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.75% (0.7710 => 0.7845, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.66% (1.3245 => 1.3465, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.58% (1.4563 => 1.4793, std. dev.: 0.0087) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.52% (13.2842 => 13.4858, std. dev.: 0.0047) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.42% (0.7460 => 0.7566, std. dev.: 0.0019) MultiSource/Applications/kimwitu++/kc: 1.38% (16.6129 => 16.8426, std. dev.: 0.0049) MultiSource/Applications/Burg/burg: 1.37% (1.1061 => 1.1213, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 1.34% (3.8646 => 3.9165, std. dev.: 0.0032) MultiSource/Applications/siod/siod: 1.33% (2.1791 => 2.2081, std. dev.: 0.0028) MultiSource/Applications/treecc/treecc: 1.32% (1.9270 => 1.9525, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.30% (1.3819 => 1.3999, std. dev.: 0.0016) MultiSource/Applications/hbd/hbd: 1.25% (1.3693 => 1.3864, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.20% (1.3813 => 1.3979, std. dev.: 0.0011) MultiSource/Applications/JM/lencod/lencod: 1.12% (14.8535 => 15.0203, std. dev.: 0.0118) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.93% (0.4846 => 0.6975, std. dev.: 0.0066) SingleSource/Benchmarks/Misc/fbench: 24.43% (1.8175 => 2.2615, std. dev.: 0.0061) SingleSource/Benchmarks/Misc/mandel-2: 7.60% (1.2998 => 1.3986, std. dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.52% (2.5629 => 2.7299, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.92% (1.5824 => 1.6761, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.81% (1.9144 => 1.9873, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.67% (1.7688 => 1.8338, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: 3.56% (7.4271 => 7.6914, std. dev.: 0.0020) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4552, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: 2.86% (1.9199 => 1.9749, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 2.79% (11.2619 => 11.5764, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9392, std. dev.: 0.0022) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.44% (7.9275 => 8.1208, std. dev.: 0.0061) MultiSource/Applications/sqlite3/sqlite3: 2.42% (4.5928 => 4.7041, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 1.74% (3.2729 => 3.3298, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/ffbench: 1.63% (0.8273 => 0.8408, std. dev.: 0.0041) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9603, std. dev.: 0.0083) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5081, std. dev.: 0.0023) MultiSource/Applications/lemon/lemon: 1.38% (1.4298 => 1.4496, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.30% (2.0200 => 2.0463, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.17% (1.9433 => 1.9661, std. dev.: 0.0053) SingleSource/Benchmarks/Misc/flops: 1.13% (9.0760 => 9.1784, std. dev.: 0.0012) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -20.55% (0.4657 => 0.3700, std. dev.: 0.0364) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.06% (0.3511 => 0.3263, std. dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.04% (0.2670 => 0.2482, std. dev.: 0.0030) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.00% (22.5627 => 20.9832, std. dev.: 0.0063) SingleSource/UnitTests/ObjC/exceptions-3: -4.22% (0.3623 => 0.3470, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.05% (0.3650 => 0.3502, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/synchronized: -4.04% (0.3663 => 0.3515, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -4.00% (0.3601 => 0.3457, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -3.97% (0.3578 => 0.3436, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -3.89% (0.3646 => 0.3504, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -3.83% (0.3940 => 0.3789, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -3.67% (0.3789 => 0.3650, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -3.63% (0.3914 => 0.3772, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: -3.55% (0.4003 => 0.3861, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.04% (0.6576 => 0.6376, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.68% (0.8818 => 0.8582, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/bigfib: -2.43% (0.6250 => 0.6098, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.65% (0.9108 => 0.8958, std. dev.: 0.0026) MultiSource/Applications/lua/lua: -1.42% (3.7467 => 3.6934, std. dev.: 0.0051) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.14% (1.0460 => 0.9504, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-3: -6.21% (2.4152 => 2.2651, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.75% (1.3780 => 1.3125, std. dev.: 0.0077) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9623, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -4.01% (2.5089 => 2.4082, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.64% (0.3458 => 0.3332, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.60% (1.9762 => 1.9050, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/richards_benchmark: -2.14% (1.1560 => 1.1313, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout/lists: -2.02% (6.3560 => 6.2274, std. dev.: 0.0065) MultiSource/Applications/minisat/minisat: -1.95% (9.3358 => 9.1535, std. dev.: 0.0033) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.93% (20.3410 => 19.9494, std. dev.: 0.0946) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.88% (6.6320 => 6.5073, std. dev.: 0.0032) MultiSource/Benchmarks/mafft/pairlocalalign: -1.85% (28.2225 => 27.7008, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3446, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9957, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0013) MultiSource/Applications/lua/lua: -1.52% (26.5159 => 26.1132, std. dev.: 0.0315) SingleSource/Benchmarks/Shootout/heapsort: -1.29% (3.9173 => 3.8666, std. dev.: 0.0058) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.23% (8.8259 => 8.7177, std. dev.: 0.0089) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.45s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed May 30 11:56:35 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 30 May 2012 13:56:35 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120530185635.CA4242A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/853?compare_to=852&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 853, Order: 157696, Start Time: 2012-05-30 18:01:11, End Time: 2012-05-30 18:57:39 To: 852, Order: 157694, Start Time: 2012-05-30 16:38:22, End Time: 2012-05-30 17:34:56 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (56 on baseline) Performance Improvements: 0 (41 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (793 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 11.88% (2.0176 => 2.2573, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.81% (0.3130 => 0.3312, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.68% (0.2721 => 0.2821, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.97% (3.9660 => 4.0838, std. dev.: 0.0090) MultiSource/Benchmarks/nbench/nbench: 2.54% (1.0594 => 1.0863, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.40% (0.9199 => 0.9420, std. dev.: 0.0045) MultiSource/Applications/SPASS/SPASS: 2.37% (13.8202 => 14.1481, std. dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.37% (0.6959 => 0.7124, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.36% (0.5265 => 0.5389, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/football/football: 2.31% (0.8310 => 0.8502, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.21% (1.2193 => 1.2462, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.07% (1.1364 => 1.1599, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.99% (0.5637 => 0.5749, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.68% (1.3245 => 1.3467, std. dev.: 0.0019) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.64% (0.7460 => 0.7582, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.63% (1.4563 => 1.4801, std. dev.: 0.0016) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.62% (0.7710 => 0.7835, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.50% (13.2842 => 13.4832, std. dev.: 0.0053) MultiSource/Applications/Burg/burg: 1.45% (1.1061 => 1.1221, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 1.43% (2.1791 => 2.2102, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/gs/gs: 1.35% (3.8646 => 3.9167, std. dev.: 0.0042) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.28% (1.3819 => 1.3996, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.25% (1.3813 => 1.3985, std. dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 1.23% (1.2749 => 1.2906, std. dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 1.22% (16.6129 => 16.8159, std. dev.: 0.0115) MultiSource/Applications/JM/lencod/lencod: 1.22% (14.8535 => 15.0347, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.14% (3.6692 => 3.7111, std. dev.: 0.0044) MultiSource/Applications/hbd/hbd: 1.04% (1.3693 => 1.3836, std. dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.02% (3.2742 => 3.3076, std. dev.: 0.0077) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/fbench: 24.65% (1.8175 => 2.2655, std. dev.: 0.0267) SingleSource/Benchmarks/Misc/mandel-2: 8.61% (1.2998 => 1.4117, std. dev.: 0.0073) SingleSource/Benchmarks/Misc/flops-4: 6.52% (1.0640 => 1.1334, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.89% (1.5824 => 1.6756, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8147, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9875, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: 3.66% (7.4271 => 7.6988, std. dev.: 0.0025) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.65% (1.7688 => 1.8333, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4545, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: 2.85% (1.9199 => 1.9747, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 2.80% (11.2619 => 11.5776, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.76% (2.8606 => 2.9395, std. dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.55% (7.9275 => 8.1296, std. dev.: 0.0046) MultiSource/Applications/sqlite3/sqlite3: 2.33% (4.5928 => 4.6998, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 1.71% (3.2729 => 3.3290, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/ffbench: 1.62% (0.8273 => 0.8407, std. dev.: 0.0013) SingleSource/Benchmarks/Dhrystone/fldry: 1.60% (1.9290 => 1.9598, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.46% (1.4298 => 1.4507, std. dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5098, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.28% (2.0200 => 2.0458, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1777, std. dev.: 0.0005) MultiSource/Benchmarks/sim/sim: 1.09% (5.0168 => 5.0714, std. dev.: 0.0052) SingleSource/Benchmarks/McGill/chomp: 1.07% (1.2308 => 1.2440, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -21.26% (0.4657 => 0.3667, std. dev.: 0.0299) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.11% (22.5627 => 20.9593, std. dev.: 0.0186) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.97% (0.2670 => 0.2484, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.86% (0.3511 => 0.3270, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -4.25% (0.3601 => 0.3448, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -4.20% (0.3623 => 0.3471, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.14% (0.3650 => 0.3499, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -4.09% (0.3646 => 0.3497, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: -4.02% (0.3578 => 0.3434, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -4.01% (0.3663 => 0.3516, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -3.93% (0.3940 => 0.3785, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -3.80% (0.3789 => 0.3645, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -3.68% (0.3914 => 0.3770, std. dev.: 0.0029) SingleSource/UnitTests/ObjC/parameter-passing: -3.65% (0.4003 => 0.3857, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.89% (0.6576 => 0.6386, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/bigfib: -2.43% (0.6250 => 0.6098, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.96% (0.8818 => 0.8645, std. dev.: 0.0005) MultiSource/Applications/lua/lua: -1.39% (3.7467 => 3.6945, std. dev.: 0.0046) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.30% (0.9108 => 0.8990, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.13% (1.0460 => 0.9505, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std. dev.: 0.0004) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9623, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.44% (1.3780 => 1.3168, std. dev.: 0.0058) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -4.05% (2.5089 => 2.4072, std. dev.: 0.0017) MultiSource/Benchmarks/Olden/bh/bh: -3.65% (1.9762 => 1.9041, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.59% (0.3458 => 0.3334, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -2.28% (6.3560 => 6.2112, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/richards_benchmark: -2.15% (1.1560 => 1.1311, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -2.03% (6.6320 => 6.4971, std. dev.: 0.0050) MultiSource/Applications/minisat/minisat: -2.00% (9.3358 => 9.1491, std. dev.: 0.0080) MultiSource/Benchmarks/mafft/pairlocalalign: -1.84% (28.2225 => 27.7031, std. dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.77% (20.3410 => 19.9813, std. dev.: 0.0320) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9951, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.56% (0.9692 => 0.9541, std. dev.: 0.0000) MultiSource/Applications/lua/lua: -1.45% (26.5159 => 26.1303, std. dev.: 0.0196) SingleSource/Benchmarks/Shootout/heapsort: -1.40% (3.9173 => 3.8625, std. dev.: 0.0135) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.35% (8.8259 => 8.7067, std. dev.: 0.0042) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.79s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed May 30 13:19:25 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 30 May 2012 15:19:25 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120530201925.B9C662A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/854?compare_to=853&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 854, Order: 157706, Start Time: 2012-05-30 19:23:47, End Time: 2012-05-30 20:20:29 To: 853, Order: 157696, Start Time: 2012-05-30 18:01:11, End Time: 2012-05-30 18:57:39 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (55 on baseline) Performance Improvements: 0 (41 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 893 (794 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 1.19% (3.7702 => 3.8150, std. dev.: 0.0111) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.05% (2.0176 => 2.2607, std. dev.: 0.0120) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.72% (0.3130 => 0.3309, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.68% (0.2721 => 0.2821, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.02% (3.9660 => 4.0857, std. dev.: 0.0084) MultiSource/Benchmarks/nbench/nbench: 2.49% (1.0594 => 1.0858, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.43% (0.5265 => 0.5393, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.41% (0.9199 => 0.9421, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: 2.41% (0.8310 => 0.8510, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.39% (0.6959 => 0.7125, std. dev.: 0.0045) MultiSource/Applications/SPASS/SPASS: 2.24% (13.8202 => 14.1300, std. dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.21% (1.2193 => 1.2463, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.06% (1.1364 => 1.1598, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.99% (0.5637 => 0.5749, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.71% (1.4563 => 1.4812, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.66% (1.3245 => 1.3465, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.65% (0.7710 => 0.7837, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.55% (0.7460 => 0.7576, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.47% (13.2842 => 13.4794, std. dev.: 0.0177) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.36% (1.3819 => 1.4007, std. dev.: 0.0014) MultiSource/Applications/siod/siod: 1.30% (2.1791 => 2.2074, std. dev.: 0.0026) MultiSource/Benchmarks/MallocBench/gs/gs: 1.29% (3.8646 => 3.9145, std. dev.: 0.0075) MultiSource/Applications/SIBsim4/SIBsim4: 1.29% (1.2749 => 1.2913, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.21% (1.3813 => 1.3980, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.20% (3.6692 => 3.7132, std. dev.: 0.0113) MultiSource/Applications/JM/lencod/lencod: 1.20% (14.8535 => 15.0314, std. dev.: 0.0067) MultiSource/Applications/treecc/treecc: 1.19% (1.9270 => 1.9499, std. dev.: 0.0047) MultiSource/Applications/Burg/burg: 1.18% (1.1061 => 1.1192, std. dev.: 0.0007) MultiSource/Applications/kimwitu++/kc: 1.04% (16.6129 => 16.7850, std. dev.: 0.0123) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 24.08% (1.8175 => 2.2551, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 6.45% (1.2998 => 1.3836, std. dev.: 0.0158) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.89% (1.5824 => 1.6756, std. dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9881, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.64% (1.7688 => 1.8332, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: 3.60% (7.4271 => 7.6942, std. dev.: 0.0081) MultiSource/Applications/hexxagon/hexxagon: 3.01% (12.0921 => 12.4564, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/flops-6: 2.82% (1.9199 => 1.9741, std. dev.: 0.0014) MultiSource/Benchmarks/nbench/nbench: 2.81% (11.2619 => 11.5788, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.76% (2.8606 => 2.9396, std. dev.: 0.0014) MultiSource/Applications/sqlite3/sqlite3: 2.44% (4.5928 => 4.7048, std. dev.: 0.0017) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.28% (7.9275 => 8.1083, std. dev.: 0.0169) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 1.69% (3.2729 => 3.3283, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/ffbench: 1.57% (0.8273 => 0.8403, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.45% (1.4298 => 1.4505, std. dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5085, std. dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.26% (2.0200 => 2.0455, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0034) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.17% (1.9433 => 1.9661, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1774, std. dev.: 0.0016) MultiSource/Benchmarks/llubenchmark/llu: 1.11% (3.7731 => 3.8150, std. dev.: 0.0111) MultiSource/Applications/SPASS/SPASS: 1.05% (10.7476 => 10.8606, std. dev.: 0.0142) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.23% (22.5627 => 20.9307, std. dev.: 0.0027) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.89% (0.2670 => 0.2486, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.27% (0.3511 => 0.3291, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-3: -4.75% (0.3623 => 0.3451, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.71% (0.3650 => 0.3478, std. dev.: 0.0020) SingleSource/UnitTests/ObjC/exceptions-2: -4.67% (0.3601 => 0.3433, std. dev.: 0.0060) SingleSource/UnitTests/ObjC/trivial-interface: -4.53% (0.3578 => 0.3416, std. dev.: 0.0023) SingleSource/UnitTests/ObjC/synchronized: -4.48% (0.3663 => 0.3499, std. dev.: 0.0052) SingleSource/UnitTests/ObjC/exceptions-4: -4.42% (0.3646 => 0.3485, std. dev.: 0.0058) SingleSource/UnitTests/ObjC/property: -4.39% (0.3940 => 0.3767, std. dev.: 0.0020) SingleSource/UnitTests/ObjC/exceptions: -4.14% (0.3914 => 0.3752, std. dev.: 0.0035) SingleSource/UnitTests/ObjC/parameter-passing: -4.12% (0.4003 => 0.3838, std. dev.: 0.0034) SingleSource/UnitTests/ObjC/for-in: -4.12% (0.3789 => 0.3633, std. dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/bigfib: -2.54% (0.6250 => 0.6091, std. dev.: 0.0048) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.54% (0.6576 => 0.6409, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.83% (0.8818 => 0.8657, std. dev.: 0.0011) MultiSource/Applications/lua/lua: -1.52% (3.7467 => 3.6897, std. dev.: 0.0017) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.43% (0.9108 => 0.8978, std. dev.: 0.0009) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.14% (1.0460 => 0.9504, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0005) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9624, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.28% (1.3780 => 1.3190, std. dev.: 0.0007) SingleSource/Benchmarks/Dhrystone/dry: -4.00% (2.5089 => 2.4086, std. dev.: 0.0048) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.66% (1.9762 => 1.9038, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/lists: -2.29% (6.3560 => 6.2102, std. dev.: 0.0108) SingleSource/Benchmarks/Misc/richards_benchmark: -2.12% (1.1560 => 1.1315, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.05% (20.3410 => 19.9247, std. dev.: 0.0325) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.87% (6.6320 => 6.5081, std. dev.: 0.0033) MultiSource/Applications/minisat/minisat: -1.68% (9.3358 => 9.1793, std. dev.: 0.0135) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3446, std. dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: -1.62% (28.2225 => 27.7645, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9957, std. dev.: 0.0001) MultiSource/Applications/lua/lua: -1.60% (26.5159 => 26.0923, std. dev.: 0.0392) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.52% (8.8259 => 8.6921, std. dev.: 0.0145) SingleSource/Benchmarks/Shootout/heapsort: -1.49% (3.9173 => 3.8589, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.04% (3.8887 => 3.8483, std. dev.: 0.0039) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.94s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed May 30 14:42:03 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 30 May 2012 16:42:03 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120530214203.3F19D2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/855?compare_to=854&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 855, Order: 157711, Start Time: 2012-05-30 20:46:38, End Time: 2012-05-30 21:43:06 To: 854, Order: 157706, Start Time: 2012-05-30 19:23:47, End Time: 2012-05-30 20:20:29 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (53 on baseline) Performance Improvements: 0 (41 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (796 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.40% (2.0176 => 2.2677, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.85% (0.3130 => 0.3313, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.75% (0.2721 => 0.2823, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.97% (3.9660 => 4.0836, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.49% (0.9199 => 0.9428, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 2.45% (1.0594 => 1.0854, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.45% (0.5265 => 0.5394, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 2.42% (13.8202 => 14.1549, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.40% (0.6959 => 0.7126, std. dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/football/football: 2.24% (0.8310 => 0.8496, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.07% (1.2193 => 1.2445, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.99% (0.5637 => 0.5749, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.66% (13.2842 => 13.5051, std. dev.: 0.0108) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.62% (1.3245 => 1.3460, std. dev.: 0.0046) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.61% (1.4563 => 1.4798, std. dev.: 0.0068) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.54% (0.7460 => 0.7575, std. dev.: 0.0015) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.50% (0.7710 => 0.7826, std. dev.: 0.0027) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.43% (1.3813 => 1.4010, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.43% (1.3819 => 1.4016, std. dev.: 0.0015) MultiSource/Applications/treecc/treecc: 1.34% (1.9270 => 1.9528, std. dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 1.33% (16.6129 => 16.8338, std. dev.: 0.0076) MultiSource/Benchmarks/MallocBench/gs/gs: 1.32% (3.8646 => 3.9155, std. dev.: 0.0071) MultiSource/Applications/JM/lencod/lencod: 1.28% (14.8535 => 15.0433, std. dev.: 0.0014) MultiSource/Applications/Burg/burg: 1.22% (1.1061 => 1.1196, std. dev.: 0.0012) MultiSource/Applications/SIBsim4/SIBsim4: 1.15% (1.2749 => 1.2895, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.01% (3.6692 => 3.7062, std. dev.: 0.0015) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 24.06% (1.8175 => 2.2547, std. dev.: 0.0209) SingleSource/Benchmarks/Misc/mandel-2: 7.51% (1.2998 => 1.3974, std. dev.: 0.0078) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.90% (1.5824 => 1.6758, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8148, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9879, std. dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.64% (1.7688 => 1.8331, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/salsa20: 3.47% (7.4271 => 7.6847, std. dev.: 0.0108) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4536, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-6: 2.85% (1.9199 => 1.9747, std. dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 2.80% (11.2619 => 11.5774, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.76% (2.8606 => 2.9395, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.52% (7.9275 => 8.1274, std. dev.: 0.0060) MultiSource/Applications/sqlite3/sqlite3: 2.37% (4.5928 => 4.7015, std. dev.: 0.0109) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 1.65% (3.2729 => 3.3269, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/ffbench: 1.61% (0.8273 => 0.8406, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.60% (1.9290 => 1.9599, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5096, std. dev.: 0.0019) MultiSource/Applications/lemon/lemon: 1.38% (1.4298 => 1.4495, std. dev.: 0.0035) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.25% (2.0200 => 2.0452, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.22% (1.9433 => 1.9671, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/flops: 1.11% (9.0760 => 9.1765, std. dev.: 0.0021) MultiSource/Benchmarks/sim/sim: 1.04% (5.0168 => 5.0689, std. dev.: 0.0074) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -21.47% (0.4657 => 0.3657, std. dev.: 0.0030) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.04% (0.2670 => 0.2482, std. dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.98% (22.5627 => 20.9886, std. dev.: 0.0092) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.75% (0.3511 => 0.3274, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-3: -4.22% (0.3623 => 0.3470, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -4.11% (0.3601 => 0.3453, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -4.00% (0.3646 => 0.3500, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -3.93% (0.3663 => 0.3519, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -3.91% (0.3940 => 0.3786, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: -3.86% (0.3578 => 0.3440, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -3.67% (0.3789 => 0.3650, std. dev.: 0.0033) SingleSource/UnitTests/ObjC/exceptions: -3.55% (0.3914 => 0.3775, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -3.50% (0.4003 => 0.3863, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: -2.56% (0.6250 => 0.6090, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.54% (0.6576 => 0.6409, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.32% (0.8818 => 0.8613, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.56% (0.9108 => 0.8966, std. dev.: 0.0001) MultiSource/Applications/lua/lua: -1.45% (3.7467 => 3.6924, std. dev.: 0.0034) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.13% (1.0460 => 0.9505, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.77% (1.3780 => 1.3123, std. dev.: 0.0096) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9623, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -4.04% (2.5089 => 2.4075, std. dev.: 0.0009) MultiSource/Benchmarks/Olden/bh/bh: -3.72% (1.9762 => 1.9027, std. dev.: 0.0012) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.67% (0.3458 => 0.3331, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: -2.15% (1.1560 => 1.1311, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -2.07% (6.3560 => 6.2243, std. dev.: 0.0073) MultiSource/Applications/minisat/minisat: -1.92% (9.3358 => 9.1565, std. dev.: 0.0353) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.85% (6.6320 => 6.5094, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.76% (20.3410 => 19.9839, std. dev.: 0.0067) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3446, std. dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: -1.63% (28.2225 => 27.7626, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9956, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout/heapsort: -1.57% (3.9173 => 3.8558, std. dev.: 0.0095) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) MultiSource/Applications/lua/lua: -1.57% (26.5159 => 26.1006, std. dev.: 0.0211) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.47% (8.8259 => 8.6966, std. dev.: 0.0106) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.02% (3.8887 => 3.8489, std. dev.: 0.0040) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.00s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed May 30 16:04:33 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 30 May 2012 18:04:33 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120530230433.BC1BC2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/856?compare_to=855&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 856, Order: 157713, Start Time: 2012-05-30 22:09:08, End Time: 2012-05-30 23:05:37 To: 855, Order: 157711, Start Time: 2012-05-30 20:46:38, End Time: 2012-05-30 21:43:06 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (51 on baseline) Performance Improvements: 0 (42 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 893 (797 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/McGill/chomp: 1.11% (1.2353 => 1.2490, std. dev.: 0.0022) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.03% (2.0176 => 2.2604, std. dev.: 0.0129) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.59% (0.3130 => 0.3305, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.76% (3.9660 => 4.0755, std. dev.: 0.0101) MultiSource/Benchmarks/nbench/nbench: 2.35% (1.0594 => 1.0843, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.22% (0.9199 => 0.9403, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.20% (0.6959 => 0.7112, std. dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 2.16% (13.8202 => 14.1188, std. dev.: 0.0120) MultiSource/Benchmarks/Prolangs-C/football/football: 2.14% (0.8310 => 0.8488, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.09% (0.5265 => 0.5375, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.99% (1.1364 => 1.1590, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.95% (1.2193 => 1.2431, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.86% (0.5637 => 0.5742, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.57% (1.4563 => 1.4792, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.48% (1.3245 => 1.3441, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.38% (0.7460 => 0.7563, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.24% (13.2842 => 13.4487, std. dev.: 0.0029) MultiSource/Applications/kimwitu++/kc: 1.19% (16.6129 => 16.8104, std. dev.: 0.0081) MultiSource/Applications/siod/siod: 1.14% (2.1791 => 2.2040, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.13% (1.3819 => 1.3975, std. dev.: 0.0033) MultiSource/Benchmarks/MallocBench/gs/gs: 1.08% (3.8646 => 3.9062, std. dev.: 0.0030) MultiSource/Applications/Burg/burg: 1.05% (1.1061 => 1.1177, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.03% (1.3813 => 1.3955, std. dev.: 0.0017) MultiSource/Applications/treecc/treecc: 1.01% (1.9270 => 1.9465, std. dev.: 0.0056) MultiSource/Applications/SIBsim4/SIBsim4: 1.00% (1.2749 => 1.2877, std. dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 24.00% (1.8175 => 2.2537, std. dev.: 0.0049) SingleSource/Benchmarks/Misc/mandel-2: 7.36% (1.2998 => 1.3955, std. dev.: 0.0098) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.89% (1.5824 => 1.6756, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9875, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.67% (1.7688 => 1.8337, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: 3.65% (7.4271 => 7.6979, std. dev.: 0.0067) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4532, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: 2.97% (1.9199 => 1.9770, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 2.78% (11.2619 => 11.5750, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9393, std. dev.: 0.0019) MultiSource/Applications/sqlite3/sqlite3: 2.38% (4.5928 => 4.7023, std. dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.35% (7.9275 => 8.1138, std. dev.: 0.0133) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 1.76% (3.2729 => 3.3306, std. dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/fldry: 1.60% (1.9290 => 1.9599, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.59% (1.4298 => 1.4526, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/ffbench: 1.58% (0.8273 => 0.8404, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 1.48% (1.2308 => 1.2490, std. dev.: 0.0022) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5084, std. dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.27% (2.0200 => 2.0456, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.14% (1.9433 => 1.9655, std. dev.: 0.0059) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1779, std. dev.: 0.0016) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -18.85% (0.4657 => 0.3779, std. dev.: 0.0183) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.28% (22.5627 => 20.9209, std. dev.: 0.0168) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.19% (0.2670 => 0.2478, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.09% (0.3511 => 0.3262, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-3: -4.83% (0.3623 => 0.3448, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.82% (0.3650 => 0.3474, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/trivial-interface: -4.78% (0.3578 => 0.3407, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: -4.78% (0.3601 => 0.3429, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: -4.74% (0.3646 => 0.3473, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -4.72% (0.3663 => 0.3490, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: -4.59% (0.3940 => 0.3759, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -4.43% (0.3789 => 0.3621, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: -4.17% (0.4003 => 0.3836, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -4.14% (0.3914 => 0.3752, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.35% (0.6576 => 0.6356, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.23% (0.8818 => 0.8621, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: -1.79% (0.5748 => 0.5645, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.68% (0.9108 => 0.8955, std. dev.: 0.0005) MultiSource/Applications/lua/lua: -1.61% (3.7467 => 3.6864, std. dev.: 0.0018) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.11% (6.2785 => 6.2086, std. dev.: 0.0069) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.13% (1.0460 => 0.9505, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.15% (1.3780 => 1.3071, std. dev.: 0.0095) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9623, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -3.94% (2.5089 => 2.4101, std. dev.: 0.0037) MultiSource/Benchmarks/Olden/bh/bh: -3.74% (1.9762 => 1.9022, std. dev.: 0.0014) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.73% (0.3458 => 0.3329, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: -2.12% (1.1560 => 1.1315, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -2.03% (6.3560 => 6.2271, std. dev.: 0.0033) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -2.02% (6.6320 => 6.4982, std. dev.: 0.0063) MultiSource/Applications/minisat/minisat: -1.96% (9.3358 => 9.1528, std. dev.: 0.0126) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.78% (20.3410 => 19.9784, std. dev.: 0.0300) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: -1.63% (28.2225 => 27.7630, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9954, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.47% (3.9173 => 3.8598, std. dev.: 0.0169) MultiSource/Applications/lua/lua: -1.44% (26.5159 => 26.1348, std. dev.: 0.0241) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.32% (8.8259 => 8.7090, std. dev.: 0.0064) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.01s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed May 30 17:27:13 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 30 May 2012 19:27:13 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120531002713.5F0562A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/857?compare_to=856&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 857, Order: 157718, Start Time: 2012-05-30 23:31:42, End Time: 2012-05-31 00:28:17 To: 856, Order: 157713, Start Time: 2012-05-30 22:09:08, End Time: 2012-05-30 23:05:37 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (56 on baseline) Performance Improvements: 0 (43 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 893 (791 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.03% (1.3071 => 1.3205, std. dev.: 0.0009) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.04% (2.0176 => 2.2606, std. dev.: 0.0146) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.69% (0.3130 => 0.3308, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.86% (0.2721 => 0.2826, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.99% (3.9660 => 4.0846, std. dev.: 0.0151) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.52% (0.9199 => 0.9431, std. dev.: 0.0027) MultiSource/Benchmarks/nbench/nbench: 2.50% (1.0594 => 1.0859, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.49% (0.6959 => 0.7132, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 2.43% (13.8202 => 14.1564, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.43% (0.5265 => 0.5393, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/football/football: 2.38% (0.8310 => 0.8508, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.27% (1.2193 => 1.2470, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.20% (1.1364 => 1.1614, std. dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.09% (0.5637 => 0.5755, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.90% (1.4563 => 1.4839, std. dev.: 0.0079) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.73% (1.3245 => 1.3474, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.63% (0.7710 => 0.7836, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.57% (0.7460 => 0.7577, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.56% (13.2842 => 13.4908, std. dev.: 0.0160) MultiSource/Applications/kimwitu++/kc: 1.51% (16.6129 => 16.8644, std. dev.: 0.0100) MultiSource/Applications/lambda-0_1_3/lambda: 1.49% (0.7038 => 0.7143, std. dev.: 0.0001) MultiSource/Applications/SIBsim4/SIBsim4: 1.48% (1.2749 => 1.2938, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: 1.48% (3.8646 => 3.9218, std. dev.: 0.0032) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.37% (1.3819 => 1.4009, std. dev.: 0.0016) MultiSource/Applications/Burg/burg: 1.33% (1.1061 => 1.1208, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.29% (1.3813 => 1.3991, std. dev.: 0.0008) MultiSource/Applications/JM/lencod/lencod: 1.27% (14.8535 => 15.0427, std. dev.: 0.0089) MultiSource/Applications/treecc/treecc: 1.27% (1.9270 => 1.9515, std. dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: 1.21% (16.2614 => 16.4585, std. dev.: 0.0135) MultiSource/Applications/hbd/hbd: 1.10% (1.3693 => 1.3843, std. dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.09% (3.2742 => 3.3100, std. dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 24.45% (1.8175 => 2.2618, std. dev.: 0.0340) SingleSource/Benchmarks/Misc/mandel-2: 7.63% (1.2998 => 1.3990, std. dev.: 0.0096) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7298, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.89% (1.5824 => 1.6756, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9882, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.70% (1.7688 => 1.8343, std. dev.: 0.0062) SingleSource/Benchmarks/Misc/salsa20: 3.62% (7.4271 => 7.6960, std. dev.: 0.0032) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4552, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-6: 2.95% (1.9199 => 1.9765, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 2.79% (11.2619 => 11.5759, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9394, std. dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.52% (7.9275 => 8.1272, std. dev.: 0.0089) MultiSource/Applications/sqlite3/sqlite3: 2.31% (4.5928 => 4.6991, std. dev.: 0.0040) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 1.73% (3.2729 => 3.3295, std. dev.: 0.0006) SingleSource/Benchmarks/Dhrystone/fldry: 1.60% (1.9290 => 1.9598, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/ffbench: 1.60% (0.8273 => 0.8405, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: 1.46% (1.4298 => 1.4507, std. dev.: 0.0035) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5092, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.28% (2.0200 => 2.0458, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.24% (1.9433 => 1.9673, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/flops: 1.16% (9.0760 => 9.1810, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -22.46% (0.4657 => 0.3611, std. dev.: 0.0162) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.04% (22.5627 => 20.9735, std. dev.: 0.0103) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.85% (0.2670 => 0.2487, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.84% (0.3511 => 0.3271, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions-3: -4.80% (0.3623 => 0.3449, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.71% (0.3650 => 0.3478, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -4.67% (0.3601 => 0.3433, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions-4: -4.64% (0.3646 => 0.3477, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -4.53% (0.3578 => 0.3416, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -4.45% (0.3663 => 0.3500, std. dev.: 0.0026) SingleSource/UnitTests/ObjC/property: -4.42% (0.3940 => 0.3766, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -4.33% (0.3789 => 0.3625, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -4.16% (0.3914 => 0.3751, std. dev.: 0.0056) SingleSource/UnitTests/ObjC/parameter-passing: -4.15% (0.4003 => 0.3837, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.92% (0.6576 => 0.6384, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: -2.51% (0.6250 => 0.6093, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.04% (0.8818 => 0.8638, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/Hello: -1.74% (0.5748 => 0.5648, std. dev.: 0.0011) MultiSource/Applications/lua/lua: -1.31% (3.7467 => 3.6976, std. dev.: 0.0048) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.28% (0.9108 => 0.8991, std. dev.: 0.0008) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.14% (1.0460 => 0.9504, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.44% (0.3139 => 0.2937, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.27% (2.4152 => 2.2637, std. dev.: 0.0005) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9624, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.17% (1.3780 => 1.3205, std. dev.: 0.0009) SingleSource/Benchmarks/Dhrystone/dry: -3.98% (2.5089 => 2.4090, std. dev.: 0.0007) MultiSource/Benchmarks/Olden/bh/bh: -3.64% (1.9762 => 1.9042, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.61% (0.3458 => 0.3333, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -2.16% (6.3560 => 6.2184, std. dev.: 0.0066) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.14% (20.3410 => 19.9061, std. dev.: 0.0186) SingleSource/Benchmarks/Misc/richards_benchmark: -2.11% (1.1560 => 1.1316, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: -1.93% (9.3358 => 9.1557, std. dev.: 0.0403) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.93% (6.6320 => 6.5042, std. dev.: 0.0062) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3446, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: -1.63% (28.2225 => 27.7636, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9956, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.48% (3.9173 => 3.8593, std. dev.: 0.0034) MultiSource/Applications/lua/lua: -1.48% (26.5159 => 26.1247, std. dev.: 0.0134) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.38% (8.8259 => 8.7043, std. dev.: 0.0112) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.03% (3.8887 => 3.8485, std. dev.: 0.0041) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.17s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed May 30 18:49:54 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 30 May 2012 20:49:54 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120531014954.587BE2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/858?compare_to=857&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 858, Order: 157723, Start Time: 2012-05-31 00:54:26, End Time: 2012-05-31 01:50:58 To: 857, Order: 157718, Start Time: 2012-05-30 23:31:42, End Time: 2012-05-31 00:28:17 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (57 on baseline) Performance Improvements: 0 (41 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (792 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.70% (2.0176 => 2.2738, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.85% (0.3130 => 0.3313, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.86% (0.2721 => 0.2826, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.22% (3.9660 => 4.0939, std. dev.: 0.0040) MultiSource/Benchmarks/nbench/nbench: 2.82% (1.0594 => 1.0893, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.80% (0.6959 => 0.7154, std. dev.: 0.0024) MultiSource/Applications/SPASS/SPASS: 2.75% (13.8202 => 14.2000, std. dev.: 0.0107) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.73% (0.9199 => 0.9450, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 2.65% (0.8310 => 0.8530, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.56% (0.5265 => 0.5400, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.48% (1.2193 => 1.2495, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.34% (1.1364 => 1.1630, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.16% (0.5637 => 0.5759, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.01% (1.4563 => 1.4855, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.94% (1.3245 => 1.3502, std. dev.: 0.0018) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.84% (0.7710 => 0.7852, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.80% (13.2842 => 13.5228, std. dev.: 0.0099) MultiSource/Applications/SIBsim4/SIBsim4: 1.59% (1.2749 => 1.2952, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 1.58% (1.9270 => 1.9575, std. dev.: 0.0016) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.55% (0.7460 => 0.7576, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 1.50% (1.1061 => 1.1227, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 1.46% (3.8646 => 3.9212, std. dev.: 0.0031) MultiSource/Applications/JM/lencod/lencod: 1.42% (14.8535 => 15.0638, std. dev.: 0.0122) MultiSource/Applications/kimwitu++/kc: 1.35% (16.6129 => 16.8367, std. dev.: 0.0026) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.34% (1.3813 => 1.3998, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.30% (1.3819 => 1.3998, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.28% (3.6692 => 3.7161, std. dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.26% (3.2742 => 3.3156, std. dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: 1.26% (16.2614 => 16.4669, std. dev.: 0.0159) MultiSource/Applications/hbd/hbd: 1.13% (1.3693 => 1.3848, std. dev.: 0.0033) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.89% (0.4846 => 0.6973, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: 23.65% (1.8175 => 2.2473, std. dev.: 0.0063) SingleSource/Benchmarks/Misc/mandel-2: 7.02% (1.2998 => 1.3911, std. dev.: 0.0085) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.90% (1.5824 => 1.6758, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9880, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.70% (1.7688 => 1.8342, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: 3.59% (7.4271 => 7.6935, std. dev.: 0.0056) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4535, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-6: 2.88% (1.9199 => 1.9752, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 2.80% (11.2619 => 11.5777, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.76% (2.8606 => 2.9396, std. dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.46% (7.9275 => 8.1225, std. dev.: 0.0104) MultiSource/Applications/sqlite3/sqlite3: 2.38% (4.5928 => 4.7021, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 1.74% (3.2729 => 3.3298, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/ffbench: 1.60% (0.8273 => 0.8405, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: 1.54% (1.9290 => 1.9588, std. dev.: 0.0007) MultiSource/Applications/lemon/lemon: 1.44% (1.4298 => 1.4504, std. dev.: 0.0008) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5103, std. dev.: 0.0015) MultiSource/Benchmarks/sim/sim: 1.28% (5.0168 => 5.0808, std. dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.27% (2.0200 => 2.0457, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.24% (1.9433 => 1.9673, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 1.10% (9.0760 => 9.1762, std. dev.: 0.0011) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.04% (0.2670 => 0.2482, std. dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.87% (22.5627 => 21.0132, std. dev.: 0.0150) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.78% (0.3511 => 0.3273, std. dev.: 0.0077) SingleSource/UnitTests/ObjC/exceptions-3: -4.36% (0.3623 => 0.3465, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.25% (0.3650 => 0.3495, std. dev.: 0.0015) SingleSource/UnitTests/ObjC/exceptions-2: -4.22% (0.3601 => 0.3449, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -4.16% (0.3578 => 0.3429, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -4.12% (0.3663 => 0.3512, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -4.09% (0.3646 => 0.3497, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -4.04% (0.3940 => 0.3781, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -3.85% (0.3789 => 0.3643, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -3.76% (0.3914 => 0.3767, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -3.65% (0.4003 => 0.3857, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.78% (0.6576 => 0.6393, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: -2.46% (0.6250 => 0.6096, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.21% (0.8818 => 0.8623, std. dev.: 0.0007) MultiSource/Applications/lua/lua: -1.23% (3.7467 => 3.7007, std. dev.: 0.0024) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.20% (0.9108 => 0.8999, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.13% (1.0460 => 0.9505, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.31% (0.3139 => 0.2941, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-3: -6.27% (2.4152 => 2.2638, std. dev.: 0.0007) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9624, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.58% (1.3780 => 1.3149, std. dev.: 0.0096) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -3.98% (2.5089 => 2.4091, std. dev.: 0.0029) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.73% (0.3458 => 0.3329, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -3.62% (1.9762 => 1.9047, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: -2.15% (1.1560 => 1.1312, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -2.11% (6.3560 => 6.2216, std. dev.: 0.0047) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -2.00% (6.6320 => 6.4994, std. dev.: 0.0051) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.78% (20.3410 => 19.9784, std. dev.: 0.0464) MultiSource/Applications/minisat/minisat: -1.77% (9.3358 => 9.1706, std. dev.: 0.0078) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3444, std. dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: -1.63% (28.2225 => 27.7627, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9957, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.54% (3.9173 => 3.8569, std. dev.: 0.0041) MultiSource/Applications/lua/lua: -1.47% (26.5159 => 26.1270, std. dev.: 0.0256) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.31% (8.8259 => 8.7107, std. dev.: 0.0254) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.03% (3.8887 => 3.8486, std. dev.: 0.0037) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.06s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed May 30 20:12:46 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 30 May 2012 22:12:46 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120531031246.56B1D2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/859?compare_to=858&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 859, Order: 157726, Start Time: 2012-05-31 02:17:14, End Time: 2012-05-31 03:13:50 To: 858, Order: 157723, Start Time: 2012-05-31 00:54:26, End Time: 2012-05-31 01:50:58 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (57 on baseline) Performance Improvements: 0 (41 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (792 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 2.85% (0.3616 => 0.3719, std. dev.: 0.0037) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 1.02% (7.9547 => 8.0355, std. dev.: 0.0162) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.69% (2.0176 => 2.2737, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.85% (0.3130 => 0.3313, std. dev.: 0.0064) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.79% (0.2721 => 0.2824, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.18% (3.9660 => 4.0922, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.83% (0.6959 => 0.7156, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 2.79% (1.0594 => 1.0890, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.71% (0.9199 => 0.9448, std. dev.: 0.0055) MultiSource/Applications/SPASS/SPASS: 2.66% (13.8202 => 14.1875, std. dev.: 0.0157) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.62% (0.5265 => 0.5403, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/football/football: 2.61% (0.8310 => 0.8527, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.45% (1.2193 => 1.2492, std. dev.: 0.0019) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.37% (1.1364 => 1.1633, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.23% (1.3245 => 1.3540, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.09% (0.5637 => 0.5755, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.89% (1.4563 => 1.4838, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.73% (13.2842 => 13.5144, std. dev.: 0.0054) MultiSource/Applications/treecc/treecc: 1.60% (1.9270 => 1.9578, std. dev.: 0.0107) MultiSource/Applications/siod/siod: 1.60% (2.1791 => 2.2139, std. dev.: 0.0037) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.58% (0.7460 => 0.7578, std. dev.: 0.0006) MultiSource/Applications/SIBsim4/SIBsim4: 1.54% (1.2749 => 1.2945, std. dev.: 0.0023) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.45% (0.7710 => 0.7822, std. dev.: 0.0014) MultiSource/Applications/Burg/burg: 1.45% (1.1061 => 1.1221, std. dev.: 0.0059) MultiSource/Applications/lambda-0_1_3/lambda: 1.44% (0.7038 => 0.7139, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.42% (1.3819 => 1.4015, std. dev.: 0.0047) MultiSource/Benchmarks/MallocBench/gs/gs: 1.41% (3.8646 => 3.9191, std. dev.: 0.0036) MultiSource/Applications/kimwitu++/kc: 1.38% (16.6129 => 16.8424, std. dev.: 0.0069) MultiSource/Applications/JM/lencod/lencod: 1.36% (14.8535 => 15.0561, std. dev.: 0.0147) MultiSource/Applications/sqlite3/sqlite3: 1.29% (16.2614 => 16.4713, std. dev.: 0.0105) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.27% (3.6692 => 3.7158, std. dev.: 0.0035) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.26% (1.3813 => 1.3987, std. dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.17% (3.2742 => 3.3124, std. dev.: 0.0012) MultiSource/Applications/hbd/hbd: 1.16% (1.3693 => 1.3852, std. dev.: 0.0026) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: 24.47% (1.8175 => 2.2622, std. dev.: 0.0529) SingleSource/Benchmarks/Misc/mandel-2: 7.29% (1.2998 => 1.3945, std. dev.: 0.0093) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.91% (1.5824 => 1.6759, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8147, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9880, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.68% (1.7688 => 1.8339, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/salsa20: 3.58% (7.4271 => 7.6929, std. dev.: 0.0079) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4539, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: 2.86% (1.9199 => 1.9748, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 2.80% (11.2619 => 11.5777, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.76% (2.8606 => 2.9395, std. dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: 2.36% (4.5928 => 4.7014, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.18% (7.9275 => 8.1006, std. dev.: 0.0089) MultiSource/Applications/siod/siod: 1.74% (3.2729 => 3.3300, std. dev.: 0.0006) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9603, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.40% (1.4298 => 1.4498, std. dev.: 0.0031) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5079, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/ffbench: 1.29% (0.8273 => 0.8380, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.26% (2.0200 => 2.0454, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 1.09% (9.0760 => 9.1752, std. dev.: 0.0013) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -20.14% (0.4657 => 0.3719, std. dev.: 0.0037) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.97% (0.2670 => 0.2484, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.82% (22.5627 => 21.0250, std. dev.: 0.0095) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.81% (0.3511 => 0.3272, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: -4.31% (0.3623 => 0.3467, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.25% (0.3650 => 0.3495, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: -4.22% (0.3601 => 0.3449, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -4.15% (0.3663 => 0.3511, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -4.14% (0.3646 => 0.3495, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -4.11% (0.3578 => 0.3431, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -3.81% (0.3940 => 0.3790, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: -3.80% (0.3789 => 0.3645, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -3.70% (0.3914 => 0.3769, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -3.65% (0.4003 => 0.3857, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.95% (0.6576 => 0.6382, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: -2.46% (0.6250 => 0.6096, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.29% (0.8818 => 0.8616, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.25% (0.9108 => 0.8994, std. dev.: 0.0003) MultiSource/Applications/lua/lua: -1.16% (3.7467 => 3.7031, std. dev.: 0.0089) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.14% (1.0460 => 0.9504, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2640, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.22% (1.3780 => 1.3060, std. dev.: 0.0037) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9624, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -3.99% (2.5089 => 2.4089, std. dev.: 0.0008) MultiSource/Benchmarks/Olden/bh/bh: -3.64% (1.9762 => 1.9042, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.59% (0.3458 => 0.3334, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: -2.12% (1.1560 => 1.1315, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -2.10% (6.3560 => 6.2225, std. dev.: 0.0046) MultiSource/Applications/minisat/minisat: -1.95% (9.3358 => 9.1534, std. dev.: 0.0075) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.83% (6.6320 => 6.5104, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: -1.63% (28.2225 => 27.7636, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9957, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.52% (20.3410 => 20.0309, std. dev.: 0.0446) MultiSource/Applications/lua/lua: -1.49% (26.5159 => 26.1216, std. dev.: 0.0291) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.48% (8.8259 => 8.6950, std. dev.: 0.0086) SingleSource/Benchmarks/Shootout/heapsort: -1.18% (3.9173 => 3.8712, std. dev.: 0.0027) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.09s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed May 30 21:35:16 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 30 May 2012 23:35:16 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120531043516.7ACFE2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/860?compare_to=859&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 860, Order: 157730, Start Time: 2012-05-31 03:39:52, End Time: 2012-05-31 04:36:20 To: 859, Order: 157726, Start Time: 2012-05-31 02:17:14, End Time: 2012-05-31 03:13:50 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (53 on baseline) Performance Improvements: 0 (42 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (795 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.05% (2.0176 => 2.2608, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.62% (0.3130 => 0.3306, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.91% (3.9660 => 4.0813, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.40% (0.9199 => 0.9420, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.39% (0.5265 => 0.5391, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 2.36% (13.8202 => 14.1458, std. dev.: 0.0067) MultiSource/Benchmarks/nbench/nbench: 2.31% (1.0594 => 1.0839, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.30% (0.6959 => 0.7119, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.12% (1.2193 => 1.2452, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.10% (1.1364 => 1.1603, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/football/football: 2.09% (0.8310 => 0.8484, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.81% (0.5637 => 0.5739, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.64% (1.3245 => 1.3462, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.61% (1.4563 => 1.4798, std. dev.: 0.0021) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.54% (0.7460 => 0.7575, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.50% (13.2842 => 13.4835, std. dev.: 0.0147) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.45% (0.7710 => 0.7822, std. dev.: 0.0029) MultiSource/Benchmarks/MallocBench/gs/gs: 1.34% (3.8646 => 3.9165, std. dev.: 0.0077) MultiSource/Applications/siod/siod: 1.32% (2.1791 => 2.2078, std. dev.: 0.0064) MultiSource/Applications/kimwitu++/kc: 1.26% (16.6129 => 16.8227, std. dev.: 0.0136) MultiSource/Applications/SIBsim4/SIBsim4: 1.26% (1.2749 => 1.2909, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 1.24% (1.1061 => 1.1198, std. dev.: 0.0013) MultiSource/Applications/treecc/treecc: 1.21% (1.9270 => 1.9504, std. dev.: 0.0028) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.18% (1.3819 => 1.3982, std. dev.: 0.0028) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.03% (1.3813 => 1.3955, std. dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 1.02% (14.8535 => 15.0054, std. dev.: 0.0019) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/fbench: 24.26% (1.8175 => 2.2584, std. dev.: 0.0503) SingleSource/Benchmarks/Misc/mandel-2: 7.03% (1.2998 => 1.3912, std. dev.: 0.0155) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7298, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.90% (1.5824 => 1.6757, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9878, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.67% (1.7688 => 1.8338, std. dev.: 0.0048) SingleSource/Benchmarks/Misc/salsa20: 3.65% (7.4271 => 7.6984, std. dev.: 0.0064) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4548, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-6: 2.86% (1.9199 => 1.9748, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 2.78% (11.2619 => 11.5755, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.76% (2.8606 => 2.9396, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.68% (7.9275 => 8.1400, std. dev.: 0.0065) MultiSource/Applications/sqlite3/sqlite3: 2.37% (4.5928 => 4.7017, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 1.66% (3.2729 => 3.3273, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/ffbench: 1.60% (0.8273 => 0.8405, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.43% (1.4298 => 1.4503, std. dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5102, std. dev.: 0.0090) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.27% (2.0200 => 2.0457, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.18% (1.9433 => 1.9662, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2135, std. dev.: 0.0001) MultiSource/Benchmarks/sim/sim: 1.17% (5.0168 => 5.0755, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1776, std. dev.: 0.0007) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -21.97% (0.4657 => 0.3634, std. dev.: 0.0060) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.30% (0.2670 => 0.2475, std. dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.14% (22.5627 => 20.9517, std. dev.: 0.0076) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.12% (0.3511 => 0.3261, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: -4.25% (0.3623 => 0.3469, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.19% (0.3650 => 0.3497, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-2: -4.11% (0.3601 => 0.3453, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -4.04% (0.3940 => 0.3781, std. dev.: 0.0039) SingleSource/UnitTests/ObjC/exceptions-4: -4.03% (0.3646 => 0.3499, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -4.02% (0.3578 => 0.3434, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -3.99% (0.3663 => 0.3517, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: -3.91% (0.3789 => 0.3641, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -3.76% (0.3914 => 0.3767, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -3.60% (0.4003 => 0.3859, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.69% (0.8818 => 0.8581, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.63% (0.6576 => 0.6403, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: -2.54% (0.6250 => 0.6091, std. dev.: 0.0025) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.68% (0.9108 => 0.8955, std. dev.: 0.0007) MultiSource/Applications/lua/lua: -1.44% (3.7467 => 3.6927, std. dev.: 0.0066) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.14% (1.0460 => 0.9504, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.47% (0.3139 => 0.2936, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9622, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.51% (1.3780 => 1.3159, std. dev.: 0.0028) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -4.00% (2.5089 => 2.4086, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.62% (1.9762 => 1.9047, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -2.38% (6.3560 => 6.2045, std. dev.: 0.0052) SingleSource/Benchmarks/Misc/richards_benchmark: -2.12% (1.1560 => 1.1315, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: -1.93% (9.3358 => 9.1557, std. dev.: 0.0303) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.88% (6.6320 => 6.5076, std. dev.: 0.0049) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.83% (20.3410 => 19.9696, std. dev.: 0.0249) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: -1.62% (28.2225 => 27.7640, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9957, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout/heapsort: -1.55% (3.9173 => 3.8564, std. dev.: 0.0069) MultiSource/Applications/lua/lua: -1.53% (26.5159 => 26.1110, std. dev.: 0.0173) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.43% (8.8259 => 8.7001, std. dev.: 0.0225) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.11% (3.8887 => 3.8455, std. dev.: 0.0081) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.01s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed May 30 23:04:32 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 31 May 2012 01:04:32 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120531060432.7551A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/861?compare_to=860&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 861, Order: 157731, Start Time: 2012-05-31 05:09:08, End Time: 2012-05-31 06:05:36 To: 860, Order: 157730, Start Time: 2012-05-31 03:39:52, End Time: 2012-05-31 04:36:20 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (54 on baseline) Performance Improvements: 0 (41 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (795 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.43% (2.0176 => 2.2684, std. dev.: 0.0137) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.53% (0.3130 => 0.3303, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.09% (3.9660 => 4.0884, std. dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.53% (0.5265 => 0.5398, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.48% (0.9199 => 0.9427, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 2.41% (1.0594 => 1.0849, std. dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: 2.39% (13.8202 => 14.1505, std. dev.: 0.0085) MultiSource/Benchmarks/Prolangs-C/football/football: 2.31% (0.8310 => 0.8502, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.30% (0.6959 => 0.7119, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.12% (1.2193 => 1.2451, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.08% (0.5637 => 0.5754, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.02% (1.1364 => 1.1593, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.01% (0.7710 => 0.7865, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.70% (1.3245 => 1.3470, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.68% (1.4563 => 1.4807, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.52% (13.2842 => 13.4867, std. dev.: 0.0029) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.42% (0.7460 => 0.7566, std. dev.: 0.0013) MultiSource/Applications/SIBsim4/SIBsim4: 1.33% (1.2749 => 1.2919, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 1.30% (2.1791 => 2.2074, std. dev.: 0.0038) MultiSource/Benchmarks/MallocBench/gs/gs: 1.30% (3.8646 => 3.9147, std. dev.: 0.0016) MultiSource/Applications/treecc/treecc: 1.26% (1.9270 => 1.9513, std. dev.: 0.0013) MultiSource/Applications/Burg/burg: 1.25% (1.1061 => 1.1199, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.24% (1.3819 => 1.3990, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.16% (3.6692 => 3.7119, std. dev.: 0.0083) MultiSource/Applications/kimwitu++/kc: 1.16% (16.6129 => 16.8053, std. dev.: 0.0105) MultiSource/Applications/JM/lencod/lencod: 1.14% (14.8535 => 15.0231, std. dev.: 0.0017) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.14% (1.3813 => 1.3970, std. dev.: 0.0026) MultiSource/Applications/sqlite3/sqlite3: 1.06% (16.2614 => 16.4341, std. dev.: 0.0030) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 24.25% (1.8175 => 2.2583, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/mandel-2: 6.89% (1.2998 => 1.3894, std. dev.: 0.0108) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.90% (1.5824 => 1.6757, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9875, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/salsa20: 3.73% (7.4271 => 7.7045, std. dev.: 0.0025) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.68% (1.7688 => 1.8339, std. dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4550, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-6: 2.91% (1.9199 => 1.9758, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 2.80% (11.2619 => 11.5774, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9393, std. dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 2.36% (4.5928 => 4.7013, std. dev.: 0.0017) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.28% (7.9275 => 8.1082, std. dev.: 0.0195) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 1.68% (3.2729 => 3.3279, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/ffbench: 1.62% (0.8273 => 0.8407, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: 1.60% (1.9290 => 1.9598, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.50% (1.4298 => 1.4512, std. dev.: 0.0034) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5089, std. dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.25% (2.0200 => 2.0453, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1778, std. dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: 1.08% (1.2308 => 1.2441, std. dev.: 0.0011) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -21.99% (0.4657 => 0.3633, std. dev.: 0.0069) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.23% (0.2670 => 0.2477, std. dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.10% (22.5627 => 20.9609, std. dev.: 0.0085) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.95% (0.3511 => 0.3267, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-3: -4.55% (0.3623 => 0.3458, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.55% (0.3650 => 0.3484, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -4.44% (0.3601 => 0.3441, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-4: -4.42% (0.3646 => 0.3485, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -4.33% (0.3578 => 0.3423, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/property: -4.21% (0.3940 => 0.3774, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: -4.20% (0.3663 => 0.3509, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: -4.17% (0.3789 => 0.3631, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -3.91% (0.3914 => 0.3761, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -3.77% (0.4003 => 0.3852, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: -2.64% (0.6250 => 0.6085, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.54% (0.8818 => 0.8594, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.43% (0.6576 => 0.6416, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.68% (0.9108 => 0.8955, std. dev.: 0.0009) MultiSource/Applications/lua/lua: -1.33% (3.7467 => 3.6967, std. dev.: 0.0016) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.13% (1.0460 => 0.9505, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9624, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.38% (1.3780 => 1.3177, std. dev.: 0.0139) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0011) SingleSource/Benchmarks/Dhrystone/dry: -4.02% (2.5089 => 2.4080, std. dev.: 0.0039) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.73% (0.3458 => 0.3329, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.63% (1.9762 => 1.9044, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: -2.16% (1.1560 => 1.1310, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.13% (20.3410 => 19.9076, std. dev.: 0.0765) SingleSource/Benchmarks/Shootout/lists: -2.11% (6.3560 => 6.2216, std. dev.: 0.0011) MultiSource/Applications/minisat/minisat: -1.95% (9.3358 => 9.1537, std. dev.: 0.0102) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.87% (6.6320 => 6.5082, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3446, std. dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: -1.62% (28.2225 => 27.7645, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9952, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) MultiSource/Applications/lua/lua: -1.49% (26.5159 => 26.1200, std. dev.: 0.0435) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.41% (8.8259 => 8.7014, std. dev.: 0.0051) SingleSource/Benchmarks/Shootout/heapsort: -1.30% (3.9173 => 3.8664, std. dev.: 0.0154) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.55s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu May 31 01:32:53 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 31 May 2012 03:32:53 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120531083253.50D3E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/862?compare_to=861&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 862, Order: 157734, Start Time: 2012-05-31 07:37:07, End Time: 2012-05-31 08:33:57 To: 861, Order: 157731, Start Time: 2012-05-31 05:09:08, End Time: 2012-05-31 06:05:36 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (52 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (798 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.35% (2.0176 => 2.2667, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.53% (0.3130 => 0.3303, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.07% (3.9660 => 4.0878, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.64% (0.6959 => 0.7143, std. dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.50% (0.9199 => 0.9429, std. dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: 2.48% (13.8202 => 14.1626, std. dev.: 0.0147) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.43% (0.5265 => 0.5393, std. dev.: 0.0024) MultiSource/Benchmarks/nbench/nbench: 2.42% (1.0594 => 1.0850, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/football/football: 2.23% (0.8310 => 0.8495, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.16% (1.1364 => 1.1609, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.11% (1.2193 => 1.2450, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.06% (0.5637 => 0.5753, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.82% (1.4563 => 1.4828, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.71% (1.3245 => 1.3472, std. dev.: 0.0059) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.62% (0.7460 => 0.7581, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.60% (0.7710 => 0.7833, std. dev.: 0.0025) MultiSource/Applications/Burg/burg: 1.56% (1.1061 => 1.1234, std. dev.: 0.0061) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.55% (13.2842 => 13.4900, std. dev.: 0.0066) MultiSource/Applications/siod/siod: 1.47% (2.1791 => 2.2112, std. dev.: 0.0060) MultiSource/Applications/lambda-0_1_3/lambda: 1.45% (0.7038 => 0.7140, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.44% (1.3819 => 1.4018, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 1.43% (3.8646 => 3.9200, std. dev.: 0.0074) MultiSource/Applications/kimwitu++/kc: 1.39% (16.6129 => 16.8442, std. dev.: 0.0103) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.35% (1.3813 => 1.4000, std. dev.: 0.0009) MultiSource/Applications/treecc/treecc: 1.33% (1.9270 => 1.9527, std. dev.: 0.0026) MultiSource/Applications/SIBsim4/SIBsim4: 1.32% (1.2749 => 1.2917, std. dev.: 0.0022) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.71% (0.4846 => 0.6964, std. dev.: 0.0052) SingleSource/Benchmarks/Misc/fbench: 24.10% (1.8175 => 2.2555, std. dev.: 0.0481) SingleSource/Benchmarks/Misc/mandel-2: 8.05% (1.2998 => 1.4044, std. dev.: 0.0059) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.86% (1.5824 => 1.6752, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8146, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9880, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 3.76% (7.4271 => 7.7064, std. dev.: 0.0047) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.61% (1.7688 => 1.8326, std. dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4539, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: 2.89% (1.9199 => 1.9754, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 2.79% (11.2619 => 11.5765, std. dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.74% (2.8606 => 2.9391, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.52% (7.9275 => 8.1274, std. dev.: 0.0053) MultiSource/Applications/sqlite3/sqlite3: 2.35% (4.5928 => 4.7007, std. dev.: 0.0096) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 1.74% (3.2729 => 3.3298, std. dev.: 0.0026) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.58% (0.8273 => 0.8404, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.41% (1.4298 => 1.4500, std. dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5080, std. dev.: 0.0032) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.32% (2.0200 => 2.0466, std. dev.: 0.0025) MultiSource/Benchmarks/sim/sim: 1.19% (5.0168 => 5.0767, std. dev.: 0.0090) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 1.10% (9.0760 => 9.1759, std. dev.: 0.0020) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.15% (0.2670 => 0.2479, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.08% (22.5627 => 20.9661, std. dev.: 0.0109) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.04% (0.3511 => 0.3264, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-3: -4.50% (0.3623 => 0.3460, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.38% (0.3650 => 0.3490, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-4: -4.36% (0.3646 => 0.3487, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -4.33% (0.3601 => 0.3445, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/trivial-interface: -4.33% (0.3578 => 0.3423, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -4.29% (0.3663 => 0.3506, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -4.14% (0.3940 => 0.3777, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -4.01% (0.3789 => 0.3637, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -3.91% (0.3914 => 0.3761, std. dev.: 0.0031) SingleSource/UnitTests/ObjC/parameter-passing: -3.70% (0.4003 => 0.3855, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.86% (0.8818 => 0.8566, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.55% (0.6576 => 0.6408, std. dev.: 0.0042) SingleSource/Benchmarks/Misc-C++/bigfib: -2.22% (0.6250 => 0.6111, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.66% (0.9108 => 0.8957, std. dev.: 0.0003) MultiSource/Applications/lua/lua: -1.24% (3.7467 => 3.7002, std. dev.: 0.0016) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.13% (1.0460 => 0.9505, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0007) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9623, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.22% (1.3780 => 1.3198, std. dev.: 0.0112) SingleSource/Benchmarks/Dhrystone/dry: -3.99% (2.5089 => 2.4087, std. dev.: 0.0009) MultiSource/Benchmarks/Olden/bh/bh: -3.75% (1.9762 => 1.9020, std. dev.: 0.0016) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.67% (0.3458 => 0.3331, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -2.36% (6.3560 => 6.2061, std. dev.: 0.0144) SingleSource/Benchmarks/Misc/richards_benchmark: -2.15% (1.1560 => 1.1312, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.03% (20.3410 => 19.9285, std. dev.: 0.0611) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.87% (6.6320 => 6.5079, std. dev.: 0.0023) MultiSource/Applications/minisat/minisat: -1.85% (9.3358 => 9.1634, std. dev.: 0.0046) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3446, std. dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: -1.63% (28.2225 => 27.7624, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9957, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.56% (8.8259 => 8.6886, std. dev.: 0.0265) MultiSource/Applications/lua/lua: -1.49% (26.5159 => 26.1198, std. dev.: 0.0273) SingleSource/Benchmarks/Shootout/heapsort: -1.34% (3.9173 => 3.8647, std. dev.: 0.0103) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.64s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu May 31 02:55:27 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 31 May 2012 04:55:27 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120531095527.E7B4E2A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/863?compare_to=862&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 863, Order: 157736, Start Time: 2012-05-31 09:00:00, End Time: 2012-05-31 09:56:32 To: 862, Order: 157734, Start Time: 2012-05-31 07:37:07, End Time: 2012-05-31 08:33:57 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (55 on baseline) Performance Improvements: 1 (43 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 893 (792 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -13.63% (0.4219 => 0.3644, std. dev.: 0.0099) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.56% (2.0176 => 2.2711, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.56% (0.3130 => 0.3304, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.15% (3.9660 => 4.0910, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.76% (0.6959 => 0.7151, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.65% (0.9199 => 0.9443, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.62% (0.5265 => 0.5403, std. dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 2.57% (13.8202 => 14.1748, std. dev.: 0.0138) MultiSource/Benchmarks/nbench/nbench: 2.52% (1.0594 => 1.0861, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/football/football: 2.29% (0.8310 => 0.8500, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.22% (0.5637 => 0.5762, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.21% (1.2193 => 1.2462, std. dev.: 0.0023) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.10% (1.1364 => 1.1603, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.97% (0.7710 => 0.7862, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.83% (1.4563 => 1.4829, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.79% (0.5577 => 0.5677, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.75% (1.3245 => 1.3477, std. dev.: 0.0011) MultiSource/Applications/siod/siod: 1.69% (2.1791 => 2.2160, std. dev.: 0.0045) MultiSource/Benchmarks/MallocBench/gs/gs: 1.59% (3.8646 => 3.9260, std. dev.: 0.0057) MultiSource/Applications/kimwitu++/kc: 1.54% (16.6129 => 16.8681, std. dev.: 0.0063) MultiSource/Applications/lambda-0_1_3/lambda: 1.53% (0.7038 => 0.7146, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.50% (13.2842 => 13.4835, std. dev.: 0.0198) MultiSource/Applications/Burg/burg: 1.46% (1.1061 => 1.1223, std. dev.: 0.0022) MultiSource/Applications/hbd/hbd: 1.46% (1.3693 => 1.3893, std. dev.: 0.0033) MultiSource/Applications/SIBsim4/SIBsim4: 1.40% (1.2749 => 1.2928, std. dev.: 0.0024) MultiSource/Applications/treecc/treecc: 1.36% (1.9270 => 1.9533, std. dev.: 0.0088) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.36% (1.3813 => 1.4001, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.30% (1.3819 => 1.3998, std. dev.: 0.0044) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.01% (3.6692 => 3.7061, std. dev.: 0.0018) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 24.38% (1.8175 => 2.2606, std. dev.: 0.0421) SingleSource/Benchmarks/Misc/mandel-2: 7.82% (1.2998 => 1.4014, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/flops-4: 6.52% (1.0640 => 1.1334, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6754, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8146, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9881, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.77% (1.7688 => 1.8355, std. dev.: 0.0166) SingleSource/Benchmarks/Misc/salsa20: 3.55% (7.4271 => 7.6906, std. dev.: 0.0067) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4539, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-6: 2.82% (1.9199 => 1.9741, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 2.80% (11.2619 => 11.5775, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9394, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.55% (7.9275 => 8.1293, std. dev.: 0.0047) MultiSource/Applications/sqlite3/sqlite3: 2.43% (4.5928 => 4.7044, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 1.73% (3.2729 => 3.3295, std. dev.: 0.0006) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9603, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.56% (0.8273 => 0.8402, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.44% (1.4298 => 1.4504, std. dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5090, std. dev.: 0.0078) MultiSource/Benchmarks/Olden/bisort/bisort: 1.29% (0.8239 => 0.8345, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.27% (2.0200 => 2.0456, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.15% (1.9433 => 1.9656, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1774, std. dev.: 0.0007) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -21.75% (0.4657 => 0.3644, std. dev.: 0.0099) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.15% (0.2670 => 0.2479, std. dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.05% (22.5627 => 20.9722, std. dev.: 0.0121) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.01% (0.3511 => 0.3265, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-3: -4.64% (0.3623 => 0.3455, std. dev.: 0.0021) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.49% (0.3650 => 0.3486, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -4.47% (0.3601 => 0.3440, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -4.39% (0.3646 => 0.3486, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -4.37% (0.3663 => 0.3503, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -4.36% (0.3578 => 0.3422, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -4.16% (0.3940 => 0.3776, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -4.04% (0.3789 => 0.3636, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -3.88% (0.3914 => 0.3762, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -3.75% (0.4003 => 0.3853, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.92% (0.6576 => 0.6384, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.74% (0.8818 => 0.8576, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: -2.18% (0.6250 => 0.6114, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.64% (0.9108 => 0.8959, std. dev.: 0.0007) MultiSource/Applications/lua/lua: -1.24% (3.7467 => 3.7004, std. dev.: 0.0036) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.13% (1.0460 => 0.9505, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.44% (0.3139 => 0.2937, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2642, std. dev.: 0.0005) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9623, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.01% (1.3780 => 1.3227, std. dev.: 0.0040) SingleSource/Benchmarks/Dhrystone/dry: -3.95% (2.5089 => 2.4099, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.73% (0.3458 => 0.3329, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.68% (1.9762 => 1.9034, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/richards_benchmark: -2.15% (1.1560 => 1.1312, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: -1.90% (9.3358 => 9.1587, std. dev.: 0.0392) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.79% (6.6320 => 6.5133, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout/lists: -1.76% (6.3560 => 6.2439, std. dev.: 0.0067) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.69% (20.3410 => 19.9966, std. dev.: 0.0743) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: -1.63% (28.2225 => 27.7631, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9954, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.47% (8.8259 => 8.6961, std. dev.: 0.0233) SingleSource/Benchmarks/Shootout/heapsort: -1.45% (3.9173 => 3.8604, std. dev.: 0.0178) MultiSource/Applications/lua/lua: -1.33% (26.5159 => 26.1641, std. dev.: 0.0197) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.13% (2.5254 => 2.4968, std. dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.03% (3.8887 => 3.8485, std. dev.: 0.0049) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.59s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu May 31 04:18:10 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 31 May 2012 06:18:10 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120531111810.9F6B02A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/864?compare_to=863&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 864, Order: 157737, Start Time: 2012-05-31 10:22:35, End Time: 2012-05-31 11:19:15 To: 863, Order: 157736, Start Time: 2012-05-31 09:00:00, End Time: 2012-05-31 09:56:32 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (56 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 893 (794 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.33% (0.8576 => 0.8690, std. dev.: 0.0009) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.37% (2.0176 => 2.2671, std. dev.: 0.0163) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.04% (0.3130 => 0.3319, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.15% (0.2721 => 0.2834, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.19% (3.9660 => 4.0924, std. dev.: 0.0175) MultiSource/Benchmarks/nbench/nbench: 2.86% (1.0594 => 1.0897, std. dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.76% (0.9199 => 0.9453, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.70% (0.6959 => 0.7147, std. dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 2.64% (13.8202 => 14.1849, std. dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/football/football: 2.61% (0.8310 => 0.8527, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.57% (1.2193 => 1.2506, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.51% (0.5265 => 0.5397, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.29% (1.1364 => 1.1624, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.20% (0.5637 => 0.5761, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.97% (1.4563 => 1.4850, std. dev.: 0.0105) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.96% (1.3245 => 1.3504, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.83% (13.2842 => 13.5269, std. dev.: 0.0090) MultiSource/Applications/lambda-0_1_3/lambda: 1.78% (0.7038 => 0.7163, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/gs/gs: 1.74% (3.8646 => 3.9319, std. dev.: 0.0030) MultiSource/Applications/kimwitu++/kc: 1.71% (16.6129 => 16.8973, std. dev.: 0.0205) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.69% (0.7460 => 0.7586, std. dev.: 0.0009) MultiSource/Applications/treecc/treecc: 1.68% (1.9270 => 1.9594, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 1.67% (1.1061 => 1.1246, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.54% (0.7710 => 0.7829, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.54% (1.3819 => 1.4032, std. dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.50% (3.2742 => 3.3232, std. dev.: 0.0019) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.46% (1.3813 => 1.4015, std. dev.: 0.0022) MultiSource/Applications/SIBsim4/SIBsim4: 1.45% (1.2749 => 1.2934, std. dev.: 0.0018) MultiSource/Applications/JM/lencod/lencod: 1.45% (14.8535 => 15.0690, std. dev.: 0.0151) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.29% (3.6692 => 3.7167, std. dev.: 0.0152) MultiSource/Applications/hbd/hbd: 1.18% (1.3693 => 1.3855, std. dev.: 0.0020) MultiSource/Applications/sqlite3/sqlite3: 1.05% (16.2614 => 16.4316, std. dev.: 0.0185) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 24.40% (1.8175 => 2.2609, std. dev.: 0.0144) SingleSource/Benchmarks/Misc/mandel-2: 7.98% (1.2998 => 1.4035, std. dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.52% (2.5629 => 2.7299, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6755, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8146, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9880, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.77% (1.7688 => 1.8354, std. dev.: 0.0054) SingleSource/Benchmarks/Misc/salsa20: 3.62% (7.4271 => 7.6961, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/flops-6: 3.01% (1.9199 => 1.9777, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4538, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 2.81% (11.2619 => 11.5789, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9392, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.60% (7.9275 => 8.1336, std. dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: 2.39% (4.5928 => 4.7027, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 1.72% (3.2729 => 3.3293, std. dev.: 0.0014) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9603, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.58% (0.8273 => 0.8404, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5093, std. dev.: 0.0021) MultiSource/Applications/lemon/lemon: 1.41% (1.4298 => 1.4499, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.26% (2.0200 => 2.0454, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/flops: 1.11% (9.0760 => 9.1771, std. dev.: 0.0017) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -19.41% (0.4657 => 0.3753, std. dev.: 0.0284) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.76% (22.5627 => 21.0365, std. dev.: 0.0146) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.52% (0.2670 => 0.2496, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.27% (0.3511 => 0.3291, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-3: -4.94% (0.3623 => 0.3444, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.93% (0.3650 => 0.3470, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/synchronized: -4.80% (0.3663 => 0.3487, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -4.75% (0.3578 => 0.3408, std. dev.: 0.0039) SingleSource/UnitTests/ObjC/exceptions-2: -4.69% (0.3601 => 0.3432, std. dev.: 0.0027) SingleSource/UnitTests/ObjC/exceptions-4: -4.64% (0.3646 => 0.3477, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -4.44% (0.3940 => 0.3765, std. dev.: 0.0059) SingleSource/UnitTests/ObjC/for-in: -4.25% (0.3789 => 0.3628, std. dev.: 0.0058) SingleSource/UnitTests/ObjC/exceptions: -4.19% (0.3914 => 0.3750, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: -4.00% (0.4003 => 0.3843, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: -2.30% (0.6250 => 0.6106, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.24% (0.6576 => 0.6429, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.45% (0.8818 => 0.8690, std. dev.: 0.0009) MultiSource/Applications/lua/lua: -1.16% (3.7467 => 3.7034, std. dev.: 0.0029) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.14% (1.0460 => 0.9504, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.12% (1.3780 => 1.3075, std. dev.: 0.0090) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9624, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -3.93% (2.5089 => 2.4103, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.73% (0.3458 => 0.3329, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.61% (1.9762 => 1.9048, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: -2.15% (1.1560 => 1.1312, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.13% (20.3410 => 19.9082, std. dev.: 0.0471) SingleSource/Benchmarks/Shootout/lists: -2.03% (6.3560 => 6.2271, std. dev.: 0.0081) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.95% (6.6320 => 6.5029, std. dev.: 0.0051) MultiSource/Applications/minisat/minisat: -1.72% (9.3358 => 9.1752, std. dev.: 0.0333) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3446, std. dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: -1.63% (28.2225 => 27.7633, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9957, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) MultiSource/Applications/lua/lua: -1.48% (26.5159 => 26.1236, std. dev.: 0.0043) SingleSource/Benchmarks/Shootout/heapsort: -1.40% (3.9173 => 3.8624, std. dev.: 0.0060) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.35% (8.8259 => 8.7069, std. dev.: 0.0117) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.31s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu May 31 08:14:33 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 31 May 2012 10:14:33 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120531151433.EB0452A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/865?compare_to=864&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 865, Order: 157741, Start Time: 2012-05-31 14:19:01, End Time: 2012-05-31 15:15:38 To: 864, Order: 157737, Start Time: 2012-05-31 10:22:35, End Time: 2012-05-31 11:19:15 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (62 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (789 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.24% (2.0176 => 2.2848, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.17% (0.3130 => 0.3323, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.23% (0.2721 => 0.2836, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.81% (3.9660 => 4.1170, std. dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.02% (0.6959 => 0.7169, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.99% (0.9199 => 0.9474, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.96% (0.5265 => 0.5421, std. dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 2.92% (1.0594 => 1.0903, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 2.89% (13.8202 => 14.2201, std. dev.: 0.0176) MultiSource/Benchmarks/Prolangs-C/football/football: 2.72% (0.8310 => 0.8536, std. dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.63% (1.2193 => 1.2514, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.57% (0.5637 => 0.5782, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.50% (0.7710 => 0.7903, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.49% (1.1364 => 1.1647, std. dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.30% (0.4791 => 0.4901, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.19% (1.3245 => 1.3535, std. dev.: 0.0015) MultiSource/Applications/kimwitu++/kc: 2.18% (16.6129 => 16.9755, std. dev.: 0.0102) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.05% (0.7460 => 0.7613, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.96% (1.4563 => 1.4849, std. dev.: 0.0018) MultiSource/Applications/Burg/burg: 1.96% (1.1061 => 1.1278, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/gs/gs: 1.91% (3.8646 => 3.9385, std. dev.: 0.0016) MultiSource/Applications/siod/siod: 1.90% (2.1791 => 2.2206, std. dev.: 0.0018) MultiSource/Applications/lambda-0_1_3/lambda: 1.89% (0.7038 => 0.7171, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.86% (0.5577 => 0.5681, std. dev.: 0.0011) MultiSource/Applications/treecc/treecc: 1.80% (1.9270 => 1.9617, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.80% (13.2842 => 13.5234, std. dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.65% (3.2742 => 3.3282, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.53% (3.6692 => 3.7253, std. dev.: 0.0083) MultiSource/Applications/JM/lencod/lencod: 1.52% (14.8535 => 15.0787, std. dev.: 0.0036) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.49% (1.3813 => 1.4019, std. dev.: 0.0030) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.48% (1.3819 => 1.4024, std. dev.: 0.0012) MultiSource/Applications/hbd/hbd: 1.48% (1.3693 => 1.3895, std. dev.: 0.0018) MultiSource/Applications/SIBsim4/SIBsim4: 1.34% (1.2749 => 1.2920, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.21% (2.1007 => 2.1261, std. dev.: 0.0013) MultiSource/Applications/sqlite3/sqlite3: 1.07% (16.2614 => 16.4356, std. dev.: 0.0021) MultiSource/Applications/JM/ldecod/ldecod: 1.03% (6.5754 => 6.6430, std. dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.01% (1.5188 => 1.5341, std. dev.: 0.0011) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 24.10% (1.8175 => 2.2556, std. dev.: 0.0058) SingleSource/Benchmarks/Misc/mandel-2: 7.76% (1.2998 => 1.4006, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7298, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.86% (1.5824 => 1.6751, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9880, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 3.60% (7.4271 => 7.6946, std. dev.: 0.0033) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.59% (1.7688 => 1.8323, std. dev.: 0.0016) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4544, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/flops-6: 2.94% (1.9199 => 1.9763, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 2.79% (11.2619 => 11.5763, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9394, std. dev.: 0.0026) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.39% (7.9275 => 8.1166, std. dev.: 0.0055) MultiSource/Applications/sqlite3/sqlite3: 2.32% (4.5928 => 4.6995, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 1.73% (3.2729 => 3.3294, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/ffbench: 1.62% (0.8273 => 0.8407, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5091, std. dev.: 0.0009) MultiSource/Applications/lemon/lemon: 1.41% (1.4298 => 1.4499, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.31% (2.0200 => 2.0464, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 1.14% (9.0760 => 9.1791, std. dev.: 0.0005) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.82% (0.2670 => 0.2488, std. dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.52% (22.5627 => 21.0920, std. dev.: 0.0083) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.29% (0.3511 => 0.3290, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-3: -4.09% (0.3623 => 0.3475, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.97% (0.3650 => 0.3505, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -3.88% (0.3663 => 0.3521, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -3.84% (0.3646 => 0.3506, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -3.83% (0.3578 => 0.3441, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -3.78% (0.3601 => 0.3465, std. dev.: 0.0024) SingleSource/UnitTests/ObjC/property: -3.48% (0.3940 => 0.3803, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -3.46% (0.3789 => 0.3658, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -3.27% (0.3914 => 0.3786, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: -3.17% (0.4003 => 0.3876, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.80% (0.6576 => 0.6392, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.97% (0.8818 => 0.8644, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: -1.94% (0.6250 => 0.6129, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.14% (1.0460 => 0.9504, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0003) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9623, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.29% (1.3780 => 1.3189, std. dev.: 0.0045) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -4.03% (2.5089 => 2.4079, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.62% (1.9762 => 1.9047, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/richards_benchmark: -2.15% (1.1560 => 1.1311, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: -1.99% (9.3358 => 9.1496, std. dev.: 0.0110) SingleSource/Benchmarks/Shootout/lists: -1.99% (6.3560 => 6.2293, std. dev.: 0.0036) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.85% (6.6320 => 6.5095, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3444, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.66% (20.3410 => 20.0036, std. dev.: 0.0200) MultiSource/Benchmarks/mafft/pairlocalalign: -1.63% (28.2225 => 27.7635, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9954, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.56% (8.8259 => 8.6882, std. dev.: 0.0149) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.56% (0.9692 => 0.9541, std. dev.: 0.0000) MultiSource/Applications/lua/lua: -1.51% (26.5159 => 26.1143, std. dev.: 0.0313) SingleSource/Benchmarks/Shootout/heapsort: -1.45% (3.9173 => 3.8604, std. dev.: 0.0174) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.04% (3.8887 => 3.8484, std. dev.: 0.0032) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.57s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu May 31 09:37:03 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 31 May 2012 11:37:03 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120531163703.AA6032A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/866?compare_to=865&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 866, Order: 157745, Start Time: 2012-05-31 15:41:37, End Time: 2012-05-31 16:38:09 To: 865, Order: 157741, Start Time: 2012-05-31 14:19:01, End Time: 2012-05-31 15:15:38 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (65 on baseline) Performance Improvements: 1 (39 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 893 (786 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -9.00% (0.3990 => 0.3631, std. dev.: 0.0084) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.28% (2.0176 => 2.2855, std. dev.: 0.0058) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.19% (0.2721 => 0.2835, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.50% (3.9660 => 4.1049, std. dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.12% (0.6959 => 0.7176, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 3.08% (1.0594 => 1.0920, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.88% (0.9199 => 0.9464, std. dev.: 0.0027) MultiSource/Applications/SPASS/SPASS: 2.87% (13.8202 => 14.2168, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.85% (0.5265 => 0.5415, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.67% (1.2193 => 1.2518, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 2.64% (0.8310 => 0.8529, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.43% (0.5637 => 0.5774, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.42% (1.1364 => 1.1639, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.25% (0.4791 => 0.4899, std. dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 2.13% (16.6129 => 16.9668, std. dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.11% (1.3245 => 1.3525, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.09% (1.4563 => 1.4868, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 2.02% (0.7038 => 0.7180, std. dev.: 0.0017) MultiSource/Benchmarks/MallocBench/gs/gs: 2.00% (3.8646 => 3.9418, std. dev.: 0.0087) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.98% (13.2842 => 13.5474, std. dev.: 0.0044) MultiSource/Applications/siod/siod: 1.95% (2.1791 => 2.2216, std. dev.: 0.0047) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.93% (0.7710 => 0.7859, std. dev.: 0.0020) MultiSource/Applications/Burg/burg: 1.93% (1.1061 => 1.1274, std. dev.: 0.0030) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.89% (0.7460 => 0.7601, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.81% (0.5577 => 0.5678, std. dev.: 0.0001) MultiSource/Applications/treecc/treecc: 1.76% (1.9270 => 1.9609, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.68% (3.2742 => 3.3293, std. dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.66% (0.6135 => 0.6237, std. dev.: 0.0006) MultiSource/Applications/JM/lencod/lencod: 1.50% (14.8535 => 15.0762, std. dev.: 0.0147) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.46% (3.6692 => 3.7226, std. dev.: 0.0070) MultiSource/Applications/hbd/hbd: 1.45% (1.3693 => 1.3892, std. dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 1.44% (1.2749 => 1.2933, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.40% (1.3819 => 1.4012, std. dev.: 0.0064) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.32% (1.3813 => 1.3996, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.23% (2.1007 => 2.1266, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.10% (1.5188 => 1.5355, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 1.09% (6.5754 => 6.6472, std. dev.: 0.0154) MultiSource/Applications/sqlite3/sqlite3: 1.06% (16.2614 => 16.4339, std. dev.: 0.0193) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/fbench: 24.46% (1.8175 => 2.2620, std. dev.: 0.0446) SingleSource/Benchmarks/Misc/mandel-2: 7.66% (1.2998 => 1.3994, std. dev.: 0.0075) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.91% (1.5824 => 1.6759, std. dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8146, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.80% (1.9144 => 1.9872, std. dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.68% (1.7688 => 1.8339, std. dev.: 0.0056) SingleSource/Benchmarks/Misc/salsa20: 3.60% (7.4271 => 7.6944, std. dev.: 0.0099) MultiSource/Applications/hexxagon/hexxagon: 2.98% (12.0921 => 12.4520, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-6: 2.85% (1.9199 => 1.9746, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 2.80% (11.2619 => 11.5773, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9394, std. dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.52% (7.9275 => 8.1276, std. dev.: 0.0071) MultiSource/Applications/sqlite3/sqlite3: 2.34% (4.5928 => 4.7005, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 1.72% (3.2729 => 3.3293, std. dev.: 0.0008) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/ffbench: 1.56% (0.8273 => 0.8402, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 1.44% (5.0168 => 5.0892, std. dev.: 0.0045) MultiSource/Benchmarks/NPB-serial/is/is: 1.43% (8.3908 => 8.5104, std. dev.: 0.0073) MultiSource/Applications/lemon/lemon: 1.40% (1.4298 => 1.4498, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.28% (2.0200 => 2.0459, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bisort/bisort: 1.23% (0.8239 => 0.8340, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.21% (1.9433 => 1.9668, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/flops: 1.09% (9.0760 => 9.1752, std. dev.: 0.0030) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -22.03% (0.4657 => 0.3631, std. dev.: 0.0084) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.82% (0.2670 => 0.2488, std. dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.57% (22.5627 => 21.0795, std. dev.: 0.0112) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.32% (0.3511 => 0.3289, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-3: -4.06% (0.3623 => 0.3476, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -4.05% (0.3601 => 0.3455, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.97% (0.3650 => 0.3505, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -3.88% (0.3663 => 0.3521, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -3.87% (0.3646 => 0.3505, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -3.83% (0.3578 => 0.3441, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -3.54% (0.3789 => 0.3655, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -3.50% (0.3940 => 0.3802, std. dev.: 0.0025) SingleSource/UnitTests/ObjC/parameter-passing: -3.22% (0.4003 => 0.3874, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.74% (0.6576 => 0.6396, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.98% (0.8818 => 0.8643, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: -1.86% (0.6250 => 0.6134, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.13% (1.0460 => 0.9505, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.44% (0.3139 => 0.2937, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0004) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9622, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.53% (1.3780 => 1.3156, std. dev.: 0.0069) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -4.04% (2.5089 => 2.4075, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.73% (0.3458 => 0.3329, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -3.68% (1.9762 => 1.9035, std. dev.: 0.0048) SingleSource/Benchmarks/Shootout/lists: -2.27% (6.3560 => 6.2119, std. dev.: 0.0104) SingleSource/Benchmarks/Misc/richards_benchmark: -2.13% (1.1560 => 1.1314, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: -2.02% (9.3358 => 9.1475, std. dev.: 0.0278) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.97% (20.3410 => 19.9397, std. dev.: 0.0292) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.86% (6.6320 => 6.5085, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3445, std. dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: -1.63% (28.2225 => 27.7633, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9954, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) MultiSource/Applications/lua/lua: -1.47% (26.5159 => 26.1252, std. dev.: 0.0211) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.45% (8.8259 => 8.6976, std. dev.: 0.0120) SingleSource/Benchmarks/Shootout/heapsort: -1.45% (3.9173 => 3.8605, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.12% (3.8887 => 3.8453, std. dev.: 0.0042) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.32s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu May 31 10:59:41 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 31 May 2012 12:59:41 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120531175941.771772A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/867?compare_to=866&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 867, Order: 157749, Start Time: 2012-05-31 17:04:09, End Time: 2012-05-31 18:00:47 To: 866, Order: 157745, Start Time: 2012-05-31 15:41:37, End Time: 2012-05-31 16:38:09 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (52 on baseline) Performance Improvements: 1 (39 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 893 (799 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.22% (2.2855 => 2.2576, std. dev.: 0.0063) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 11.90% (2.0176 => 2.2576, std. dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.01% (0.3130 => 0.3318, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.86% (0.2721 => 0.2826, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.05% (3.9660 => 4.0868, std. dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.56% (0.5265 => 0.5400, std. dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 2.55% (13.8202 => 14.1727, std. dev.: 0.0099) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.49% (0.9199 => 0.9428, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 2.36% (1.0594 => 1.0844, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/football/football: 2.30% (0.8310 => 0.8501, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.18% (1.2193 => 1.2459, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.15% (0.5637 => 0.5758, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.07% (1.1364 => 1.1599, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.80% (1.3245 => 1.3483, std. dev.: 0.0012) MultiSource/Applications/kimwitu++/kc: 1.74% (16.6129 => 16.9020, std. dev.: 0.0234) MultiSource/Applications/siod/siod: 1.67% (2.1791 => 2.2154, std. dev.: 0.0050) MultiSource/Applications/lambda-0_1_3/lambda: 1.66% (0.7038 => 0.7155, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/gs/gs: 1.62% (3.8646 => 3.9273, std. dev.: 0.0041) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.60% (0.7460 => 0.7579, std. dev.: 0.0014) MultiSource/Applications/treecc/treecc: 1.58% (1.9270 => 1.9575, std. dev.: 0.0061) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.57% (1.4563 => 1.4792, std. dev.: 0.0034) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.54% (0.7710 => 0.7829, std. dev.: 0.0018) MultiSource/Applications/Burg/burg: 1.51% (1.1061 => 1.1228, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.49% (13.2842 => 13.4817, std. dev.: 0.0024) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.11% (1.3813 => 1.3967, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.11% (3.2742 => 3.3106, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.05% (3.6692 => 3.7079, std. dev.: 0.0031) MultiSource/Applications/hbd/hbd: 1.04% (1.3693 => 1.3836, std. dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.77% (0.4846 => 0.6967, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/fbench: 24.36% (1.8175 => 2.2602, std. dev.: 0.0055) SingleSource/Benchmarks/Misc/mandel-2: 7.92% (1.2998 => 1.4028, std. dev.: 0.0082) SingleSource/Benchmarks/Misc/flops-4: 6.52% (1.0640 => 1.1334, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.50% (2.5629 => 2.7296, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.87% (1.5824 => 1.6753, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9877, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.62% (1.7688 => 1.8328, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/salsa20: 3.61% (7.4271 => 7.6953, std. dev.: 0.0075) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4553, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-6: 2.92% (1.9199 => 1.9759, std. dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 2.81% (11.2619 => 11.5783, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9392, std. dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 2.40% (4.5928 => 4.7030, std. dev.: 0.0049) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.11% (7.9275 => 8.0947, std. dev.: 0.0139) MultiSource/Applications/siod/siod: 1.73% (3.2729 => 3.3294, std. dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/fldry: 1.60% (1.9290 => 1.9599, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 1.58% (0.8273 => 0.8404, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.55% (1.4298 => 1.4519, std. dev.: 0.0034) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5085, std. dev.: 0.0035) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.29% (2.0200 => 2.0461, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0042) SingleSource/Benchmarks/Misc/flops: 1.11% (9.0760 => 9.1764, std. dev.: 0.0019) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.15% (0.2670 => 0.2479, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.82% (22.5627 => 21.0233, std. dev.: 0.0098) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.52% (0.3511 => 0.3282, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-3: -4.94% (0.3623 => 0.3444, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.90% (0.3650 => 0.3471, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -4.86% (0.3601 => 0.3426, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -4.83% (0.3663 => 0.3486, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -4.81% (0.3578 => 0.3406, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -4.80% (0.3646 => 0.3471, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/property: -4.44% (0.3940 => 0.3765, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -4.33% (0.3789 => 0.3625, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -4.22% (0.3914 => 0.3749, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -4.10% (0.4003 => 0.3839, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.69% (0.6576 => 0.6399, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/bigfib: -2.45% (0.6250 => 0.6097, std. dev.: 0.0026) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.59% (0.9108 => 0.8963, std. dev.: 0.0004) MultiSource/Applications/lua/lua: -1.25% (3.7467 => 3.6997, std. dev.: 0.0055) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.13% (1.0460 => 0.9505, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.02% (1.3780 => 1.3088, std. dev.: 0.0057) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9623, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -3.97% (2.5089 => 2.4092, std. dev.: 0.0013) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.67% (0.3458 => 0.3331, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.65% (1.9762 => 1.9040, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/lists: -2.17% (6.3560 => 6.2180, std. dev.: 0.0107) SingleSource/Benchmarks/Misc/richards_benchmark: -2.12% (1.1560 => 1.1315, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: -1.99% (9.3358 => 9.1500, std. dev.: 0.0057) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.90% (6.6320 => 6.5063, std. dev.: 0.0033) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.82% (20.3410 => 19.9704, std. dev.: 0.0767) SingleSource/Benchmarks/Misc/fp-convert: -1.68% (3.4016 => 3.3446, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: -1.63% (28.2225 => 27.7625, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9954, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.59% (8.8259 => 8.6855, std. dev.: 0.0099) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.56% (0.9692 => 0.9541, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.47% (3.9173 => 3.8597, std. dev.: 0.0019) MultiSource/Applications/lua/lua: -1.45% (26.5159 => 26.1317, std. dev.: 0.0207) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.38s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu May 31 12:22:11 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 31 May 2012 14:22:11 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120531192211.1C6FA2A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/868?compare_to=867&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 868, Order: 157757, Start Time: 2012-05-31 18:26:47, End Time: 2012-05-31 19:23:17 To: 867, Order: 157749, Start Time: 2012-05-31 17:04:09, End Time: 2012-05-31 18:00:47 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (58 on baseline) Performance Improvements: 1 (42 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 892 (790 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.08% (2.2576 => 2.2820, std. dev.: 0.0049) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -8.08% (0.3999 => 0.3676, std. dev.: 0.0041) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.10% (2.0176 => 2.2820, std. dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.91% (0.3130 => 0.3315, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.82% (0.2721 => 0.2825, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.25% (3.9660 => 4.0949, std. dev.: 0.0137) MultiSource/Benchmarks/nbench/nbench: 2.89% (1.0594 => 1.0900, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.65% (0.9199 => 0.9443, std. dev.: 0.0021) MultiSource/Applications/SPASS/SPASS: 2.65% (13.8202 => 14.1867, std. dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.59% (0.6959 => 0.7139, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: 2.58% (0.8310 => 0.8524, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.49% (0.5265 => 0.5396, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.38% (1.2193 => 1.2483, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.30% (0.4791 => 0.4901, std. dev.: 0.0039) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.21% (1.1364 => 1.1615, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.08% (0.5637 => 0.5754, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.03% (1.4563 => 1.4858, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.98% (0.7710 => 0.7863, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.87% (1.3245 => 1.3493, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.83% (13.2842 => 13.5269, std. dev.: 0.0134) MultiSource/Benchmarks/MallocBench/gs/gs: 1.78% (3.8646 => 3.9333, std. dev.: 0.0023) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.61% (0.7460 => 0.7580, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 1.54% (2.1791 => 2.2126, std. dev.: 0.0040) MultiSource/Applications/treecc/treecc: 1.52% (1.9270 => 1.9562, std. dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.47% (3.2742 => 3.3222, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 1.41% (1.1061 => 1.1217, std. dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 1.38% (1.2749 => 1.2925, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.36% (3.6692 => 3.7190, std. dev.: 0.0049) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.34% (1.3819 => 1.4004, std. dev.: 0.0023) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.29% (1.3813 => 1.3991, std. dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: 1.27% (16.2614 => 16.4684, std. dev.: 0.0107) MultiSource/Applications/kimwitu++/kc: 1.24% (16.6129 => 16.8193, std. dev.: 0.0212) MultiSource/Applications/hbd/hbd: 1.19% (1.3693 => 1.3856, std. dev.: 0.0013) MultiSource/Applications/JM/lencod/lencod: 1.17% (14.8535 => 15.0277, std. dev.: 0.0079) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/fbench: 24.06% (1.8175 => 2.2547, std. dev.: 0.0532) SingleSource/Benchmarks/Misc/mandel-2: 7.70% (1.2998 => 1.3999, std. dev.: 0.0100) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7298, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.93% (1.5824 => 1.6762, std. dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8147, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9881, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.65% (1.7688 => 1.8333, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: 3.51% (7.4271 => 7.6880, std. dev.: 0.0095) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4551, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: 2.92% (1.9199 => 1.9759, std. dev.: 0.0015) MultiSource/Benchmarks/nbench/nbench: 2.80% (11.2619 => 11.5772, std. dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.76% (2.8606 => 2.9395, std. dev.: 0.0044) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.64% (7.9275 => 8.1365, std. dev.: 0.0080) MultiSource/Applications/sqlite3/sqlite3: 2.30% (4.5928 => 4.6984, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 1.65% (3.2729 => 3.3269, std. dev.: 0.0015) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9603, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.60% (0.8273 => 0.8405, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.43% (1.4298 => 1.4503, std. dev.: 0.0010) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5086, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.27% (2.0200 => 2.0456, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.20% (1.9433 => 1.9667, std. dev.: 0.0055) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.11% (9.0760 => 9.1769, std. dev.: 0.0022) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -21.07% (0.4657 => 0.3676, std. dev.: 0.0041) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.34% (0.2670 => 0.2474, std. dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.97% (22.5627 => 20.9910, std. dev.: 0.0051) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.75% (0.3511 => 0.3274, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-3: -4.58% (0.3623 => 0.3457, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: -4.44% (0.3578 => 0.3419, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -4.44% (0.3601 => 0.3441, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.44% (0.3650 => 0.3488, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-4: -4.36% (0.3646 => 0.3487, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -4.34% (0.3663 => 0.3504, std. dev.: 0.0029) SingleSource/UnitTests/ObjC/property: -4.21% (0.3940 => 0.3774, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -4.01% (0.3789 => 0.3637, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -3.95% (0.4003 => 0.3845, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -3.93% (0.3914 => 0.3760, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.69% (0.6576 => 0.6399, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.32% (0.8818 => 0.8613, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: -2.19% (0.6250 => 0.6113, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.37% (0.9108 => 0.8983, std. dev.: 0.0001) MultiSource/Applications/lua/lua: -1.24% (3.7467 => 3.7003, std. dev.: 0.0020) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.14% (1.0460 => 0.9504, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2641, std. dev.: 0.0004) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9621, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.48% (1.3780 => 1.3162, std. dev.: 0.0076) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -4.02% (2.5089 => 2.4081, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.73% (0.3458 => 0.3329, std. dev.: 0.0014) MultiSource/Benchmarks/Olden/bh/bh: -3.62% (1.9762 => 1.9047, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -2.17% (6.3560 => 6.2180, std. dev.: 0.0088) SingleSource/Benchmarks/Misc/richards_benchmark: -2.15% (1.1560 => 1.1312, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.09% (20.3410 => 19.9152, std. dev.: 0.0857) MultiSource/Applications/minisat/minisat: -1.90% (9.3358 => 9.1588, std. dev.: 0.0235) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.88% (6.6320 => 6.5076, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9957, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.56% (0.9692 => 0.9541, std. dev.: 0.0000) MultiSource/Applications/lua/lua: -1.52% (26.5159 => 26.1131, std. dev.: 0.0096) MultiSource/Benchmarks/mafft/pairlocalalign: -1.50% (28.2225 => 27.8002, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout/heapsort: -1.44% (3.9173 => 3.8607, std. dev.: 0.0032) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.42% (8.8259 => 8.7009, std. dev.: 0.0145) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.00% (3.8887 => 3.8497, std. dev.: 0.0018) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.28s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu May 31 13:45:01 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 31 May 2012 15:45:01 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120531204501.CD4E82A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/869?compare_to=868&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 869, Order: 157762, Start Time: 2012-05-31 19:49:32, End Time: 2012-05-31 20:46:06 To: 868, Order: 157757, Start Time: 2012-05-31 18:26:47, End Time: 2012-05-31 19:23:17 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (57 on baseline) Performance Improvements: 0 (42 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (791 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.14% (2.0176 => 2.2827, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.94% (0.3130 => 0.3316, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.75% (0.2721 => 0.2823, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.23% (3.9660 => 4.0940, std. dev.: 0.0014) MultiSource/Benchmarks/nbench/nbench: 2.90% (1.0594 => 1.0901, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 2.70% (0.8310 => 0.8534, std. dev.: 0.0084) MultiSource/Applications/SPASS/SPASS: 2.69% (13.8202 => 14.1917, std. dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.62% (0.9199 => 0.9440, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.58% (0.5265 => 0.5401, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.51% (0.6959 => 0.7134, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.38% (1.2193 => 1.2483, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.27% (1.1364 => 1.1622, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.15% (0.5637 => 0.5758, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.92% (0.7710 => 0.7858, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.88% (1.3245 => 1.3494, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.86% (1.4563 => 1.4834, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.77% (13.2842 => 13.5188, std. dev.: 0.0162) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.57% (0.7460 => 0.7577, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/gs/gs: 1.57% (3.8646 => 3.9252, std. dev.: 0.0065) MultiSource/Applications/siod/siod: 1.52% (2.1791 => 2.2122, std. dev.: 0.0051) MultiSource/Applications/treecc/treecc: 1.48% (1.9270 => 1.9555, std. dev.: 0.0015) MultiSource/Applications/Burg/burg: 1.45% (1.1061 => 1.1221, std. dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.39% (3.2742 => 3.3197, std. dev.: 0.0051) MultiSource/Applications/SIBsim4/SIBsim4: 1.37% (1.2749 => 1.2924, std. dev.: 0.0025) MultiSource/Applications/kimwitu++/kc: 1.32% (16.6129 => 16.8317, std. dev.: 0.0081) MultiSource/Applications/sqlite3/sqlite3: 1.32% (16.2614 => 16.4754, std. dev.: 0.0451) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.26% (3.6692 => 3.7153, std. dev.: 0.0020) MultiSource/Applications/JM/lencod/lencod: 1.25% (14.8535 => 15.0396, std. dev.: 0.0093) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.19% (1.3813 => 1.3977, std. dev.: 0.0022) MultiSource/Applications/hbd/hbd: 1.15% (1.3693 => 1.3851, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.09% (1.3819 => 1.3969, std. dev.: 0.0016) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 24.04% (1.8175 => 2.2545, std. dev.: 0.0462) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: 6.39% (1.2998 => 1.3829, std. dev.: 0.0088) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.86% (1.5824 => 1.6752, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8146, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9875, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.65% (1.7688 => 1.8333, std. dev.: 0.0050) SingleSource/Benchmarks/Misc/salsa20: 3.59% (7.4271 => 7.6939, std. dev.: 0.0076) MultiSource/Applications/hexxagon/hexxagon: 2.98% (12.0921 => 12.4530, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-6: 2.88% (1.9199 => 1.9752, std. dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 2.79% (11.2619 => 11.5763, std. dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9393, std. dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 2.29% (4.5928 => 4.6979, std. dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.26% (7.9275 => 8.1069, std. dev.: 0.0064) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 1.74% (3.2729 => 3.3298, std. dev.: 0.0010) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9600, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 1.56% (0.8273 => 0.8402, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.50% (1.4298 => 1.4512, std. dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5093, std. dev.: 0.0049) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.27% (2.0200 => 2.0456, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.26% (1.9433 => 1.9677, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/flops: 1.13% (9.0760 => 9.1784, std. dev.: 0.0007) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -17.93% (0.4657 => 0.3822, std. dev.: 0.0218) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.34% (0.2670 => 0.2474, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.01% (0.3511 => 0.3265, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.91% (22.5627 => 21.0042, std. dev.: 0.0128) SingleSource/UnitTests/ObjC/exceptions-3: -4.47% (0.3623 => 0.3461, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.38% (0.3650 => 0.3490, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-2: -4.30% (0.3601 => 0.3446, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -4.14% (0.3646 => 0.3495, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -4.12% (0.3663 => 0.3512, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -4.11% (0.3578 => 0.3431, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -3.98% (0.3940 => 0.3783, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -3.85% (0.3789 => 0.3643, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -3.75% (0.4003 => 0.3853, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -3.70% (0.3914 => 0.3769, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.65% (0.6576 => 0.6402, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.40% (0.8818 => 0.8606, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: -2.29% (0.6250 => 0.6107, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.44% (0.9108 => 0.8977, std. dev.: 0.0007) MultiSource/Applications/lua/lua: -1.27% (3.7467 => 3.6993, std. dev.: 0.0035) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.13% (1.0460 => 0.9505, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2650, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9623, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.26% (1.3780 => 1.3193, std. dev.: 0.0032) SingleSource/Benchmarks/Dhrystone/dry: -3.97% (2.5089 => 2.4094, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.73% (0.3458 => 0.3329, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.68% (1.9762 => 1.9035, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/lists: -2.21% (6.3560 => 6.2156, std. dev.: 0.0127) SingleSource/Benchmarks/Misc/richards_benchmark: -2.13% (1.1560 => 1.1314, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.92% (6.6320 => 6.5048, std. dev.: 0.0034) MultiSource/Applications/minisat/minisat: -1.89% (9.3358 => 9.1591, std. dev.: 0.0319) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.87% (20.3410 => 19.9612, std. dev.: 0.0476) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9954, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.50% (8.8259 => 8.6932, std. dev.: 0.0232) MultiSource/Benchmarks/mafft/pairlocalalign: -1.50% (28.2225 => 27.7998, std. dev.: 0.0021) MultiSource/Applications/lua/lua: -1.50% (26.5159 => 26.1191, std. dev.: 0.0076) SingleSource/Benchmarks/Shootout/heapsort: -1.47% (3.9173 => 3.8599, std. dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.01% (3.8887 => 3.8493, std. dev.: 0.0051) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.27s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu May 31 15:07:26 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 31 May 2012 17:07:26 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120531220726.C57552A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/870?compare_to=869&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 870, Order: 157763, Start Time: 2012-05-31 21:12:08, End Time: 2012-05-31 22:08:32 To: 869, Order: 157762, Start Time: 2012-05-31 19:49:32, End Time: 2012-05-31 20:46:06 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (57 on baseline) Performance Improvements: 0 (41 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (792 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.12% (2.0176 => 2.2823, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.01% (0.3130 => 0.3318, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.75% (0.2721 => 0.2823, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.27% (3.9660 => 4.0956, std. dev.: 0.0022) MultiSource/Benchmarks/nbench/nbench: 2.79% (1.0594 => 1.0890, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.70% (0.6959 => 0.7147, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 2.69% (13.8202 => 14.1920, std. dev.: 0.0175) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.58% (0.5265 => 0.5401, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/football/football: 2.56% (0.8310 => 0.8523, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.50% (0.9199 => 0.9429, std. dev.: 0.0021) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.38% (1.1364 => 1.1634, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.27% (1.2193 => 1.2470, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.11% (0.4791 => 0.4892, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.08% (0.5637 => 0.5754, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.85% (1.4563 => 1.4833, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.85% (1.3245 => 1.3490, std. dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.73% (13.2842 => 13.5141, std. dev.: 0.0136) MultiSource/Applications/siod/siod: 1.70% (2.1791 => 2.2161, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 1.54% (3.8646 => 3.9241, std. dev.: 0.0124) MultiSource/Applications/treecc/treecc: 1.54% (1.9270 => 1.9566, std. dev.: 0.0007) MultiSource/Applications/Burg/burg: 1.43% (1.1061 => 1.1219, std. dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.42% (3.2742 => 3.3207, std. dev.: 0.0167) MultiSource/Applications/kimwitu++/kc: 1.42% (16.6129 => 16.8483, std. dev.: 0.0118) MultiSource/Applications/SIBsim4/SIBsim4: 1.33% (1.2749 => 1.2919, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.25% (3.6692 => 3.7152, std. dev.: 0.0030) MultiSource/Applications/JM/lencod/lencod: 1.20% (14.8535 => 15.0324, std. dev.: 0.0074) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.20% (1.3813 => 1.3979, std. dev.: 0.0005) MultiSource/Applications/hbd/hbd: 1.20% (1.3693 => 1.3857, std. dev.: 0.0025) MultiSource/Applications/sqlite3/sqlite3: 1.18% (16.2614 => 16.4525, std. dev.: 0.0112) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.14% (1.3819 => 1.3976, std. dev.: 0.0024) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 23.76% (1.8175 => 2.2493, std. dev.: 0.0061) SingleSource/Benchmarks/Misc/mandel-2: 7.92% (1.2998 => 1.4028, std. dev.: 0.0126) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.87% (1.5824 => 1.6753, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.79% (4.5947 => 4.8147, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9880, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: 3.70% (7.4271 => 7.7020, std. dev.: 0.0020) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.65% (1.7688 => 1.8334, std. dev.: 0.0065) MultiSource/Applications/hexxagon/hexxagon: 2.99% (12.0921 => 12.4532, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-6: 2.90% (1.9199 => 1.9755, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 2.80% (11.2619 => 11.5774, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9392, std. dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 2.27% (4.5928 => 4.6971, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.14% (7.9275 => 8.0973, std. dev.: 0.0157) MultiSource/Applications/siod/siod: 1.76% (3.2729 => 3.3304, std. dev.: 0.0013) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ffbench: 1.60% (0.8273 => 0.8405, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5100, std. dev.: 0.0083) MultiSource/Applications/lemon/lemon: 1.33% (1.4298 => 1.4488, std. dev.: 0.0013) MultiSource/Benchmarks/Olden/bisort/bisort: 1.27% (0.8239 => 0.8344, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.27% (2.0200 => 2.0457, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.21% (1.9433 => 1.9669, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 1.10% (9.0760 => 9.1759, std. dev.: 0.0018) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -22.27% (0.4657 => 0.3620, std. dev.: 0.0186) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.34% (0.2670 => 0.2474, std. dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.91% (22.5627 => 21.0026, std. dev.: 0.0181) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.89% (0.3511 => 0.3269, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -4.36% (0.3623 => 0.3465, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.33% (0.3650 => 0.3492, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -4.22% (0.3601 => 0.3449, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -4.16% (0.3578 => 0.3429, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -4.11% (0.3646 => 0.3496, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -3.99% (0.3663 => 0.3517, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/property: -3.98% (0.3940 => 0.3783, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: -3.85% (0.3789 => 0.3643, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -3.77% (0.4003 => 0.3852, std. dev.: 0.0029) SingleSource/UnitTests/ObjC/exceptions: -3.68% (0.3914 => 0.3770, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.60% (0.6576 => 0.6405, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.31% (0.8818 => 0.8614, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/bigfib: -2.26% (0.6250 => 0.6109, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.42% (0.9108 => 0.8979, std. dev.: 0.0004) MultiSource/Applications/lua/lua: -1.19% (3.7467 => 3.7021, std. dev.: 0.0026) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.14% (1.0460 => 0.9504, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.17% (1.3780 => 1.3067, std. dev.: 0.0028) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9624, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.98% (2.5089 => 2.4090, std. dev.: 0.0040) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.65% (1.9762 => 1.9040, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/lists: -2.28% (6.3560 => 6.2110, std. dev.: 0.0184) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.15% (20.3410 => 19.9043, std. dev.: 0.0312) SingleSource/Benchmarks/Misc/richards_benchmark: -2.14% (1.1560 => 1.1313, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.89% (6.6320 => 6.5066, std. dev.: 0.0047) MultiSource/Applications/minisat/minisat: -1.83% (9.3358 => 9.1654, std. dev.: 0.0384) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9956, std. dev.: 0.0002) MultiSource/Applications/lua/lua: -1.57% (26.5159 => 26.0989, std. dev.: 0.0569) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.56% (0.9692 => 0.9541, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.51% (8.8259 => 8.6926, std. dev.: 0.0100) SingleSource/Benchmarks/Shootout/heapsort: -1.50% (3.9173 => 3.8584, std. dev.: 0.0024) MultiSource/Benchmarks/mafft/pairlocalalign: -1.49% (28.2225 => 27.8006, std. dev.: 0.0021) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.26s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu May 31 17:36:48 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 31 May 2012 19:36:48 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120601003648.CBE472A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/871?compare_to=870&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 871, Order: 157777, Start Time: 2012-05-31 23:41:28, End Time: 2012-06-01 00:37:54 To: 870, Order: 157763, Start Time: 2012-05-31 21:12:08, End Time: 2012-05-31 22:08:32 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (57 on baseline) Performance Improvements: 0 (42 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (791 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.40% (2.0176 => 2.2678, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.85% (0.3130 => 0.3313, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.06% (3.9660 => 4.0872, std. dev.: 0.0024) MultiSource/Benchmarks/nbench/nbench: 2.53% (1.0594 => 1.0862, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.48% (0.9199 => 0.9427, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.47% (0.6959 => 0.7131, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.47% (0.5265 => 0.5395, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/football/football: 2.38% (0.8310 => 0.8508, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 2.33% (13.8202 => 14.1416, std. dev.: 0.0150) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.23% (1.2193 => 1.2465, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.18% (0.5637 => 0.5760, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.06% (1.1364 => 1.1598, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.74% (1.3245 => 1.3476, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.60% (1.4563 => 1.4796, std. dev.: 0.0029) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.54% (0.7460 => 0.7575, std. dev.: 0.0012) MultiSource/Applications/siod/siod: 1.51% (2.1791 => 2.2121, std. dev.: 0.0031) MultiSource/Applications/Burg/burg: 1.51% (1.1061 => 1.1228, std. dev.: 0.0038) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.47% (13.2842 => 13.4791, std. dev.: 0.0135) MultiSource/Benchmarks/MallocBench/gs/gs: 1.43% (3.8646 => 3.9198, std. dev.: 0.0035) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.39% (0.7710 => 0.7817, std. dev.: 0.0034) MultiSource/Applications/treecc/treecc: 1.29% (1.9270 => 1.9518, std. dev.: 0.0016) MultiSource/Applications/kimwitu++/kc: 1.29% (16.6129 => 16.8267, std. dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.29% (3.2742 => 3.3163, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.17% (1.3813 => 1.3975, std. dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 1.16% (14.8535 => 15.0264, std. dev.: 0.0112) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.15% (1.3819 => 1.3978, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.10% (3.6692 => 3.7097, std. dev.: 0.0036) MultiSource/Applications/sqlite3/sqlite3: 1.04% (16.2614 => 16.4304, std. dev.: 0.0131) MultiSource/Applications/hbd/hbd: 1.03% (1.3693 => 1.3834, std. dev.: 0.0031) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.89% (0.4846 => 0.6973, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: 24.01% (1.8175 => 2.2539, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/mandel-2: 8.76% (1.2998 => 1.4137, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7298, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6754, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.81% (1.9144 => 1.9874, std. dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.65% (1.7688 => 1.8333, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/salsa20: 3.58% (7.4271 => 7.6929, std. dev.: 0.0020) MultiSource/Applications/hexxagon/hexxagon: 2.98% (12.0921 => 12.4530, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-6: 2.93% (1.9199 => 1.9761, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 2.79% (11.2619 => 11.5757, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.74% (2.8606 => 2.9391, std. dev.: 0.0022) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.43% (7.9275 => 8.1201, std. dev.: 0.0106) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 2.24% (4.5928 => 4.6955, std. dev.: 0.0017) MultiSource/Applications/siod/siod: 1.73% (3.2729 => 3.3295, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9603, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ffbench: 1.61% (0.8273 => 0.8406, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.42% (1.4298 => 1.4501, std. dev.: 0.0017) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5099, std. dev.: 0.0026) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.27% (1.9433 => 1.9680, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.26% (2.0200 => 2.0455, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1779, std. dev.: 0.0012) MultiSource/Benchmarks/sim/sim: 1.10% (5.0168 => 5.0722, std. dev.: 0.0069) SingleSource/Benchmarks/McGill/chomp: 1.02% (1.2308 => 1.2434, std. dev.: 0.0021) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -18.96% (0.4657 => 0.3774, std. dev.: 0.0175) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.04% (0.2670 => 0.2482, std. dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.00% (22.5627 => 20.9827, std. dev.: 0.0152) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.81% (0.3511 => 0.3272, std. dev.: 0.0036) SingleSource/UnitTests/ObjC/exceptions-3: -4.22% (0.3623 => 0.3470, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -4.19% (0.3601 => 0.3450, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.11% (0.3650 => 0.3500, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/synchronized: -4.10% (0.3663 => 0.3513, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -4.03% (0.3646 => 0.3499, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -4.02% (0.3578 => 0.3434, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: -3.76% (0.3940 => 0.3792, std. dev.: 0.0030) SingleSource/UnitTests/ObjC/for-in: -3.62% (0.3789 => 0.3652, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -3.50% (0.3914 => 0.3777, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -3.50% (0.4003 => 0.3863, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.09% (0.6576 => 0.6373, std. dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/bigfib: -2.46% (0.6250 => 0.6096, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.38% (0.8818 => 0.8608, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.52% (0.9108 => 0.8970, std. dev.: 0.0003) MultiSource/Applications/lua/lua: -1.30% (3.7467 => 3.6980, std. dev.: 0.0131) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.13% (1.0460 => 0.9505, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2640, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.12% (1.3780 => 1.3075, std. dev.: 0.0170) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9624, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -3.98% (2.5089 => 2.4091, std. dev.: 0.0030) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.73% (0.3458 => 0.3329, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.61% (1.9762 => 1.9048, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/richards_benchmark: -2.14% (1.1560 => 1.1313, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -2.03% (6.3560 => 6.2268, std. dev.: 0.0073) MultiSource/Applications/minisat/minisat: -1.96% (9.3358 => 9.1532, std. dev.: 0.0085) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.86% (6.6320 => 6.5089, std. dev.: 0.0046) MultiSource/Applications/lua/lua: -1.67% (26.5159 => 26.0740, std. dev.: 0.0249) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9951, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.56% (0.9692 => 0.9541, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.53% (8.8259 => 8.6907, std. dev.: 0.0167) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.50% (20.3410 => 20.0364, std. dev.: 0.0065) MultiSource/Benchmarks/mafft/pairlocalalign: -1.49% (28.2225 => 27.8008, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/heapsort: -1.40% (3.9173 => 3.8625, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.02% (3.8887 => 3.8492, std. dev.: 0.0028) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.52s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu May 31 18:59:37 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 31 May 2012 20:59:37 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120601015937.92B3E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/872?compare_to=871&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 872, Order: 157787, Start Time: 2012-06-01 01:03:59, End Time: 2012-06-01 02:00:43 To: 871, Order: 157777, Start Time: 2012-05-31 23:41:28, End Time: 2012-06-01 00:37:54 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (54 on baseline) Performance Improvements: 0 (42 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (794 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 11.56% (2.0176 => 2.2508, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.56% (0.3130 => 0.3304, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.81% (3.9660 => 4.0776, std. dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 2.49% (13.8202 => 14.1637, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.43% (0.6959 => 0.7128, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.41% (0.9199 => 0.9421, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.36% (0.5265 => 0.5389, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 2.23% (1.0594 => 1.0830, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 2.12% (0.8310 => 0.8486, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.03% (1.2193 => 1.2441, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.00% (0.5637 => 0.5750, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.89% (1.1364 => 1.1579, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.68% (0.7460 => 0.7585, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.60% (1.3245 => 1.3457, std. dev.: 0.0030) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.56% (0.7710 => 0.7830, std. dev.: 0.0033) MultiSource/Applications/siod/siod: 1.50% (2.1791 => 2.2118, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.48% (1.4563 => 1.4778, std. dev.: 0.0019) MultiSource/Benchmarks/MallocBench/gs/gs: 1.39% (3.8646 => 3.9184, std. dev.: 0.0022) MultiSource/Applications/Burg/burg: 1.32% (1.1061 => 1.1207, std. dev.: 0.0035) MultiSource/Applications/kimwitu++/kc: 1.31% (16.6129 => 16.8313, std. dev.: 0.0139) MultiSource/Applications/treecc/treecc: 1.29% (1.9270 => 1.9519, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.22% (13.2842 => 13.4460, std. dev.: 0.0059) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.15% (1.3813 => 1.3972, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.09% (1.3819 => 1.3969, std. dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.01% (3.2742 => 3.3073, std. dev.: 0.0126) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.93% (0.4846 => 0.6975, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: 24.28% (1.8175 => 2.2587, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/mandel-2: 8.91% (1.2998 => 1.4156, std. dev.: 0.0073) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.87% (1.5824 => 1.6753, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8145, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 3.79% (1.9144 => 1.9870, std. dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.64% (1.7688 => 1.8331, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: 3.59% (7.4271 => 7.6939, std. dev.: 0.0100) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4543, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-6: 2.90% (1.9199 => 1.9755, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 2.80% (11.2619 => 11.5769, std. dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.76% (2.8606 => 2.9395, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.55% (7.9275 => 8.1300, std. dev.: 0.0096) MultiSource/Applications/sqlite3/sqlite3: 2.28% (4.5928 => 4.6977, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 1.72% (3.2729 => 3.3292, std. dev.: 0.0011) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/ffbench: 1.60% (0.8273 => 0.8405, std. dev.: 0.0014) MultiSource/Applications/lemon/lemon: 1.43% (1.4298 => 1.4503, std. dev.: 0.0009) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5090, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.28% (2.0200 => 2.0459, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bisort/bisort: 1.23% (0.8239 => 0.8340, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.18% (1.9433 => 1.9663, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 1.15% (1.2308 => 1.2449, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1777, std. dev.: 0.0016) MultiSource/Benchmarks/sim/sim: 1.07% (5.0168 => 5.0703, std. dev.: 0.0123) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -20.79% (0.4657 => 0.3689, std. dev.: 0.0177) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.30% (0.2670 => 0.2475, std. dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.27% (22.5627 => 20.9226, std. dev.: 0.0136) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.89% (0.3511 => 0.3269, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -4.33% (0.3623 => 0.3466, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -4.22% (0.3601 => 0.3449, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.22% (0.3650 => 0.3496, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -4.14% (0.3578 => 0.3430, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -4.10% (0.3663 => 0.3513, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -4.09% (0.3646 => 0.3497, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/property: -3.93% (0.3940 => 0.3785, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -3.77% (0.3789 => 0.3646, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -3.65% (0.3914 => 0.3771, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -3.55% (0.4003 => 0.3861, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.13% (0.6576 => 0.6370, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: -2.59% (0.6250 => 0.6088, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.51% (0.8818 => 0.8597, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.70% (0.9108 => 0.8953, std. dev.: 0.0005) MultiSource/Applications/lua/lua: -1.36% (3.7467 => 3.6957, std. dev.: 0.0025) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.14% (1.0460 => 0.9504, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.75% (1.3780 => 1.3125, std. dev.: 0.0056) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9623, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -4.03% (2.5089 => 2.4077, std. dev.: 0.0046) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3458 => 0.3330, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.66% (1.9762 => 1.9039, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.13% (20.3410 => 19.9084, std. dev.: 0.0545) SingleSource/Benchmarks/Misc/richards_benchmark: -2.11% (1.1560 => 1.1316, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -2.08% (6.3560 => 6.2237, std. dev.: 0.0077) MultiSource/Applications/minisat/minisat: -2.00% (9.3358 => 9.1491, std. dev.: 0.0036) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.92% (6.6320 => 6.5044, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.60% (7.1097 => 6.9956, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.57% (0.9692 => 0.9540, std. dev.: 0.0000) MultiSource/Applications/lua/lua: -1.52% (26.5159 => 26.1132, std. dev.: 0.0421) MultiSource/Benchmarks/mafft/pairlocalalign: -1.50% (28.2225 => 27.8005, std. dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.30% (8.8259 => 8.7114, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout/heapsort: -1.27% (3.9173 => 3.8674, std. dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.02% (3.8887 => 3.8492, std. dev.: 0.0043) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.39s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu May 31 20:22:08 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 31 May 2012 22:22:08 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120601032208.07B552A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/873?compare_to=872&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 873, Order: 157788, Start Time: 2012-06-01 02:26:45, End Time: 2012-06-01 03:23:13 To: 872, Order: 157787, Start Time: 2012-06-01 01:03:59, End Time: 2012-06-01 02:00:43 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (52 on baseline) Performance Improvements: 0 (42 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (796 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 11.60% (2.0176 => 2.2516, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.62% (0.3130 => 0.3306, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.83% (3.9660 => 4.0781, std. dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.43% (0.5265 => 0.5393, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.41% (0.9199 => 0.9421, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.36% (0.6959 => 0.7123, std. dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 2.22% (13.8202 => 14.1273, std. dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C/football/football: 2.13% (0.8310 => 0.8487, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.12% (1.2193 => 1.2451, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.00% (0.5637 => 0.5750, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.93% (1.1364 => 1.1583, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.82% (0.7710 => 0.7850, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.63% (1.4563 => 1.4800, std. dev.: 0.0024) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.58% (0.7460 => 0.7578, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.56% (1.3245 => 1.3452, std. dev.: 0.0017) MultiSource/Benchmarks/MallocBench/gs/gs: 1.43% (3.8646 => 3.9197, std. dev.: 0.0074) MultiSource/Applications/Burg/burg: 1.28% (1.1061 => 1.1203, std. dev.: 0.0021) MultiSource/Applications/kimwitu++/kc: 1.25% (16.6129 => 16.8198, std. dev.: 0.0145) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.23% (13.2842 => 13.4473, std. dev.: 0.0116) MultiSource/Applications/treecc/treecc: 1.20% (1.9270 => 1.9502, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.18% (1.3819 => 1.3982, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.13% (1.3813 => 1.3969, std. dev.: 0.0023) MultiSource/Applications/SIBsim4/SIBsim4: 1.10% (1.2749 => 1.2889, std. dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.06% (3.2742 => 3.3089, std. dev.: 0.0014) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: 24.23% (1.8175 => 2.2578, std. dev.: 0.0112) SingleSource/Benchmarks/Misc/mandel-2: 7.89% (1.2998 => 1.4023, std. dev.: 0.0060) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7297, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.87% (1.5824 => 1.6753, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9876, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.72% (1.7688 => 1.8346, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/salsa20: 3.58% (7.4271 => 7.6931, std. dev.: 0.0062) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4545, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-6: 2.90% (1.9199 => 1.9755, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 2.79% (11.2619 => 11.5756, std. dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.75% (2.8606 => 2.9393, std. dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 2.29% (4.5928 => 4.6981, std. dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.29% (7.9275 => 8.1092, std. dev.: 0.0173) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 1.74% (3.2729 => 3.3297, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.56% (0.8273 => 0.8402, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5082, std. dev.: 0.0016) MultiSource/Applications/lemon/lemon: 1.39% (1.4298 => 1.4497, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.28% (2.0200 => 2.0458, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.24% (1.9433 => 1.9674, std. dev.: 0.0006) SingleSource/Benchmarks/McGill/chomp: 1.20% (1.2308 => 1.2456, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1778, std. dev.: 0.0013) MultiSource/Benchmarks/sim/sim: 1.02% (5.0168 => 5.0678, std. dev.: 0.0114) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -19.43% (0.4657 => 0.3752, std. dev.: 0.0078) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.30% (0.2670 => 0.2475, std. dev.: 0.0017) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.26% (22.5627 => 20.9248, std. dev.: 0.0017) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.92% (0.3511 => 0.3268, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-3: -4.33% (0.3623 => 0.3466, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -4.25% (0.3601 => 0.3448, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.19% (0.3650 => 0.3497, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-4: -4.17% (0.3646 => 0.3494, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -4.11% (0.3578 => 0.3431, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -4.07% (0.3663 => 0.3514, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -4.01% (0.3940 => 0.3782, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -3.73% (0.3914 => 0.3768, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -3.72% (0.3789 => 0.3648, std. dev.: 0.0023) SingleSource/UnitTests/ObjC/parameter-passing: -3.65% (0.4003 => 0.3857, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.24% (0.6576 => 0.6363, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: -2.69% (0.6250 => 0.6082, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.47% (0.8818 => 0.8600, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.68% (0.9108 => 0.8955, std. dev.: 0.0006) MultiSource/Applications/lua/lua: -1.38% (3.7467 => 3.6951, std. dev.: 0.0026) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.13% (1.0460 => 0.9505, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2640, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.15% (1.3780 => 1.3071, std. dev.: 0.0027) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9624, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -4.00% (2.5089 => 2.4086, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.64% (0.3458 => 0.3332, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.63% (1.9762 => 1.9045, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.16% (20.3410 => 19.9008, std. dev.: 0.0748) SingleSource/Benchmarks/Misc/richards_benchmark: -2.13% (1.1560 => 1.1314, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.97% (6.3560 => 6.2307, std. dev.: 0.0034) MultiSource/Applications/minisat/minisat: -1.96% (9.3358 => 9.1529, std. dev.: 0.0238) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.94% (6.6320 => 6.5033, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9955, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.56% (0.9692 => 0.9541, std. dev.: 0.0000) MultiSource/Applications/lua/lua: -1.51% (26.5159 => 26.1147, std. dev.: 0.0107) MultiSource/Benchmarks/mafft/pairlocalalign: -1.49% (28.2225 => 27.8014, std. dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.20% (8.8259 => 8.7198, std. dev.: 0.0064) SingleSource/Benchmarks/Shootout/heapsort: -1.17% (3.9173 => 3.8715, std. dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.09% (3.8887 => 3.8463, std. dev.: 0.0043) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.56s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu May 31 21:44:54 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 31 May 2012 23:44:54 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120601044454.072CC2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/874?compare_to=873&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 874, Order: 157793, Start Time: 2012-06-01 03:49:17, End Time: 2012-06-01 04:45:59 To: 873, Order: 157788, Start Time: 2012-06-01 02:26:45, End Time: 2012-06-01 03:23:13 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (57 on baseline) Performance Improvements: 0 (41 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 893 (792 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.24% (2.2516 => 2.2796, std. dev.: 0.0019) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 12.99% (2.0176 => 2.2796, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.13% (0.3130 => 0.3322, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.79% (0.2721 => 0.2824, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.08% (3.9660 => 4.0881, std. dev.: 0.0016) MultiSource/Benchmarks/nbench/nbench: 2.62% (1.0594 => 1.0872, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.61% (0.9199 => 0.9439, std. dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.60% (0.6959 => 0.7140, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 2.59% (13.8202 => 14.1776, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.53% (0.5265 => 0.5398, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/football/football: 2.49% (0.8310 => 0.8517, std. dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.22% (1.2193 => 1.2464, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.20% (1.1364 => 1.1614, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.18% (0.5637 => 0.5760, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.89% (1.3245 => 1.3495, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.70% (1.4563 => 1.4811, std. dev.: 0.0019) MultiSource/Applications/siod/siod: 1.70% (2.1791 => 2.2161, std. dev.: 0.0064) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.67% (13.2842 => 13.5062, std. dev.: 0.0065) MultiSource/Applications/lambda-0_1_3/lambda: 1.61% (0.7038 => 0.7151, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.56% (1.3813 => 1.4029, std. dev.: 0.0025) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.55% (0.7460 => 0.7576, std. dev.: 0.0011) MultiSource/Applications/treecc/treecc: 1.54% (1.9270 => 1.9567, std. dev.: 0.0093) MultiSource/Applications/Burg/burg: 1.49% (1.1061 => 1.1226, std. dev.: 0.0034) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.45% (0.7710 => 0.7822, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.43% (1.3819 => 1.4016, std. dev.: 0.0025) MultiSource/Applications/hbd/hbd: 1.42% (1.3693 => 1.3888, std. dev.: 0.0042) MultiSource/Benchmarks/MallocBench/gs/gs: 1.38% (3.8646 => 3.9180, std. dev.: 0.0031) MultiSource/Applications/SIBsim4/SIBsim4: 1.24% (1.2749 => 1.2907, std. dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 1.23% (14.8535 => 15.0358, std. dev.: 0.0034) MultiSource/Applications/sqlite3/sqlite3: 1.20% (16.2614 => 16.4566, std. dev.: 0.0197) MultiSource/Applications/kimwitu++/kc: 1.20% (16.6129 => 16.8123, std. dev.: 0.0066) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.17% (3.2742 => 3.3126, std. dev.: 0.0048) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.07% (3.6692 => 3.7085, std. dev.: 0.0020) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 24.43% (1.8175 => 2.2615, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/mandel-2: 7.39% (1.2998 => 1.3958, std. dev.: 0.0121) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7298, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.92% (1.5824 => 1.6760, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.80% (1.9144 => 1.9872, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.70% (1.7688 => 1.8342, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: 3.67% (7.4271 => 7.6998, std. dev.: 0.0057) MultiSource/Applications/hexxagon/hexxagon: 3.00% (12.0921 => 12.4544, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-6: 2.90% (1.9199 => 1.9755, std. dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 2.80% (11.2619 => 11.5772, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.74% (2.8606 => 2.9391, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.57% (7.9275 => 8.1316, std. dev.: 0.0064) MultiSource/Applications/sqlite3/sqlite3: 2.26% (4.5928 => 4.6968, std. dev.: 0.0074) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 1.76% (3.2729 => 3.3305, std. dev.: 0.0056) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 1.61% (0.8273 => 0.8406, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.50% (1.4298 => 1.4512, std. dev.: 0.0038) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5100, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.29% (2.0200 => 2.0461, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 1.12% (9.0760 => 9.1775, std. dev.: 0.0009) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -22.80% (0.4657 => 0.3595, std. dev.: 0.0365) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.31% (22.5627 => 20.9142, std. dev.: 0.0173) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.97% (0.2670 => 0.2484, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.69% (0.3511 => 0.3276, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: -4.55% (0.3623 => 0.3458, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.52% (0.3650 => 0.3485, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -4.44% (0.3601 => 0.3441, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -4.40% (0.3663 => 0.3502, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -4.39% (0.3646 => 0.3486, std. dev.: 0.0032) SingleSource/UnitTests/ObjC/trivial-interface: -4.33% (0.3578 => 0.3423, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -4.21% (0.3940 => 0.3774, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -3.99% (0.3789 => 0.3638, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -3.87% (0.4003 => 0.3848, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -3.86% (0.3914 => 0.3763, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.69% (0.8818 => 0.8581, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: -2.42% (0.6250 => 0.6099, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.52% (0.9108 => 0.8970, std. dev.: 0.0005) MultiSource/Applications/lua/lua: -1.25% (3.7467 => 3.6997, std. dev.: 0.0017) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.14% (1.0460 => 0.9504, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2641, std. dev.: 0.0004) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9623, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.34% (1.3780 => 1.3182, std. dev.: 0.0044) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -4.04% (2.5089 => 2.4076, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.73% (0.3458 => 0.3329, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.71% (1.9762 => 1.9029, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout/lists: -2.20% (6.3560 => 6.2164, std. dev.: 0.0187) SingleSource/Benchmarks/Misc/richards_benchmark: -2.12% (1.1560 => 1.1315, std. dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.08% (0.4867 => 0.4766, std. dev.: 0.0014) MultiSource/Applications/minisat/minisat: -1.95% (9.3358 => 9.1541, std. dev.: 0.0118) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.90% (6.6320 => 6.5059, std. dev.: 0.0046) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.74% (20.3410 => 19.9873, std. dev.: 0.0390) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9951, std. dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.56% (0.9692 => 0.9541, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.53% (8.8259 => 8.6909, std. dev.: 0.0190) MultiSource/Benchmarks/mafft/pairlocalalign: -1.49% (28.2225 => 27.8008, std. dev.: 0.0003) MultiSource/Applications/lua/lua: -1.44% (26.5159 => 26.1342, std. dev.: 0.0183) SingleSource/Benchmarks/Shootout/heapsort: -1.42% (3.9173 => 3.8615, std. dev.: 0.0063) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.52s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu May 31 23:31:02 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 1 Jun 2012 01:31:02 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120601063102.BD9B82A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/875?compare_to=874&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 875, Order: 157797, Start Time: 2012-06-01 05:35:20, End Time: 2012-06-01 06:32:08 To: 874, Order: 157793, Start Time: 2012-06-01 03:49:17, End Time: 2012-06-01 04:45:59 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (58 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (4 on baseline) Unchanged Tests: 894 (792 on baseline) Total Tests: 894 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.35% (2.0176 => 2.2869, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.01% (0.2721 => 0.2830, std. dev.: 0.0024) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.38% (3.9660 => 4.1000, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.87% (0.6959 => 0.7159, std. dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 2.85% (1.0594 => 1.0896, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.77% (0.9199 => 0.9454, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 2.72% (0.8310 => 0.8536, std. dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 2.71% (13.8202 => 14.1953, std. dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.60% (0.5265 => 0.5402, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.47% (0.5637 => 0.5776, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.44% (1.2193 => 1.2491, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.31% (1.1364 => 1.1627, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.06% (1.3245 => 1.3518, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.98% (1.4563 => 1.4852, std. dev.: 0.0016) MultiSource/Applications/siod/siod: 1.81% (2.1791 => 2.2186, std. dev.: 0.0034) MultiSource/Applications/treecc/treecc: 1.80% (1.9270 => 1.9616, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.78% (13.2842 => 13.5208, std. dev.: 0.0040) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.76% (0.7710 => 0.7846, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.76% (1.3819 => 1.4062, std. dev.: 0.0081) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.74% (1.3813 => 1.4053, std. dev.: 0.0013) MultiSource/Applications/lambda-0_1_3/lambda: 1.69% (0.7038 => 0.7157, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 1.65% (1.1061 => 1.1243, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 1.63% (3.8646 => 3.9274, std. dev.: 0.0035) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.62% (0.7460 => 0.7581, std. dev.: 0.0006) MultiSource/Applications/hbd/hbd: 1.50% (1.3693 => 1.3899, std. dev.: 0.0044) MultiSource/Applications/kimwitu++/kc: 1.48% (16.6129 => 16.8594, std. dev.: 0.0039) MultiSource/Applications/JM/lencod/lencod: 1.46% (14.8535 => 15.0706, std. dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.41% (3.2742 => 3.3204, std. dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: 1.34% (16.2614 => 16.4799, std. dev.: 0.0273) MultiSource/Applications/SIBsim4/SIBsim4: 1.32% (1.2749 => 1.2917, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.26% (3.6692 => 3.7153, std. dev.: 0.0032) MultiSource/Applications/d/make_dparser: 1.16% (3.1889 => 3.2258, std. dev.: 0.0038) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 23.76% (1.8175 => 2.2494, std. dev.: 0.0056) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (2.5629 => 2.7298, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: 6.45% (1.2998 => 1.3836, std. dev.: 0.0139) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.86% (1.5824 => 1.6752, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (4.5947 => 4.8144, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 3.72% (1.9144 => 1.9857, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: 3.63% (7.4271 => 7.6966, std. dev.: 0.0075) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.57% (1.7688 => 1.8320, std. dev.: 0.0019) MultiSource/Applications/hexxagon/hexxagon: 2.98% (12.0921 => 12.4529, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-6: 2.90% (1.9199 => 1.9755, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 2.81% (11.2619 => 11.5781, std. dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.76% (2.8606 => 2.9396, std. dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.34% (7.9275 => 8.1130, std. dev.: 0.0108) MultiSource/Applications/sqlite3/sqlite3: 2.29% (4.5928 => 4.6981, std. dev.: 0.0059) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 1.74% (3.2729 => 3.3297, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/ffbench: 1.60% (0.8273 => 0.8405, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: 1.45% (1.9290 => 1.9569, std. dev.: 0.0016) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5081, std. dev.: 0.0024) MultiSource/Applications/lemon/lemon: 1.38% (1.4298 => 1.4495, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.28% (2.0200 => 2.0459, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.14% (1.9433 => 1.9655, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 1.14% (9.0760 => 9.1794, std. dev.: 0.0007) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.18% (22.5627 => 20.9427, std. dev.: 0.0077) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.33% (0.2670 => 0.2501, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.12% (0.3511 => 0.3296, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: -4.50% (0.3623 => 0.3460, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -4.36% (0.3601 => 0.3444, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.36% (0.3650 => 0.3491, std. dev.: 0.0015) SingleSource/UnitTests/ObjC/trivial-interface: -4.33% (0.3578 => 0.3423, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -4.29% (0.3663 => 0.3506, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -4.25% (0.3646 => 0.3491, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -4.14% (0.3940 => 0.3777, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -3.88% (0.3789 => 0.3642, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: -3.68% (0.3914 => 0.3770, std. dev.: 0.0022) SingleSource/UnitTests/ObjC/parameter-passing: -3.67% (0.4003 => 0.3856, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.81% (0.6576 => 0.6391, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.37% (0.8818 => 0.8609, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: -2.24% (0.6250 => 0.6110, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.19% (0.9108 => 0.9000, std. dev.: 0.0001) MultiSource/Applications/lua/lua: -1.06% (3.7467 => 3.7068, std. dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.14% (1.0460 => 0.9504, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.21% (1.3780 => 1.3062, std. dev.: 0.0051) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/perlin: -4.60% (6.2497 => 5.9624, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -4.00% (2.5089 => 2.4085, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.73% (0.3458 => 0.3329, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -3.63% (1.9762 => 1.9044, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/richards_benchmark: -2.13% (1.1560 => 1.1314, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.95% (6.6320 => 6.5025, std. dev.: 0.0035) MultiSource/Applications/minisat/minisat: -1.91% (9.3358 => 9.1575, std. dev.: 0.0149) SingleSource/Benchmarks/Shootout/lists: -1.90% (6.3560 => 6.2355, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (7.1097 => 6.9953, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.56% (0.9692 => 0.9541, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.52% (3.9173 => 3.8579, std. dev.: 0.0032) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.50% (20.3410 => 20.0349, std. dev.: 0.0161) MultiSource/Benchmarks/mafft/pairlocalalign: -1.50% (28.2225 => 27.7991, std. dev.: 0.0007) MultiSource/Applications/lua/lua: -1.44% (26.5159 => 26.1338, std. dev.: 0.0582) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.37% (8.8259 => 8.7052, std. dev.: 0.0126) Added Tests - Compile Time -------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.52s -------------- next part -------------- An HTML attachment was scrubbed... URL: